-- Logs begin at Tue 2022-07-19 14:49:45 UTC, end at Tue 2022-07-19 15:53:42 UTC. -- Jul 19 15:17:26.129719 dv-cinder-849846-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 19 15:17:26.140570 dv-cinder-849846-2-smb devstack@keystone.service[80295]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 19 15:17:26.142397 dv-cinder-849846-2-smb devstack@keystone.service[80295]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 19 15:17:26 2022] *** Jul 19 15:17:26.142397 dv-cinder-849846-2-smb devstack@keystone.service[80295]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 19 15:17:26.142397 dv-cinder-849846-2-smb devstack@keystone.service[80295]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 19 15:17:26.142397 dv-cinder-849846-2-smb devstack@keystone.service[80295]: nodename: dv-cinder-849846-2-smb Jul 19 15:17:26.142397 dv-cinder-849846-2-smb devstack@keystone.service[80295]: machine: x86_64 Jul 19 15:17:26.142397 dv-cinder-849846-2-smb devstack@keystone.service[80295]: clock source: unix Jul 19 15:17:26.142397 dv-cinder-849846-2-smb devstack@keystone.service[80295]: pcre jit disabled Jul 19 15:17:26.142397 dv-cinder-849846-2-smb devstack@keystone.service[80295]: detected number of CPU cores: 4 Jul 19 15:17:26.142397 dv-cinder-849846-2-smb devstack@keystone.service[80295]: current working directory: / Jul 19 15:17:26.142397 dv-cinder-849846-2-smb devstack@keystone.service[80295]: detected binary path: /usr/bin/uwsgi-core Jul 19 15:17:26.143022 dv-cinder-849846-2-smb devstack@keystone.service[80295]: your processes number limit is 47680 Jul 19 15:17:26.143022 dv-cinder-849846-2-smb devstack@keystone.service[80295]: your memory page size is 4096 bytes Jul 19 15:17:26.143022 dv-cinder-849846-2-smb devstack@keystone.service[80295]: detected max file descriptor number: 2048 Jul 19 15:17:26.143022 dv-cinder-849846-2-smb devstack@keystone.service[80295]: lock engine: pthread robust mutexes Jul 19 15:17:26.143022 dv-cinder-849846-2-smb devstack@keystone.service[80295]: thunder lock: enabled Jul 19 15:17:26.143022 dv-cinder-849846-2-smb devstack@keystone.service[80295]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 19 15:17:26.143022 dv-cinder-849846-2-smb devstack@keystone.service[80295]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 19 15:17:26.187434 dv-cinder-849846-2-smb devstack@keystone.service[80295]: Python main interpreter initialized at 0x556566b619c0 Jul 19 15:17:26.187434 dv-cinder-849846-2-smb devstack@keystone.service[80295]: python threads support enabled Jul 19 15:17:26.187434 dv-cinder-849846-2-smb devstack@keystone.service[80295]: your server socket listen backlog is limited to 100 connections Jul 19 15:17:26.187434 dv-cinder-849846-2-smb devstack@keystone.service[80295]: your mercy for graceful operations on workers is 90 seconds Jul 19 15:17:26.187787 dv-cinder-849846-2-smb devstack@keystone.service[80295]: mapped 403077 bytes (393 KB) for 2 cores Jul 19 15:17:26.187865 dv-cinder-849846-2-smb devstack@keystone.service[80295]: *** Operational MODE: preforking *** Jul 19 15:17:26.188122 dv-cinder-849846-2-smb devstack@keystone.service[80295]: *** uWSGI is running in multiple interpreter mode *** Jul 19 15:17:26.188122 dv-cinder-849846-2-smb devstack@keystone.service[80295]: spawned uWSGI master process (pid: 80295) Jul 19 15:17:26.188318 dv-cinder-849846-2-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 19 15:17:26.189514 dv-cinder-849846-2-smb devstack@keystone.service[80295]: spawned uWSGI worker 1 (pid: 80304, cores: 1) Jul 19 15:17:26.189514 dv-cinder-849846-2-smb devstack@keystone.service[80295]: spawned uWSGI worker 2 (pid: 80305, cores: 1) Jul 19 15:17:26.190083 dv-cinder-849846-2-smb devstack@keystone.service[80295]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 19 15:17:31.646562 dv-cinder-849846-2-smb devstack@keystone.service[80305]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 15:17:31.646562 dv-cinder-849846-2-smb devstack@keystone.service[80305]: from cryptography.utils import int_from_bytes Jul 19 15:17:31.647439 dv-cinder-849846-2-smb devstack@keystone.service[80304]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 15:17:31.647439 dv-cinder-849846-2-smb devstack@keystone.service[80304]: from cryptography.utils import int_from_bytes Jul 19 15:17:31.647855 dv-cinder-849846-2-smb devstack@keystone.service[80305]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 15:17:31.647855 dv-cinder-849846-2-smb devstack@keystone.service[80305]: from cryptography.utils import int_from_bytes Jul 19 15:17:31.647962 dv-cinder-849846-2-smb devstack@keystone.service[80304]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 15:17:31.647962 dv-cinder-849846-2-smb devstack@keystone.service[80304]: from cryptography.utils import int_from_bytes Jul 19 15:17:31.696974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 15:17:31.697153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 15:17:31.697355 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] command line args: [] {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 15:17:31.697466 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 15:17:31.697629 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 15:17:31.697718 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 15:17:31.697798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ================================================================================ {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 15:17:31.697876 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] command line args: [] {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 15:17:31.698054 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] admin_token = **** {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.698163 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 15:17:31.698304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] config_dir = [] {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.698394 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ================================================================================ {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 15:17:31.698498 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.698621 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] admin_token = **** {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.698700 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] config_source = [] {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.698855 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] debug = True {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.698941 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] config_dir = [] {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.699055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.699350 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.699350 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] config_source = [] {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.699461 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.699519 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] debug = True {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.699674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.699754 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.699876 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.699992 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.700101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.700204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.700340 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] list_limit = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.700452 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.700555 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] log_config_append = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.700650 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.700755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.700864 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] log_dir = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.700964 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] list_limit = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.701065 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] log_file = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.701163 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] log_config_append = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.701264 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.701375 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.701468 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] log_dir = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.701542 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.701665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] log_file = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.701742 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.701849 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.701982 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.702114 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.702193 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.702319 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.702400 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.702523 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.702611 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.702755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.702831 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.702960 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.703039 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.703210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.703313 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.703469 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.703597 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.703704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.703783 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.703952 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.704077 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.704212 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.704291 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.704459 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.704537 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.704731 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.705015 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.705134 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.705212 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] publish_errors = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.705418 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.705507 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.705648 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.705832 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.705945 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.706079 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] publish_errors = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.706158 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.706314 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.706391 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.706548 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.706649 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] standard_threads = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.706730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.706801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.706966 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.707050 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.707173 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.707266 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.707386 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] use_journal = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.707473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] standard_threads = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.707551 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] use_json = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.707689 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.707775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] use_stderr = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.707854 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] use_syslog = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.707924 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.708086 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.708170 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.708250 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] use_journal = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.708345 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.708429 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] use_json = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.708585 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.708699 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] use_stderr = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.708801 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] use_syslog = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.708888 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.708982 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:17:31.709060 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.709242 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.709319 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.709485 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.709574 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.710260 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.710345 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.710505 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.710590 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.710756 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.710842 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.710999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.711077 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.711269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.711350 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.711511 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.711602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.711759 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.711842 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.711995 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.712072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.712245 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.712332 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.712481 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.712568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.712722 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.712800 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.712958 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.713111 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.713192 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.713263 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.713448 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.713528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.713684 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.713771 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.713941 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.714018 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.714198 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.714276 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.714446 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.714532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.714684 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.714762 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.714917 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.715001 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.715150 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.715253 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.715408 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.715486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.715646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.715723 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.715898 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.715987 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.716140 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.716217 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.716370 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.716447 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.716606 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.716684 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.716855 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.716945 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.717276 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.717359 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.717441 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.717564 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.717647 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.717796 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.717872 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.718033 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.718122 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.718293 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.718390 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.718502 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.718581 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.718737 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.718889 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.718964 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.719029 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.719192 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.719460 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.719540 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.719712 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.719792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.719946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.720025 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.720180 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.720258 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.720410 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.720498 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.720643 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.720716 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.720879 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.720945 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.721127 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.721206 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.721358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.721436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.721597 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.721674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.721831 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.721909 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.722067 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.722151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.722304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.722406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.722541 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.722612 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.722771 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.722839 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.723014 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.723092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.723267 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.723351 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.723560 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.723646 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.723725 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.723806 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.723969 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.724056 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.724202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.724289 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.724434 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.724518 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.724674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.724761 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.724911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.724985 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.725141 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.725227 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.725450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.726062 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.726208 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.726285 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.726443 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.726522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.726685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.726764 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.726924 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.727003 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.727165 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.727257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.727444 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.727587 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.727726 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.727851 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.727975 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.728102 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.728235 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.728369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.728493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.728622 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.728622 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.728807 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.728807 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.729087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.729210 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.729337 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.729475 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.729608 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.729608 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.729858 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.729987 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.730113 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.730240 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.730366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.730493 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.730628 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.730753 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.730871 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.730999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.731122 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.731122 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.731466 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.731605 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.731733 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.731859 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.731986 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.732114 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.732248 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.732384 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.732520 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.732649 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.732776 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.732903 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.733039 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.733164 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.733299 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.733425 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.733549 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.733677 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.733797 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.733925 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.734060 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.734195 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.734321 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.734321 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.734557 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.734690 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.734833 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.734833 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] auth.external = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.735078 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.735205 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.735391 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.735391 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.735641 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.735771 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.735903 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.735903 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] auth.password = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.736142 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.736277 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] auth.token = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.736433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.736581 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.736717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] auth.external = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.736846 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.736979 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.737107 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.737242 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.737382 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.737464 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.737626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.737762 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] auth.password = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.737897 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.738025 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] auth.token = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.738160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.738288 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.738422 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] credential.caching = True {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.738551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.738678 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.738810 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.738952 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.739080 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.739206 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.739350 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.739479 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.739606 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.739748 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.739879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.740013 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.740146 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] credential.caching = True {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.740282 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.740410 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.740410 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.740661 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.740661 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.740943 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.740943 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.741182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.741317 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.741451 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.741578 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.741705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.741833 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.741969 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.742106 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.742233 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.742382 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.742505 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.742633 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.742767 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] federation.caching = True {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.742902 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.743038 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.743168 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.743305 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.743305 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.743543 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.743682 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.743817 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.743944 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.744071 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.744199 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.744325 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] federation.caching = True {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.744461 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.744589 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.744717 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.744842 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.744968 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.745096 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.745232 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.745358 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.745492 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.745616 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.745746 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] identity.caching = True {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.745874 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.746009 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.746140 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.746269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.746394 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.746521 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.746653 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.746853 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.746981 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.746981 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.747271 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.747407 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] identity.caching = True {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.747547 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.747684 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.747813 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.747947 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.748075 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.748202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.748338 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.748465 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.748591 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.748591 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.748826 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.748953 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.749098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.749225 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.749352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.749480 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.749607 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.749734 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.749867 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.749994 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.750120 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.750244 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.750371 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.750371 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.750620 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.750620 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.750871 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.750998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.751122 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.751262 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.751396 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.751522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.751645 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.751768 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.751890 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.752013 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.752143 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.752267 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.752390 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.752524 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.752649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.752772 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.752903 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.753027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.753150 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.753273 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.753396 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.753519 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.753651 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.753774 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.753897 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.754021 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.754143 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.754274 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.754406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.754530 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.754653 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.754776 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.754898 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.755021 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.755152 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.755369 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.755495 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.755623 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.755751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.755877 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.756014 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.756152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.756286 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.756412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.756581 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.756706 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.756841 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.756970 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.757069 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.757199 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.757321 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.757450 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.757588 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.757716 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.757854 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.757981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.758106 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.758232 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.758365 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.758492 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.758617 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.758742 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.758868 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.758995 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.user = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.759129 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.759270 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.759394 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.759518 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.759652 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.759776 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.759910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.760035 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.760157 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.760279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.760402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.760533 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.760657 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.user = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.760780 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.760903 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.761027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.761150 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.761290 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.761415 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.761539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.761661 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.761784 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.761907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.762038 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.762162 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.762285 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.762407 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.762530 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.762653 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.762784 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.762908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.763040 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.763164 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.763338 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.763467 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.763602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.763731 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.763859 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.763983 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.764111 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.764238 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.764373 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.764499 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.764654 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.764775 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.764915 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.765041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.765177 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.765304 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.765431 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.765557 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.765685 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.765811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.765950 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.766082 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.766212 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.766339 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.766466 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.766607 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.766748 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.766876 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.767001 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.767125 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.767267 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.767391 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.767525 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.767655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.767785 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.767868 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.768029 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.768152 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.768283 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.768416 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.768545 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] resource.caching = True {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.768668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.768791 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.768913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.769043 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.769166 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.769248 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.769409 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.769531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.769654 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.769785 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.769908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.770031 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.770162 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] resource.caching = True {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.770285 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.770410 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.770540 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.770664 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.770787 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.770909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.771032 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] role.caching = True {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.771153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.771389 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] role.driver = sql {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.771521 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.771599 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.771671 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.771743 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.771814 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.771895 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.771969 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.772040 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.772112 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.772726 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.772803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] role.caching = True {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.772885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.772960 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] role.driver = sql {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.773031 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.773102 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.773173 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.773243 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.773322 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.773395 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.773467 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.773537 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.773608 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.773687 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.773760 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.773831 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.773902 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.773973 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.774044 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.774122 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.774122 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.774252 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.774322 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.774393 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.774463 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.774542 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.774615 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.774686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.774757 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.774827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.774897 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.774979 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.774979 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.775114 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.775186 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.775279 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.775353 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.775436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.775511 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.775583 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.775654 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.775724 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.775795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.775874 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.775948 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.776018 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.776095 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.776168 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.776239 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.776318 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.776392 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.776462 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.776533 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.776604 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.776683 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.776756 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.776827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.776897 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.776967 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] token.caching = True {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.777038 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.777120 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.777194 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.777265 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.777336 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.777406 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.777477 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.777556 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.777629 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.777700 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.777770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.777841 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.777911 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] token.caching = True {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.777990 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.778063 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.778177 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.778258 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.778331 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.778402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.778482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.778561 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.778635 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.778707 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.778778 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.778849 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.778928 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.779002 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.779073 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.779144 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.779215 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.779334 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.779419 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.779494 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.779820 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.779895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.779967 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] database.connection = **** {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.780126 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.780217 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.780374 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.780463 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.780629 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.780709 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.780865 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.780945 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.781111 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.781200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.781350 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.781430 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.781589 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.781669 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] database.connection = **** {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.781828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.781918 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.782076 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.782158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.782316 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.782397 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.782562 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.782641 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.782805 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.782892 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.783046 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.783126 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.783303 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.783386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.783543 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.783624 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.783773 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.783853 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.784015 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.784095 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.784253 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.784335 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.784407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 15:17:31.784480 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.784733 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.784970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.785222 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.785456 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.785699 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.785937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:17:31.786112 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 15:17:31.815476 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:31.815709 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:31.815940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:31.816104 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:31.816341 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:31.816574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:31.824952 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:31.825817 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:31.853192 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:31.853428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:31.853797 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:31.854041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:31.996246 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:31.996430 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.045451 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.045627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.045715 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.045791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.110471 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.110704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.110933 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.111049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.111163 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.111273 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.111409 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.111492 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.111630 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.111717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.111905 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.112126 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.137028 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.137228 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.137318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.137398 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.137474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.137582 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.137668 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.137809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.137896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.138030 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.138120 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.138246 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.138348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.138461 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.150128 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.150342 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.163039 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.163295 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.163382 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.163521 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.163605 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.163741 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.163836 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.163957 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.164040 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.164173 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.164256 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.164385 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80305) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.164476 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.164599 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 15:17:32.181956 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.182064 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.182169 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 19 15:17:32.182268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 19 15:17:32.182512 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.182596 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.182717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 19 15:17:32.182799 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 19 15:17:32.182986 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.183099 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.183270 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.183356 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.183534 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.183617 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.183789 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.183871 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.195453 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.195547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.195737 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.195821 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.196013 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.196156 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.196318 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.196439 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.204449 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.204582 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.207942 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.208048 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.208048 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.208190 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.208319 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.208403 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.208711 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.208795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.209001 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.209082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.209266 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.209349 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.209541 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.209624 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.210378 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.210482 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.210961 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.211060 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.211060 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.211194 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.211303 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.211380 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.237656 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.237963 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.239302 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.239586 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.239691 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.239900 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.244916 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.245193 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.245436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.245542 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.245721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.246009 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.252830 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.253063 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.253332 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.253617 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.258223 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.258514 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.258790 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.258895 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.259076 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.259168 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.259381 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.259473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.259659 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.259761 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.259932 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.260020 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.260203 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.260292 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.260508 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.260749 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.278888 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.279169 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.280165 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.280447 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.284045 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.285154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.288324 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.288523 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.289359 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.289657 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.293555 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.294935 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.297219 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.298406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.301015 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.301318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.301622 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.301917 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.302187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.302291 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.302477 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.302568 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.302777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.303068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.303383 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.303739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.321936 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.322329 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.322602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.323016 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.323109 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.323478 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.323758 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.324031 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.332332 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.333770 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.334058 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.334343 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.336136 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.336416 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.338256 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.338583 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.338915 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.339268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.339673 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.341405 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.341887 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.342185 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.342481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.342858 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.353278 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.353566 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.353854 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.354151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.354440 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.354738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.355022 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.356966 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.357281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.357569 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.357857 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.358142 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.358445 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.358902 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.375004 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.378336 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.382220 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.383862 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.385500 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.385781 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.386073 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.387055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.390438 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.393613 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.393779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.395241 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.395404 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.397308 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.398114 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.398399 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.399043 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.399360 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.399652 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.399943 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.406164 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.407800 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.409435 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.409729 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.410016 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.410987 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.411294 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.411585 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.411855 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.418569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.418850 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.419139 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.419443 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.419721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.420007 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.420287 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.420570 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.420855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.421128 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.421492 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.421674 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.421947 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.422217 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.422346 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.422518 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.422798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.432789 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80305) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 15:17:32.433063 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.433340 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.433617 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.433884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.434160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.434431 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.434701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.434975 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.435257 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.435535 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.435794 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.436054 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.436315 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80305) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 15:17:32.461565 dv-cinder-849846-2-smb devstack@keystone.service[80304]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556566b619c0 pid: 80304 (default app) Jul 19 15:17:32.464973 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ce79a-5621-44ad-8369-c3995aedd125 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:32.465274 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ce79a-5621-44ad-8369-c3995aedd125 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:32.465559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ce79a-5621-44ad-8369-c3995aedd125 None None] PATH_INFO: `/v3` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:32.469810 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 791 bytes} [Tue Jul 19 15:17:32 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:17:32.476434 dv-cinder-849846-2-smb devstack@keystone.service[80305]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556566b619c0 pid: 80305 (default app) Jul 19 15:17:40.129774 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2883d3-9371-44c3-afef-b3c933aa7748 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:40.130301 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2883d3-9371-44c3-afef-b3c933aa7748 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:40.130301 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2883d3-9371-44c3-afef-b3c933aa7748 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:40.132316 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 2/2] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:17:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:17:40.139955 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a83b71-08ca-4d83-b930-dba3a485beac None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:40.140389 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a83b71-08ca-4d83-b930-dba3a485beac None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:40.140525 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a83b71-08ca-4d83-b930-dba3a485beac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:40.213316 dv-cinder-849846-2-smb devstack@keystone.service[80305]: INFO dbcounter [None req-d8a83b71-08ca-4d83-b930-dba3a485beac None None] Registered counter for database keystone Jul 19 15:17:40.234190 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG oslo_db.sqlalchemy.engines [None req-d8a83b71-08ca-4d83-b930-dba3a485beac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:17:40.240620 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writer thread running {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:17:40.418332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG passlib.handlers.bcrypt [None req-d8a83b71-08ca-4d83-b930-dba3a485beac None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80305) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 19 15:17:40.418671 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG passlib.handlers.bcrypt [None req-d8a83b71-08ca-4d83-b930-dba3a485beac None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80305) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 19 15:17:40.475823 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-d8a83b71-08ca-4d83-b930-dba3a485beac None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:17:40.477647 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-d8a83b71-08ca-4d83-b930-dba3a485beac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:17:40.599958 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1/3] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:17:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 19 15:17:40.820939 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2883d3-9371-44c3-afef-b3c933aa7748 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:40.891290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: INFO dbcounter [None req-6a2883d3-9371-44c3-afef-b3c933aa7748 None None] Registered counter for database keystone Jul 19 15:17:40.911158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG oslo_db.sqlalchemy.engines [None req-6a2883d3-9371-44c3-afef-b3c933aa7748 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:17:40.917803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writer thread running {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:17:41.037094 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2883d3-9371-44c3-afef-b3c933aa7748 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:41.041896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675bff75-c227-4616-bdbc-d44b8045302e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:41.042574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bff75-c227-4616-bdbc-d44b8045302e admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:41.042863 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bff75-c227-4616-bdbc-d44b8045302e admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:41.043149 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bff75-c227-4616-bdbc-d44b8045302e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:41.051822 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675bff75-c227-4616-bdbc-d44b8045302e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:41.103705 dv-cinder-849846-2-smb devstack@keystone.service[80304]: WARNING keystone.common.rbac_enforcer.enforcer [None req-675bff75-c227-4616-bdbc-d44b8045302e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 19 15:17:41.104044 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675bff75-c227-4616-bdbc-d44b8045302e admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:41.114658 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 3/4] 10.222.0.44 () {58 vars in 1324 bytes} [Tue Jul 19 15:17:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 15:17:41.121821 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a83b71-08ca-4d83-b930-dba3a485beac None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:41.139852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a83b71-08ca-4d83-b930-dba3a485beac None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:41.145054 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57f0ad-2e9a-4fcb-a9c3-65ae3fb8f1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:41.146196 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57f0ad-2e9a-4fcb-a9c3-65ae3fb8f1bd admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:41.146491 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57f0ad-2e9a-4fcb-a9c3-65ae3fb8f1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:41.146773 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57f0ad-2e9a-4fcb-a9c3-65ae3fb8f1bd admin admin] PATH_INFO: `/v3/projects/32cd8d80a1f1402daab4eabadc4fd0b7` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:41.148335 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57f0ad-2e9a-4fcb-a9c3-65ae3fb8f1bd admin admin] RBAC: Authorizing `identity:get_project(project_id=32cd8d80a1f1402daab4eabadc4fd0b7)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:41.198850 dv-cinder-849846-2-smb devstack@keystone.service[80305]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5a57f0ad-2e9a-4fcb-a9c3-65ae3fb8f1bd admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 19 15:17:41.199194 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57f0ad-2e9a-4fcb-a9c3-65ae3fb8f1bd admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:41.203948 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 2/5] 10.222.0.44 () {56 vars in 1207 bytes} [Tue Jul 19 15:17:41 2022] GET /identity/v3/projects/32cd8d80a1f1402daab4eabadc4fd0b7 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:17:43.256230 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3140a9-4abd-4c3b-97c1-687e2dea4365 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:43.256803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3140a9-4abd-4c3b-97c1-687e2dea4365 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:43.256803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3140a9-4abd-4c3b-97c1-687e2dea4365 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:43.260898 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 4/6] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:17:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:17:43.266324 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6d7e6-4d8c-46ad-969e-44c0b133938d None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:43.266720 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6d7e6-4d8c-46ad-969e-44c0b133938d None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:43.266883 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6d7e6-4d8c-46ad-969e-44c0b133938d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:43.285966 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-1ba6d7e6-4d8c-46ad-969e-44c0b133938d None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:17:43.287488 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-1ba6d7e6-4d8c-46ad-969e-44c0b133938d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:17:43.295798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 3/7] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:17:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 19 15:17:43.317555 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3140a9-4abd-4c3b-97c1-687e2dea4365 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:43.330112 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3140a9-4abd-4c3b-97c1-687e2dea4365 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:43.334433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea6d04-42e8-4ca5-958e-23614a900e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:43.335659 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea6d04-42e8-4ca5-958e-23614a900e0c admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:43.335947 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea6d04-42e8-4ca5-958e-23614a900e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:43.336224 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea6d04-42e8-4ca5-958e-23614a900e0c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:43.343918 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea6d04-42e8-4ca5-958e-23614a900e0c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:43.345680 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea6d04-42e8-4ca5-958e-23614a900e0c admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:43.354348 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 5/8] 10.222.0.44 () {58 vars in 1324 bytes} [Tue Jul 19 15:17:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 15:17:43.359915 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6d7e6-4d8c-46ad-969e-44c0b133938d None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:43.368846 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6d7e6-4d8c-46ad-969e-44c0b133938d None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:43.373165 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc236e13-4b4e-4cbe-a3e2-4e24788f2b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:43.374017 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc236e13-4b4e-4cbe-a3e2-4e24788f2b3c admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:43.374297 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc236e13-4b4e-4cbe-a3e2-4e24788f2b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:43.374568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc236e13-4b4e-4cbe-a3e2-4e24788f2b3c admin admin] PATH_INFO: `/v3/users/a5979772c3b54e8bb6dcc49d7d98fa0c` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:43.375983 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc236e13-4b4e-4cbe-a3e2-4e24788f2b3c admin admin] RBAC: Authorizing `identity:get_user(user_id=a5979772c3b54e8bb6dcc49d7d98fa0c)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:43.377790 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc236e13-4b4e-4cbe-a3e2-4e24788f2b3c admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:43.379379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 4/9] 10.222.0.44 () {56 vars in 1198 bytes} [Tue Jul 19 15:17:43 2022] GET /identity/v3/users/a5979772c3b54e8bb6dcc49d7d98fa0c => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:17:45.476635 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c50a5-ebb8-41d2-af2b-d19b11eb6a5b None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:45.477174 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c50a5-ebb8-41d2-af2b-d19b11eb6a5b None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:45.477174 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c50a5-ebb8-41d2-af2b-d19b11eb6a5b None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:45.478586 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 6/10] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:17:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:17:45.483453 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9eff82-3528-4560-9674-96a9b28a166f None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:45.483889 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ca63b-65a7-4f92-a089-fd0d36cd756e None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:45.483979 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9eff82-3528-4560-9674-96a9b28a166f None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:45.484065 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ca63b-65a7-4f92-a089-fd0d36cd756e None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:45.484149 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9eff82-3528-4560-9674-96a9b28a166f None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:45.484242 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ca63b-65a7-4f92-a089-fd0d36cd756e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:45.485364 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 5/11] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:17:45.490460 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f4f94-f1b0-4074-b553-9721c0a04cea None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:45.490832 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f4f94-f1b0-4074-b553-9721c0a04cea None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:45.491111 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f4f94-f1b0-4074-b553-9721c0a04cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:45.507434 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-2a4f4f94-f1b0-4074-b553-9721c0a04cea None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:17:45.508626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-2a4f4f94-f1b0-4074-b553-9721c0a04cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:17:45.523523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG passlib.handlers.bcrypt [None req-092ca63b-65a7-4f92-a089-fd0d36cd756e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80304) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 19 15:17:45.523963 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG passlib.handlers.bcrypt [None req-092ca63b-65a7-4f92-a089-fd0d36cd756e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80304) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 19 15:17:45.570435 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-092ca63b-65a7-4f92-a089-fd0d36cd756e None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:17:45.572076 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-092ca63b-65a7-4f92-a089-fd0d36cd756e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:17:45.599844 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 6/12] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:17:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:17:45.622702 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f4f94-f1b0-4074-b553-9721c0a04cea None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:45.646395 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:45.679868 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 7/13] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:17:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:17:45.702555 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ca63b-65a7-4f92-a089-fd0d36cd756e None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:45.727634 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f4f94-f1b0-4074-b553-9721c0a04cea None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:45.761748 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3eb49-d859-4d0e-b790-4636cfe4a53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:45.762393 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3eb49-d859-4d0e-b790-4636cfe4a53e None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:45.762680 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3eb49-d859-4d0e-b790-4636cfe4a53e None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:45.762965 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3eb49-d859-4d0e-b790-4636cfe4a53e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:45.803950 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ca63b-65a7-4f92-a089-fd0d36cd756e None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:45.806243 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:45.831479 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c3eb49-d859-4d0e-b790-4636cfe4a53e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:45.832971 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c3eb49-d859-4d0e-b790-4636cfe4a53e None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:45.843515 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa0db6-a2da-49a2-8ff2-ecac52a28ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:45.844568 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa0db6-a2da-49a2-8ff2-ecac52a28ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:45.844858 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa0db6-a2da-49a2-8ff2-ecac52a28ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:45.845138 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa0db6-a2da-49a2-8ff2-ecac52a28ab6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:45.857857 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:45.858067 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa0db6-a2da-49a2-8ff2-ecac52a28ab6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:17:45.869705 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-e5aa0db6-a2da-49a2-8ff2-ecac52a28ab6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:17:45.869705 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:17:45.869705 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:17:45.869705 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:17:45.869705 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:17:45.869705 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:17:45.869705 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:17:45.869705 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:17:45.869705 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:17:45.869705 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:17:45.869705 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:17:45.869705 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:17:45.869705 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:17:45.869705 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:17:45.869705 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:17:45.869705 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:17:45.870818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:17:45.870818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:17:45.870818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:17:45.870818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:17:45.870818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:17:45.870818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:17:45.870818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:17:45.870818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:17:45.870818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:17:45.870818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:17:45.870818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:17:45.870818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:17:45.870818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:17:45.870818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:17:45.870818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:17:45.870818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:17:45.876469 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:17:45.876469 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:17:45.876469 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:17:45.876469 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:17:45.876469 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:17:45.876469 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:17:45.876469 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:17:45.876469 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:17:45.876469 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:17:45.876469 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:17:45.876469 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:17:45.876469 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:17:45.876469 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 8/14] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:17:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:17:45.877108 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa0db6-a2da-49a2-8ff2-ecac52a28ab6 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:45.938873 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 7/15] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:17:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 15:17:45.945398 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3eb49-d859-4d0e-b790-4636cfe4a53e None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:45.985200 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa0db6-a2da-49a2-8ff2-ecac52a28ab6 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:46.025850 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdf44a-857d-40c4-8044-467facbb62cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:46.026950 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdf44a-857d-40c4-8044-467facbb62cc None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:46.027313 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdf44a-857d-40c4-8044-467facbb62cc None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:46.027639 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdf44a-857d-40c4-8044-467facbb62cc None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:46.028539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbdf44a-857d-40c4-8044-467facbb62cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:17:46.028880 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbdf44a-857d-40c4-8044-467facbb62cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:46.030628 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbdf44a-857d-40c4-8044-467facbb62cc None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:46.043917 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 9/16] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:17:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:17:46.048547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdf44a-857d-40c4-8044-467facbb62cc None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:46.051601 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3eb49-d859-4d0e-b790-4636cfe4a53e None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:46.075629 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:46.078707 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:46.088816 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a8bc7-920f-4d67-9806-4f3b6b59ef10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:46.089614 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a8bc7-920f-4d67-9806-4f3b6b59ef10 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:46.089902 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a8bc7-920f-4d67-9806-4f3b6b59ef10 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:46.090182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a8bc7-920f-4d67-9806-4f3b6b59ef10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:46.100139 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a8bc7-920f-4d67-9806-4f3b6b59ef10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:46.101626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a8bc7-920f-4d67-9806-4f3b6b59ef10 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:46.122464 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-297a8bc7-920f-4d67-9806-4f3b6b59ef10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:17:46.122464 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:17:46.122464 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:17:46.122464 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:17:46.122464 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:17:46.122464 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:17:46.122464 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:17:46.122464 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:17:46.122464 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:17:46.122464 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:17:46.122464 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:17:46.122464 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:17:46.122464 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:17:46.122464 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:17:46.122464 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:17:46.123834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:17:46.123834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:17:46.123834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:17:46.123834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:17:46.123834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:17:46.123834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:17:46.123834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:17:46.123834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:17:46.123834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:17:46.123834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:17:46.123834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:17:46.123834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:17:46.123834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:17:46.123834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:17:46.123834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:17:46.123834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:17:46.123834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:17:46.124971 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:17:46.124971 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:17:46.124971 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:17:46.124971 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:17:46.124971 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 8/17] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:17:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:17:46.129461 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a8bc7-920f-4d67-9806-4f3b6b59ef10 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:46.154519 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdf44a-857d-40c4-8044-467facbb62cc None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:46.190423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2ccf9-a5e9-4a2a-8c3c-c6642910d118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:46.191413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2ccf9-a5e9-4a2a-8c3c-c6642910d118 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:46.191727 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2ccf9-a5e9-4a2a-8c3c-c6642910d118 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:46.192067 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2ccf9-a5e9-4a2a-8c3c-c6642910d118 None admin] PATH_INFO: `/v3/users/a5979772c3b54e8bb6dcc49d7d98fa0c` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:46.193681 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2ccf9-a5e9-4a2a-8c3c-c6642910d118 None admin] RBAC: Authorizing `identity:get_user(user_id=a5979772c3b54e8bb6dcc49d7d98fa0c)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:46.195918 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2ccf9-a5e9-4a2a-8c3c-c6642910d118 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:46.198019 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 10/18] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:17:46 2022] GET /identity/v3/users/a5979772c3b54e8bb6dcc49d7d98fa0c => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:17:46.203241 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2ccf9-a5e9-4a2a-8c3c-c6642910d118 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:46.235128 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a8bc7-920f-4d67-9806-4f3b6b59ef10 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:46.272995 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7bbf85-9c48-4853-808f-bbacb75aaa36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:46.273578 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bbf85-9c48-4853-808f-bbacb75aaa36 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:46.273903 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bbf85-9c48-4853-808f-bbacb75aaa36 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:46.274145 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bbf85-9c48-4853-808f-bbacb75aaa36 None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:46.275059 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7bbf85-9c48-4853-808f-bbacb75aaa36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:17:46.275178 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7bbf85-9c48-4853-808f-bbacb75aaa36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:46.276581 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7bbf85-9c48-4853-808f-bbacb75aaa36 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:46.294711 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 9/19] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:17:46.298243 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:46.306667 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2ccf9-a5e9-4a2a-8c3c-c6642910d118 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:46.347520 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd16a5-fd7d-4a14-b433-bc4a708a3d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:46.348345 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd16a5-fd7d-4a14-b433-bc4a708a3d53 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:46.348635 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd16a5-fd7d-4a14-b433-bc4a708a3d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:46.348923 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd16a5-fd7d-4a14-b433-bc4a708a3d53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:46.350808 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd16a5-fd7d-4a14-b433-bc4a708a3d53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:46.352448 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd16a5-fd7d-4a14-b433-bc4a708a3d53 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:46.354471 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 11/20] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:17:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:17:46.360336 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7bbf85-9c48-4853-808f-bbacb75aaa36 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:46.396631 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:46.466864 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7bbf85-9c48-4853-808f-bbacb75aaa36 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:46.507507 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef50da-12d9-45f5-879f-4afc0a2b5e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:46.508165 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef50da-12d9-45f5-879f-4afc0a2b5e82 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:46.508451 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef50da-12d9-45f5-879f-4afc0a2b5e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:46.508729 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef50da-12d9-45f5-879f-4afc0a2b5e82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:46.509560 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef50da-12d9-45f5-879f-4afc0a2b5e82 None admin] RBAC: Adding query filter params (role.id=d884ddf33c1440d9b3a3351b85e83e76, scope.domain.id=default, user.id=a5979772c3b54e8bb6dcc49d7d98fa0c) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:17:46.509872 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef50da-12d9-45f5-879f-4afc0a2b5e82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:46.511349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef50da-12d9-45f5-879f-4afc0a2b5e82 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:46.518424 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 10/21] 10.222.0.44 () {56 vars in 1322 bytes} [Tue Jul 19 15:17:46 2022] GET /identity/v3/role_assignments?user.id=a5979772c3b54e8bb6dcc49d7d98fa0c&scope.domain.id=default&role.id=d884ddf33c1440d9b3a3351b85e83e76 => generated 233 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:17:48.911206 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362ab01-ade8-4dad-be08-c59b8e6b4a45 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:48.912286 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362ab01-ade8-4dad-be08-c59b8e6b4a45 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:48.914486 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0b897-dbc5-4e89-bb70-508cdb04ed1e None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:48.915286 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362ab01-ade8-4dad-be08-c59b8e6b4a45 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:48.917111 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 12/22] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:17:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:17:48.917620 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0b897-dbc5-4e89-bb70-508cdb04ed1e None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:48.918116 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0b897-dbc5-4e89-bb70-508cdb04ed1e None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:48.919957 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 11/23] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:17:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:17:48.925209 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbb37e-ca83-40fa-899b-950100212dbf None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:48.925777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbb37e-ca83-40fa-899b-950100212dbf None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:48.926280 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbb37e-ca83-40fa-899b-950100212dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:48.933825 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5791f-0408-4d38-a03c-351394c6068c None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:48.934411 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5791f-0408-4d38-a03c-351394c6068c None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:48.934907 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5791f-0408-4d38-a03c-351394c6068c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:48.962703 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-7cdbb37e-ca83-40fa-899b-950100212dbf None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:17:48.962703 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-7cdbb37e-ca83-40fa-899b-950100212dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:17:48.963828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-e2f5791f-0408-4d38-a03c-351394c6068c None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:17:48.964972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-e2f5791f-0408-4d38-a03c-351394c6068c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:17:49.091484 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 12/24] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:17:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:17:49.093053 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 13/25] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:17:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:17:49.094681 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b2eac-e261-4e9b-baff-3b05a97ce9e3 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:49.095182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b2eac-e261-4e9b-baff-3b05a97ce9e3 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:49.095778 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b2eac-e261-4e9b-baff-3b05a97ce9e3 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:49.097527 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 13/26] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:17:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:17:49.102694 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548513c-7199-4382-bc25-b6e14e67fcd0 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:49.103247 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548513c-7199-4382-bc25-b6e14e67fcd0 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:49.103737 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548513c-7199-4382-bc25-b6e14e67fcd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:49.114637 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b2eac-e261-4e9b-baff-3b05a97ce9e3 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:49.138833 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-0548513c-7199-4382-bc25-b6e14e67fcd0 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:17:49.140057 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-0548513c-7199-4382-bc25-b6e14e67fcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:17:49.165978 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:49.244360 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 14/27] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:17:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:17:49.245672 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548513c-7199-4382-bc25-b6e14e67fcd0 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:49.253980 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b2eac-e261-4e9b-baff-3b05a97ce9e3 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:49.276368 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:49.300332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362528b9-1ed9-4ef5-9d22-e1da19366d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:49.301488 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362528b9-1ed9-4ef5-9d22-e1da19366d07 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:49.301979 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362528b9-1ed9-4ef5-9d22-e1da19366d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:49.302485 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362528b9-1ed9-4ef5-9d22-e1da19366d07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:49.316524 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362528b9-1ed9-4ef5-9d22-e1da19366d07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:49.319579 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362528b9-1ed9-4ef5-9d22-e1da19366d07 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:49.346264 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-362528b9-1ed9-4ef5-9d22-e1da19366d07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:17:49.346264 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:17:49.346264 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:17:49.346264 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:17:49.346264 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:17:49.346264 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:17:49.346264 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:17:49.346264 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:17:49.346264 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:17:49.346264 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:17:49.346264 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:17:49.346264 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:17:49.346264 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:17:49.346264 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:17:49.346264 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:17:49.347160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:17:49.347160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:17:49.347160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:17:49.347160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:17:49.347160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:17:49.347160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:17:49.347160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:17:49.347160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:17:49.347160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:17:49.347160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:17:49.347160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:17:49.347160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:17:49.347160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:17:49.347160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:17:49.347160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:17:49.347160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:17:49.347160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:17:49.347989 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:17:49.347989 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:17:49.347989 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:17:49.347989 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:17:49.350705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 14/28] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:17:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:17:49.352289 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c3821-d4ab-4ca2-a4d8-29081199ac8e None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:49.352727 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c3821-d4ab-4ca2-a4d8-29081199ac8e None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:49.353181 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c3821-d4ab-4ca2-a4d8-29081199ac8e None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:49.355274 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 15/29] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:17:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:17:49.356188 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c3821-d4ab-4ca2-a4d8-29081199ac8e None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:49.379980 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548513c-7199-4382-bc25-b6e14e67fcd0 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:49.420725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4403d-9898-43a2-8784-cb52e2890062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:49.421670 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4403d-9898-43a2-8784-cb52e2890062 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:49.422163 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4403d-9898-43a2-8784-cb52e2890062 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:49.422565 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4403d-9898-43a2-8784-cb52e2890062 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:49.434099 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4403d-9898-43a2-8784-cb52e2890062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:17:49.442252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-cfb4403d-9898-43a2-8784-cb52e2890062 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:17:49.442252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:17:49.442252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:17:49.442252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:17:49.442252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:17:49.442252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:17:49.442252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:17:49.442252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:17:49.442252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:17:49.442252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:17:49.442252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:17:49.442252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:17:49.442252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:17:49.442252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:17:49.442252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:17:49.442252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:17:49.443155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:17:49.443155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:17:49.443155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:17:49.443155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:17:49.443155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:17:49.443155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:17:49.443155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:17:49.443155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:17:49.443155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:17:49.443155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:17:49.443155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:17:49.443155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:17:49.443155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:17:49.443155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:17:49.443155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:17:49.443155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:17:49.444499 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:17:49.444499 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:17:49.444499 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:17:49.444499 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:17:49.444499 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:17:49.444499 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:17:49.444499 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:17:49.444499 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:17:49.444499 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:17:49.444499 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:17:49.444499 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:17:49.444499 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:17:49.444499 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 15/30] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:17:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:17:49.445203 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4403d-9898-43a2-8784-cb52e2890062 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:49.452928 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:49.475607 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c3821-d4ab-4ca2-a4d8-29081199ac8e None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:49.512299 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2ccbe-404d-4122-bf53-b9b7f7fae706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:49.513279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2ccbe-404d-4122-bf53-b9b7f7fae706 None admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:49.513745 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2ccbe-404d-4122-bf53-b9b7f7fae706 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:49.514203 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2ccbe-404d-4122-bf53-b9b7f7fae706 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:49.515167 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2ccbe-404d-4122-bf53-b9b7f7fae706 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:49.516803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2ccbe-404d-4122-bf53-b9b7f7fae706 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:49.544715 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:49.565538 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4403d-9898-43a2-8784-cb52e2890062 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:49.603146 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f139231-3251-4a2e-bed7-b761cf9c5b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:49.603849 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f139231-3251-4a2e-bed7-b761cf9c5b26 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:49.604136 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f139231-3251-4a2e-bed7-b761cf9c5b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:49.604416 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f139231-3251-4a2e-bed7-b761cf9c5b26 None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:49.605152 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f139231-3251-4a2e-bed7-b761cf9c5b26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:17:49.605463 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f139231-3251-4a2e-bed7-b761cf9c5b26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:49.606844 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f139231-3251-4a2e-bed7-b761cf9c5b26 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:49.631155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 16/31] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:17:49.633057 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580a63d-3168-4bb1-b329-b1e286c23170 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:49.633360 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580a63d-3168-4bb1-b329-b1e286c23170 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:49.633646 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580a63d-3168-4bb1-b329-b1e286c23170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:49.651160 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-3580a63d-3168-4bb1-b329-b1e286c23170 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:17:49.655295 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-3580a63d-3168-4bb1-b329-b1e286c23170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:17:49.656858 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 16/32] 10.222.0.44 () {60 vars in 1131 bytes} [Tue Jul 19 15:17:49 2022] POST /identity/v3/roles => generated 219 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:17:49.658203 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2ccbe-404d-4122-bf53-b9b7f7fae706 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:49.743441 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 17/33] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:17:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:17:49.744367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580a63d-3168-4bb1-b329-b1e286c23170 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:49.844844 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:49.879484 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580a63d-3168-4bb1-b329-b1e286c23170 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:49.893991 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2ccbe-404d-4122-bf53-b9b7f7fae706 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:49.918481 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7074329-33df-4180-9243-0f86c31bbfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:49.919156 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7074329-33df-4180-9243-0f86c31bbfcc None admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:49.919574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7074329-33df-4180-9243-0f86c31bbfcc None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:49.919874 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7074329-33df-4180-9243-0f86c31bbfcc None admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:49.920600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7074329-33df-4180-9243-0f86c31bbfcc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:49.922056 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7074329-33df-4180-9243-0f86c31bbfcc None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:49.963143 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cd714-cb6a-4ff6-ad19-c7349b91593d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:49.964804 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cd714-cb6a-4ff6-ad19-c7349b91593d None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:49.965298 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cd714-cb6a-4ff6-ad19-c7349b91593d None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:49.965781 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cd714-cb6a-4ff6-ad19-c7349b91593d None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:49.966769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cd714-cb6a-4ff6-ad19-c7349b91593d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:17:49.967350 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cd714-cb6a-4ff6-ad19-c7349b91593d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:49.969378 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cd714-cb6a-4ff6-ad19-c7349b91593d None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:49.985343 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 17/34] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:17:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:17:49.986508 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cd714-cb6a-4ff6-ad19-c7349b91593d None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:49.991426 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:50.108924 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 18/35] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jul 19 15:17:49 2022] POST /identity/v3/projects => generated 301 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:17:50.110383 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7074329-33df-4180-9243-0f86c31bbfcc None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:50.111633 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cd714-cb6a-4ff6-ad19-c7349b91593d None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:50.166030 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473bcb3-5293-4502-b96e-3c88fba025b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:50.166649 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473bcb3-5293-4502-b96e-3c88fba025b9 None admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:50.166944 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473bcb3-5293-4502-b96e-3c88fba025b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:50.167258 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473bcb3-5293-4502-b96e-3c88fba025b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:50.168048 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473bcb3-5293-4502-b96e-3c88fba025b9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:50.170048 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473bcb3-5293-4502-b96e-3c88fba025b9 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:50.190621 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 18/36] 10.222.0.44 () {60 vars in 1131 bytes} [Tue Jul 19 15:17:49 2022] POST /identity/v3/roles => generated 225 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:17:50.193163 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb598e-48e1-4eaf-a68a-3ef088b3794b None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:50.193509 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb598e-48e1-4eaf-a68a-3ef088b3794b None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:50.194513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb598e-48e1-4eaf-a68a-3ef088b3794b None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:50.196559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 19/37] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:17:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:17:50.201950 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ffffc-c285-4362-ada6-e568a64fd9ea None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:50.202247 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ffffc-c285-4362-ada6-e568a64fd9ea None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:50.202531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ffffc-c285-4362-ada6-e568a64fd9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:50.243025 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-3b7ffffc-c285-4362-ada6-e568a64fd9ea None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:17:50.246898 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-3b7ffffc-c285-4362-ada6-e568a64fd9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:17:50.296027 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7074329-33df-4180-9243-0f86c31bbfcc None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:50.341609 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:50.361002 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60d25a-86ac-4d9c-b890-a6f4aa43be62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:50.362516 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60d25a-86ac-4d9c-b890-a6f4aa43be62 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:50.363093 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60d25a-86ac-4d9c-b890-a6f4aa43be62 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:50.364773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60d25a-86ac-4d9c-b890-a6f4aa43be62 None admin] PATH_INFO: `/v3/users/a5979772c3b54e8bb6dcc49d7d98fa0c` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:50.366765 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60d25a-86ac-4d9c-b890-a6f4aa43be62 None admin] RBAC: Authorizing `identity:get_user(user_id=a5979772c3b54e8bb6dcc49d7d98fa0c)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:50.368944 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60d25a-86ac-4d9c-b890-a6f4aa43be62 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:50.370075 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:50.371744 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 19/38] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:17:50 2022] GET /identity/v3/users/a5979772c3b54e8bb6dcc49d7d98fa0c => generated 247 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:17:50.377520 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60d25a-86ac-4d9c-b890-a6f4aa43be62 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:50.396752 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 20/39] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:17:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:17:50.427748 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ffffc-c285-4362-ada6-e568a64fd9ea None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:50.492082 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60d25a-86ac-4d9c-b890-a6f4aa43be62 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:50.528245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48c29a-9291-49b7-bc29-79c830c57d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:50.529386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48c29a-9291-49b7-bc29-79c830c57d3b None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:50.530227 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48c29a-9291-49b7-bc29-79c830c57d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:50.530227 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48c29a-9291-49b7-bc29-79c830c57d3b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:50.531620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48c29a-9291-49b7-bc29-79c830c57d3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:50.533017 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48c29a-9291-49b7-bc29-79c830c57d3b None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:50.534896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 20/40] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:17:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:17:50.536164 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89906372-0628-4e9d-b222-1a935d7842b4 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:50.536471 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89906372-0628-4e9d-b222-1a935d7842b4 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:50.536759 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89906372-0628-4e9d-b222-1a935d7842b4 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:50.538600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 21/41] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:17:50.540243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ffffc-c285-4362-ada6-e568a64fd9ea None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:50.543579 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89906372-0628-4e9d-b222-1a935d7842b4 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:50.617752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:50.662346 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89906372-0628-4e9d-b222-1a935d7842b4 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:50.683303 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ad650-969a-4dfe-b27d-06ca02b47c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:50.683937 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ad650-969a-4dfe-b27d-06ca02b47c24 None admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:50.684227 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ad650-969a-4dfe-b27d-06ca02b47c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:50.684512 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ad650-969a-4dfe-b27d-06ca02b47c24 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:50.685269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ad650-969a-4dfe-b27d-06ca02b47c24 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:50.686646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ad650-969a-4dfe-b27d-06ca02b47c24 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:50.696565 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db54486-48b0-42f7-bb1c-5721c1f848a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:50.697446 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db54486-48b0-42f7-bb1c-5721c1f848a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:50.697738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db54486-48b0-42f7-bb1c-5721c1f848a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:50.698023 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db54486-48b0-42f7-bb1c-5721c1f848a1 None admin] PATH_INFO: `/v3/domains/default/users/a5979772c3b54e8bb6dcc49d7d98fa0c/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:50.700100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db54486-48b0-42f7-bb1c-5721c1f848a1 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a5979772c3b54e8bb6dcc49d7d98fa0c, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:50.711254 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 21/42] 10.222.0.44 () {60 vars in 1131 bytes} [Tue Jul 19 15:17:50 2022] POST /identity/v3/roles => generated 223 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:17:50.711465 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db54486-48b0-42f7-bb1c-5721c1f848a1 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:50.711541 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721c8fc-c385-4cb1-9c73-429b0ae86403 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:50.711541 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721c8fc-c385-4cb1-9c73-429b0ae86403 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:50.711541 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721c8fc-c385-4cb1-9c73-429b0ae86403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:50.720849 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-c721c8fc-c385-4cb1-9c73-429b0ae86403 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:17:50.722206 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-c721c8fc-c385-4cb1-9c73-429b0ae86403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:17:50.730323 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 22/43] 10.222.0.44 () {58 vars in 1361 bytes} [Tue Jul 19 15:17:50 2022] PUT /identity/v3/domains/default/users/a5979772c3b54e8bb6dcc49d7d98fa0c/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:17:50.781109 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:50.808704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 22/44] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:17:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:17:50.832925 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db54486-48b0-42f7-bb1c-5721c1f848a1 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:50.951813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db54486-48b0-42f7-bb1c-5721c1f848a1 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:50.971481 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:50.987447 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9c196-ecfe-4215-894c-d52bd0e065b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:50.988257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9c196-ecfe-4215-894c-d52bd0e065b6 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:50.988551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9c196-ecfe-4215-894c-d52bd0e065b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:50.988838 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9c196-ecfe-4215-894c-d52bd0e065b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:50.990040 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc9c196-ecfe-4215-894c-d52bd0e065b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:50.992060 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc9c196-ecfe-4215-894c-d52bd0e065b6 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:50.993712 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 23/45] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:17:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:17:50.999504 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721c8fc-c385-4cb1-9c73-429b0ae86403 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:51.098036 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721c8fc-c385-4cb1-9c73-429b0ae86403 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:51.134115 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af1fd3-dcfb-4cd6-9e61-152a3ca2e576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:51.134792 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af1fd3-dcfb-4cd6-9e61-152a3ca2e576 None admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:51.135123 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af1fd3-dcfb-4cd6-9e61-152a3ca2e576 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:51.135437 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af1fd3-dcfb-4cd6-9e61-152a3ca2e576 None admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:51.136178 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af1fd3-dcfb-4cd6-9e61-152a3ca2e576 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:51.137642 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af1fd3-dcfb-4cd6-9e61-152a3ca2e576 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:51.169545 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 23/46] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jul 19 15:17:50 2022] POST /identity/v3/projects => generated 312 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:17:52.795245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a36fe-91a0-43ee-a7ff-2fb10551607f None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:52.795772 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a36fe-91a0-43ee-a7ff-2fb10551607f None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:52.795856 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a36fe-91a0-43ee-a7ff-2fb10551607f None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:52.797221 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 24/47] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:17:52.802643 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276e3d0-1658-43ec-ad05-f37b64dbb47e None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:52.803045 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276e3d0-1658-43ec-ad05-f37b64dbb47e None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:52.803239 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276e3d0-1658-43ec-ad05-f37b64dbb47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:52.820214 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-4276e3d0-1658-43ec-ad05-f37b64dbb47e None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:17:52.821413 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-4276e3d0-1658-43ec-ad05-f37b64dbb47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:17:52.849684 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:52.894971 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 24/48] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:17:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:17:52.919194 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a36fe-91a0-43ee-a7ff-2fb10551607f None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:53.019039 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a36fe-91a0-43ee-a7ff-2fb10551607f None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:53.160574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab624a42-1f9c-4d2a-928f-b41dcc393417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:53.161364 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab624a42-1f9c-4d2a-928f-b41dcc393417 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:53.161656 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab624a42-1f9c-4d2a-928f-b41dcc393417 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:53.161938 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab624a42-1f9c-4d2a-928f-b41dcc393417 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:53.172762 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab624a42-1f9c-4d2a-928f-b41dcc393417 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:17:53.181086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-ab624a42-1f9c-4d2a-928f-b41dcc393417 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:17:53.181086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:17:53.181086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:17:53.181086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:17:53.181086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:17:53.181086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:17:53.181086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:17:53.181086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:17:53.181086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:17:53.181086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:17:53.181086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:17:53.181086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:17:53.181086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:17:53.181086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:17:53.181086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:17:53.181086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:17:53.181957 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:17:53.181957 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:17:53.181957 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:17:53.181957 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:17:53.181957 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:17:53.181957 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:17:53.181957 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:17:53.181957 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:17:53.181957 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:17:53.181957 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:17:53.181957 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:17:53.181957 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:17:53.181957 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:17:53.181957 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:17:53.181957 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:17:53.181957 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:17:53.182711 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:17:53.182711 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:17:53.182711 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:17:53.182711 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:17:53.182711 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:17:53.182711 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:17:53.182711 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:17:53.182711 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:17:53.182711 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:17:53.182711 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:17:53.182711 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:17:53.182711 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:17:53.182711 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 25/49] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:17:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:17:53.188218 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276e3d0-1658-43ec-ad05-f37b64dbb47e None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:53.205051 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88543dc-6167-4f22-9c93-d880fe2c7ebd None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:53.205349 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88543dc-6167-4f22-9c93-d880fe2c7ebd None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:53.205638 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88543dc-6167-4f22-9c93-d880fe2c7ebd None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:53.207005 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 26/50] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:17:53.212093 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f928e23-cd30-4af8-b540-f15f32fcaa00 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:53.212390 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f928e23-cd30-4af8-b540-f15f32fcaa00 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:53.212677 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f928e23-cd30-4af8-b540-f15f32fcaa00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:53.230301 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-0f928e23-cd30-4af8-b540-f15f32fcaa00 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:17:53.231862 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-0f928e23-cd30-4af8-b540-f15f32fcaa00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:17:53.274415 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:53.289768 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276e3d0-1658-43ec-ad05-f37b64dbb47e None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:53.298319 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 27/51] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:17:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:17:53.321365 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f928e23-cd30-4af8-b540-f15f32fcaa00 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:53.322997 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172fccbb-04dd-4f77-a377-854a37d72eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:53.323698 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fccbb-04dd-4f77-a377-854a37d72eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:53.323983 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fccbb-04dd-4f77-a377-854a37d72eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:53.324281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fccbb-04dd-4f77-a377-854a37d72eb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:53.325022 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172fccbb-04dd-4f77-a377-854a37d72eb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:17:53.325340 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172fccbb-04dd-4f77-a377-854a37d72eb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:53.326721 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172fccbb-04dd-4f77-a377-854a37d72eb0 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:53.335027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 25/52] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:17:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:17:53.340485 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172fccbb-04dd-4f77-a377-854a37d72eb0 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:53.368649 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:53.427515 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f928e23-cd30-4af8-b540-f15f32fcaa00 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:53.446198 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172fccbb-04dd-4f77-a377-854a37d72eb0 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:53.461485 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c76e1-d66c-445d-81f9-faf0d580fd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:53.462292 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c76e1-d66c-445d-81f9-faf0d580fd9e None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:53.462588 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c76e1-d66c-445d-81f9-faf0d580fd9e None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:53.462875 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c76e1-d66c-445d-81f9-faf0d580fd9e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:53.464125 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c76e1-d66c-445d-81f9-faf0d580fd9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:53.465593 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c76e1-d66c-445d-81f9-faf0d580fd9e None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:53.467228 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 28/53] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:17:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:17:53.472789 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c76e1-d66c-445d-81f9-faf0d580fd9e None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:53.480578 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390360d5-3911-40f4-99d1-e299df8ce153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:53.481461 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390360d5-3911-40f4-99d1-e299df8ce153 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:53.481753 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390360d5-3911-40f4-99d1-e299df8ce153 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:53.482040 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390360d5-3911-40f4-99d1-e299df8ce153 None admin] PATH_INFO: `/v3/users/a5979772c3b54e8bb6dcc49d7d98fa0c` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:53.483285 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390360d5-3911-40f4-99d1-e299df8ce153 None admin] RBAC: Authorizing `identity:get_user(user_id=a5979772c3b54e8bb6dcc49d7d98fa0c)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:53.484741 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390360d5-3911-40f4-99d1-e299df8ce153 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:53.486393 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 26/54] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:17:53 2022] GET /identity/v3/users/a5979772c3b54e8bb6dcc49d7d98fa0c => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:17:53.492098 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390360d5-3911-40f4-99d1-e299df8ce153 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:53.521708 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:53.577338 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c76e1-d66c-445d-81f9-faf0d580fd9e None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:53.588769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:53.595922 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390360d5-3911-40f4-99d1-e299df8ce153 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:53.611311 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8751a4-408d-4074-badc-7d14dae18a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:53.611981 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8751a4-408d-4074-badc-7d14dae18a0a None admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:53.612275 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8751a4-408d-4074-badc-7d14dae18a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:53.612561 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8751a4-408d-4074-badc-7d14dae18a0a None admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:53.613286 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8751a4-408d-4074-badc-7d14dae18a0a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:53.614733 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8751a4-408d-4074-badc-7d14dae18a0a None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:53.630910 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a6f01-a8eb-4370-a72a-f50a39aa2f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:53.632303 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a6f01-a8eb-4370-a72a-f50a39aa2f36 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:53.632594 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a6f01-a8eb-4370-a72a-f50a39aa2f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:53.632884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a6f01-a8eb-4370-a72a-f50a39aa2f36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:53.634242 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a6f01-a8eb-4370-a72a-f50a39aa2f36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:53.635747 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a6f01-a8eb-4370-a72a-f50a39aa2f36 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:53.637949 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 27/55] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:17:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:17:53.643696 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a6f01-a8eb-4370-a72a-f50a39aa2f36 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:53.646044 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 29/56] 10.222.0.44 () {60 vars in 1140 bytes} [Tue Jul 19 15:17:53 2022] POST /identity/v3/projects => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:17:53.751869 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a6f01-a8eb-4370-a72a-f50a39aa2f36 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:53.791692 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d07f5-c858-4dad-aad5-ac579b4c9b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:53.792359 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d07f5-c858-4dad-aad5-ac579b4c9b2f None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:53.792653 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d07f5-c858-4dad-aad5-ac579b4c9b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:53.792937 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d07f5-c858-4dad-aad5-ac579b4c9b2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:53.793792 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d07f5-c858-4dad-aad5-ac579b4c9b2f None admin] RBAC: Adding query filter params (role.id=d884ddf33c1440d9b3a3351b85e83e76, scope.domain.id=default, user.id=a5979772c3b54e8bb6dcc49d7d98fa0c) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:17:53.794115 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d07f5-c858-4dad-aad5-ac579b4c9b2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:53.795582 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d07f5-c858-4dad-aad5-ac579b4c9b2f None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:53.801617 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 28/57] 10.222.0.44 () {56 vars in 1322 bytes} [Tue Jul 19 15:17:53 2022] GET /identity/v3/role_assignments?user.id=a5979772c3b54e8bb6dcc49d7d98fa0c&scope.domain.id=default&role.id=d884ddf33c1440d9b3a3351b85e83e76 => generated 530 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:17:55.708227 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb215a-3e91-4e0c-8ca4-559827236191 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:55.708747 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb215a-3e91-4e0c-8ca4-559827236191 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:55.708857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb215a-3e91-4e0c-8ca4-559827236191 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:55.710244 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 30/58] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:17:55.715295 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd4b8a-6d9b-4eac-9fa7-e39d5fa40f52 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:55.715719 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd4b8a-6d9b-4eac-9fa7-e39d5fa40f52 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:55.715866 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd4b8a-6d9b-4eac-9fa7-e39d5fa40f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:55.733181 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-0dbd4b8a-6d9b-4eac-9fa7-e39d5fa40f52 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:17:55.734409 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-0dbd4b8a-6d9b-4eac-9fa7-e39d5fa40f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:17:55.755236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:55.801593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 29/59] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:17:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:17:55.826715 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb215a-3e91-4e0c-8ca4-559827236191 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:55.922168 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:55.927290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb215a-3e91-4e0c-8ca4-559827236191 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:55.961433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536ca82-1c86-4cb9-8001-b2c3c0de1024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:55.962150 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536ca82-1c86-4cb9-8001-b2c3c0de1024 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:55.962442 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536ca82-1c86-4cb9-8001-b2c3c0de1024 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:55.962723 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536ca82-1c86-4cb9-8001-b2c3c0de1024 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:55.963936 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536ca82-1c86-4cb9-8001-b2c3c0de1024 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:55.965381 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536ca82-1c86-4cb9-8001-b2c3c0de1024 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:55.967329 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 31/60] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:17:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:17:55.973412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd4b8a-6d9b-4eac-9fa7-e39d5fa40f52 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:56.069953 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd4b8a-6d9b-4eac-9fa7-e39d5fa40f52 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:56.103075 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce536149-1122-4a3f-b4a9-fc518831d886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:56.103774 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce536149-1122-4a3f-b4a9-fc518831d886 None admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:56.104069 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce536149-1122-4a3f-b4a9-fc518831d886 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:56.104356 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce536149-1122-4a3f-b4a9-fc518831d886 None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:56.105069 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce536149-1122-4a3f-b4a9-fc518831d886 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:56.106506 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce536149-1122-4a3f-b4a9-fc518831d886 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:56.131335 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 30/61] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jul 19 15:17:55 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:17:59.085096 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4fdfe-e54f-45d5-8c7e-5dd47bfad208 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:59.085961 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4fdfe-e54f-45d5-8c7e-5dd47bfad208 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:59.086391 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4fdfe-e54f-45d5-8c7e-5dd47bfad208 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:59.088225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 32/62] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:17:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:17:59.093914 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c44e11-5692-4b2d-9758-bc3dff44d15f None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:59.094674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c44e11-5692-4b2d-9758-bc3dff44d15f None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:59.095122 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c44e11-5692-4b2d-9758-bc3dff44d15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:59.113746 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-f9c44e11-5692-4b2d-9758-bc3dff44d15f None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:17:59.115139 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-f9c44e11-5692-4b2d-9758-bc3dff44d15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:17:59.123344 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:59.201468 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 31/63] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:17:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:17:59.221204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4fdfe-e54f-45d5-8c7e-5dd47bfad208 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:59.331770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4fdfe-e54f-45d5-8c7e-5dd47bfad208 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:59.367144 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70af0e0-79c1-4832-a960-5910d780d7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:59.368183 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70af0e0-79c1-4832-a960-5910d780d7e4 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:59.368633 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70af0e0-79c1-4832-a960-5910d780d7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:59.369050 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70af0e0-79c1-4832-a960-5910d780d7e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:59.379734 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70af0e0-79c1-4832-a960-5910d780d7e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:17:59.388205 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-d70af0e0-79c1-4832-a960-5910d780d7e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:17:59.388205 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:17:59.388205 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:17:59.388205 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:17:59.388205 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:17:59.388205 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:17:59.388205 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:17:59.388205 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:17:59.388205 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:17:59.388205 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:17:59.388205 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:17:59.388205 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:17:59.388205 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:17:59.388205 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:17:59.388205 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:17:59.388205 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:17:59.389221 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:17:59.389221 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:17:59.389221 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:17:59.389221 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:17:59.389221 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:17:59.389221 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:17:59.389221 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:17:59.389221 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:17:59.389221 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:17:59.389221 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:17:59.389221 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:17:59.389221 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:17:59.389221 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:17:59.389221 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:17:59.389221 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:17:59.389221 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:17:59.390145 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:17:59.390145 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:17:59.390145 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:17:59.390145 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:17:59.390145 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:17:59.390145 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:17:59.390145 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:17:59.390145 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:17:59.390145 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:17:59.390145 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:17:59.390145 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:17:59.390145 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:17:59.392170 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 33/64] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:17:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:17:59.398350 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c44e11-5692-4b2d-9758-bc3dff44d15f None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:59.522747 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c44e11-5692-4b2d-9758-bc3dff44d15f None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:59.565518 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a722be-ee47-4241-8ebc-090b5b5e3655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:59.566438 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a722be-ee47-4241-8ebc-090b5b5e3655 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:59.566870 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a722be-ee47-4241-8ebc-090b5b5e3655 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:59.567325 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a722be-ee47-4241-8ebc-090b5b5e3655 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:59.569760 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec7e3a-6716-4294-9196-bd2d784a3839 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:59.570208 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec7e3a-6716-4294-9196-bd2d784a3839 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:59.570626 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec7e3a-6716-4294-9196-bd2d784a3839 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:59.572295 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 34/65] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:17:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:17:59.573200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a722be-ee47-4241-8ebc-090b5b5e3655 None admin] RBAC: Adding query filter params (name=member) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:17:59.573665 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a722be-ee47-4241-8ebc-090b5b5e3655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:59.575402 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a722be-ee47-4241-8ebc-090b5b5e3655 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:59.578095 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864cd42-5b3c-46a6-95f5-ba8f0cf3b314 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:59.578536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864cd42-5b3c-46a6-95f5-ba8f0cf3b314 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:59.578957 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864cd42-5b3c-46a6-95f5-ba8f0cf3b314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:59.603689 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 32/66] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 19 15:17:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:17:59.605594 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-3864cd42-5b3c-46a6-95f5-ba8f0cf3b314 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:17:59.606939 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-3864cd42-5b3c-46a6-95f5-ba8f0cf3b314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:17:59.609290 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a722be-ee47-4241-8ebc-090b5b5e3655 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:59.621430 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:59.642139 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:59.694853 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 35/67] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:17:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:17:59.696183 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c77db-f41f-4b09-8266-7cfc131d11cb None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:59.696486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c77db-f41f-4b09-8266-7cfc131d11cb None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:59.696771 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c77db-f41f-4b09-8266-7cfc131d11cb None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:59.702915 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 36/68] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:17:59.704055 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a34b88-75c8-4ac9-a7c4-cfa88c541683 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:59.704356 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a34b88-75c8-4ac9-a7c4-cfa88c541683 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:59.704647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a34b88-75c8-4ac9-a7c4-cfa88c541683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:59.722732 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-b4a34b88-75c8-4ac9-a7c4-cfa88c541683 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:17:59.723987 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-b4a34b88-75c8-4ac9-a7c4-cfa88c541683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:17:59.742274 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a722be-ee47-4241-8ebc-090b5b5e3655 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:59.779805 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0a0a7-387f-45c9-9225-46361a62debc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:59.781299 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0a0a7-387f-45c9-9225-46361a62debc None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:59.781299 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0a0a7-387f-45c9-9225-46361a62debc None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:59.781550 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0a0a7-387f-45c9-9225-46361a62debc None admin] PATH_INFO: `/v3/users/f1ce8f6287214ffbb9b21e5891234a01` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:59.796469 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca0a0a7-387f-45c9-9225-46361a62debc None admin] RBAC: Authorizing `identity:get_user(user_id=f1ce8f6287214ffbb9b21e5891234a01)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:59.798063 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca0a0a7-387f-45c9-9225-46361a62debc None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:59.799887 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 33/69] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:17:59 2022] GET /identity/v3/users/f1ce8f6287214ffbb9b21e5891234a01 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:17:59.800723 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0a0a7-387f-45c9-9225-46361a62debc None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:59.816523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 37/70] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:17:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:17:59.817768 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a34b88-75c8-4ac9-a7c4-cfa88c541683 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:59.894139 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:59.921377 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:59.941053 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0a0a7-387f-45c9-9225-46361a62debc None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:59.941248 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a34b88-75c8-4ac9-a7c4-cfa88c541683 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:59.979555 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4501f40-7507-44b9-a7a5-c910c455c409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:59.979997 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c902455-b2e2-460c-8ab9-ee4e9916a74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:59.980434 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4501f40-7507-44b9-a7a5-c910c455c409 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:59.980728 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4501f40-7507-44b9-a7a5-c910c455c409 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:59.981015 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4501f40-7507-44b9-a7a5-c910c455c409 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:59.981106 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c902455-b2e2-460c-8ab9-ee4e9916a74c None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:59.981528 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c902455-b2e2-460c-8ab9-ee4e9916a74c None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:59.982016 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c902455-b2e2-460c-8ab9-ee4e9916a74c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:59.993895 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4501f40-7507-44b9-a7a5-c910c455c409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:00.003290 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-f4501f40-7507-44b9-a7a5-c910c455c409 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:18:00.003290 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:00.003290 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:00.003290 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:00.003290 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:00.003290 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:00.003290 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:00.003290 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:00.003290 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:00.003290 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:00.003290 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:00.003290 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:00.003290 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:00.003290 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:00.003290 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:00.003290 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:00.004174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:00.004174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:00.004174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:00.004174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:00.004174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:00.004174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:00.004174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:00.004174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:00.004174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:00.004174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:00.004174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:00.004174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:00.004174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:00.004174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:00.004174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:00.004174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:00.004990 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:00.004990 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:00.004990 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:00.004990 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:00.004990 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:00.004990 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:00.004990 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:00.004990 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:00.004990 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:00.004990 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:00.004990 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:18:00.004990 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:00.004990 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 34/71] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 19 15:17:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:00.005624 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4501f40-7507-44b9-a7a5-c910c455c409 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:00.053031 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c902455-b2e2-460c-8ab9-ee4e9916a74c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:00.054503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c902455-b2e2-460c-8ab9-ee4e9916a74c None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:00.109793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4501f40-7507-44b9-a7a5-c910c455c409 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:00.132134 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:00.137709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:00.144580 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbec666-cac3-4d3d-8126-f89cae3c2201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:00.145323 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbec666-cac3-4d3d-8126-f89cae3c2201 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:00.145613 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbec666-cac3-4d3d-8126-f89cae3c2201 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:00.145898 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbec666-cac3-4d3d-8126-f89cae3c2201 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:00.158830 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbec666-cac3-4d3d-8126-f89cae3c2201 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:00.159607 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 38/72] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:17:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:18:00.164544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014cb59-a5e2-4ed9-9644-8e00855bbd6f None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:00.164544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014cb59-a5e2-4ed9-9644-8e00855bbd6f None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:00.164544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014cb59-a5e2-4ed9-9644-8e00855bbd6f None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:00.164544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 39/73] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:00.164544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe12ce1-2a5c-4f3b-8596-dd4e1ac488f3 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:00.164544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe12ce1-2a5c-4f3b-8596-dd4e1ac488f3 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:00.164928 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe12ce1-2a5c-4f3b-8596-dd4e1ac488f3 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:00.166078 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 40/74] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:00.167086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe12ce1-2a5c-4f3b-8596-dd4e1ac488f3 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:00.169481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-cfbec666-cac3-4d3d-8126-f89cae3c2201 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:18:00.169481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:00.169481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:00.169481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:00.169481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:00.169481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:00.169481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:00.169481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:00.169481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:00.169481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:00.169481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:00.169481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:00.169481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:00.169481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:00.169481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:00.169481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:00.170599 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:00.170599 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:00.170599 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:00.170599 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:00.170599 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:00.170599 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:00.170599 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:00.170599 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:00.170599 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:00.170599 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:00.170599 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:00.170599 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:00.170599 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:00.170599 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:00.170599 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:00.170599 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:00.171702 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:00.171702 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:00.171702 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:00.171702 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:00.171702 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:00.171702 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:00.171702 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:00.171702 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:00.171702 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:00.171702 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:00.171702 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:18:00.171702 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:00.171702 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 35/75] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:18:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:00.171702 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbec666-cac3-4d3d-8126-f89cae3c2201 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:00.270920 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbec666-cac3-4d3d-8126-f89cae3c2201 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:00.274316 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe12ce1-2a5c-4f3b-8596-dd4e1ac488f3 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:00.304862 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8563a82-a4e0-425d-a8e9-b050ee3c246e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:00.305725 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8563a82-a4e0-425d-a8e9-b050ee3c246e None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:00.306015 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8563a82-a4e0-425d-a8e9-b050ee3c246e None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:00.306297 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8563a82-a4e0-425d-a8e9-b050ee3c246e None admin] PATH_INFO: `/v3/projects/76392ff9ad244418a55302f0aa823f92` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:00.307534 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8563a82-a4e0-425d-a8e9-b050ee3c246e None admin] RBAC: Authorizing `identity:get_project(project_id=76392ff9ad244418a55302f0aa823f92)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:00.307641 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a3baf-3b5d-4edc-8dba-f45b749ef16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:00.308291 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a3baf-3b5d-4edc-8dba-f45b749ef16d None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:00.308583 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a3baf-3b5d-4edc-8dba-f45b749ef16d None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:00.308866 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a3baf-3b5d-4edc-8dba-f45b749ef16d None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:00.308986 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8563a82-a4e0-425d-a8e9-b050ee3c246e None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:00.309619 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a3baf-3b5d-4edc-8dba-f45b749ef16d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:00.309935 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a3baf-3b5d-4edc-8dba-f45b749ef16d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:00.310710 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 36/76] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:00 2022] GET /identity/v3/projects/76392ff9ad244418a55302f0aa823f92 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:00.311317 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a3baf-3b5d-4edc-8dba-f45b749ef16d None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:00.311905 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017d9d7-e78e-4316-b8e3-10ce683cd106 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:00.312159 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017d9d7-e78e-4316-b8e3-10ce683cd106 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:00.312446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017d9d7-e78e-4316-b8e3-10ce683cd106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:00.320347 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 41/77] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:18:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:00.321574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18b8ba-f1a2-44ca-a14b-740a89baa81e None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:00.321899 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18b8ba-f1a2-44ca-a14b-740a89baa81e None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:00.322155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18b8ba-f1a2-44ca-a14b-740a89baa81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:00.332161 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-1017d9d7-e78e-4316-b8e3-10ce683cd106 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:00.333375 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-1017d9d7-e78e-4316-b8e3-10ce683cd106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:00.338686 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-7c18b8ba-f1a2-44ca-a14b-740a89baa81e None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:00.339893 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-7c18b8ba-f1a2-44ca-a14b-740a89baa81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:00.378941 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:00.383484 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:00.401869 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 37/78] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:00.402629 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017d9d7-e78e-4316-b8e3-10ce683cd106 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:00.417500 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 42/79] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:00.425872 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18b8ba-f1a2-44ca-a14b-740a89baa81e None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:00.510043 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017d9d7-e78e-4316-b8e3-10ce683cd106 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:00.519854 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18b8ba-f1a2-44ca-a14b-740a89baa81e None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:00.543442 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369adb2-2388-42a0-98c6-8a68b77b5704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:00.544106 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369adb2-2388-42a0-98c6-8a68b77b5704 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:00.544389 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369adb2-2388-42a0-98c6-8a68b77b5704 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:00.544666 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369adb2-2388-42a0-98c6-8a68b77b5704 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:00.545406 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369adb2-2388-42a0-98c6-8a68b77b5704 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:00.545715 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369adb2-2388-42a0-98c6-8a68b77b5704 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:00.547091 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369adb2-2388-42a0-98c6-8a68b77b5704 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:00.554159 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb244f19-6857-464a-996e-038b8824d5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:00.555121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb244f19-6857-464a-996e-038b8824d5b9 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:00.555269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 38/80] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:00.555346 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb244f19-6857-464a-996e-038b8824d5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:00.555413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb244f19-6857-464a-996e-038b8824d5b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:00.555710 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369adb2-2388-42a0-98c6-8a68b77b5704 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:00.556266 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb244f19-6857-464a-996e-038b8824d5b9 None admin] RBAC: Adding query filter params (role.id=ff311e825f2b4a3d809aa772f6cdecb0, scope.project.id=76392ff9ad244418a55302f0aa823f92, user.id=f1ce8f6287214ffbb9b21e5891234a01) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:00.556594 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb244f19-6857-464a-996e-038b8824d5b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:00.558060 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb244f19-6857-464a-996e-038b8824d5b9 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:00.565788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 43/81] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:18:00 2022] GET /identity/v3/role_assignments?user.id=f1ce8f6287214ffbb9b21e5891234a01&scope.project.id=76392ff9ad244418a55302f0aa823f92&role.id=ff311e825f2b4a3d809aa772f6cdecb0 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:00.566588 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb244f19-6857-464a-996e-038b8824d5b9 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:00.612700 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:00.626959 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:00.677886 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369adb2-2388-42a0-98c6-8a68b77b5704 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:00.694499 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb244f19-6857-464a-996e-038b8824d5b9 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:00.717085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a14d5-2a48-44e2-aaeb-4a8ea5014d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:00.717982 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a14d5-2a48-44e2-aaeb-4a8ea5014d3e None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:00.718275 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a14d5-2a48-44e2-aaeb-4a8ea5014d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:00.718556 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a14d5-2a48-44e2-aaeb-4a8ea5014d3e None admin] PATH_INFO: `/v3/users/f1ce8f6287214ffbb9b21e5891234a01` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:00.720485 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a14d5-2a48-44e2-aaeb-4a8ea5014d3e None admin] RBAC: Authorizing `identity:get_user(user_id=f1ce8f6287214ffbb9b21e5891234a01)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:00.721464 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a14d5-2a48-44e2-aaeb-4a8ea5014d3e None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:00.723144 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 39/82] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:00 2022] GET /identity/v3/users/f1ce8f6287214ffbb9b21e5891234a01 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:00.723935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a14d5-2a48-44e2-aaeb-4a8ea5014d3e None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:00.742252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939e517-f989-4063-95c5-d3f28e4b976c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:00.743534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939e517-f989-4063-95c5-d3f28e4b976c None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:00.743840 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939e517-f989-4063-95c5-d3f28e4b976c None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:00.744137 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939e517-f989-4063-95c5-d3f28e4b976c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:00.745360 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939e517-f989-4063-95c5-d3f28e4b976c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:00.747433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939e517-f989-4063-95c5-d3f28e4b976c None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:00.750476 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 44/83] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:18:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:00.754025 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939e517-f989-4063-95c5-d3f28e4b976c None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:00.832073 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a14d5-2a48-44e2-aaeb-4a8ea5014d3e None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:00.846014 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:00.864444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939e517-f989-4063-95c5-d3f28e4b976c None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:00.877149 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:00.878195 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202bc87c-ba26-452d-a222-9c92a52f6008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:00.879088 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202bc87c-ba26-452d-a222-9c92a52f6008 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:00.879446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202bc87c-ba26-452d-a222-9c92a52f6008 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:00.879832 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202bc87c-ba26-452d-a222-9c92a52f6008 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:00.891653 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202bc87c-ba26-452d-a222-9c92a52f6008 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:00.899373 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-202bc87c-ba26-452d-a222-9c92a52f6008 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:00.899373 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:00.899373 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:00.899373 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:00.899373 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:00.899373 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:00.899373 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:00.899373 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:00.899373 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:00.899373 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:00.899373 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:00.899373 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:00.899373 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:00.899373 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:00.899373 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:00.899373 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:00.900236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:00.900236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:00.900236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:00.900236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:00.900236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:00.900236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:00.900236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:00.900236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:00.900236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:00.900236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:00.900236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:00.900236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:00.900236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:00.900236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:00.900236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:00.900236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:00.900989 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:00.900989 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:00.900989 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:00.900989 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:00.900989 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:00.900989 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:00.900989 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:00.900989 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:00.900989 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:00.900989 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:00.900989 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:00.900989 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:00.905948 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 40/84] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:00.906638 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202bc87c-ba26-452d-a222-9c92a52f6008 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:00.910169 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4aae3-5a1a-4c26-bca1-d6e859bc77e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:00.911068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4aae3-5a1a-4c26-bca1-d6e859bc77e8 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:00.912143 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4aae3-5a1a-4c26-bca1-d6e859bc77e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:00.912143 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4aae3-5a1a-4c26-bca1-d6e859bc77e8 None admin] PATH_INFO: `/v3/users/a5979772c3b54e8bb6dcc49d7d98fa0c` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:00.913475 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4aae3-5a1a-4c26-bca1-d6e859bc77e8 None admin] RBAC: Authorizing `identity:get_user(user_id=a5979772c3b54e8bb6dcc49d7d98fa0c)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:00.914950 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4aae3-5a1a-4c26-bca1-d6e859bc77e8 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:00.916666 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 45/85] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:00 2022] GET /identity/v3/users/a5979772c3b54e8bb6dcc49d7d98fa0c => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:00.922128 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4aae3-5a1a-4c26-bca1-d6e859bc77e8 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:01.021391 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202bc87c-ba26-452d-a222-9c92a52f6008 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:01.025130 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4aae3-5a1a-4c26-bca1-d6e859bc77e8 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:01.058077 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383495c-f7e6-4d8b-9021-29e54297aea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:01.058802 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383495c-f7e6-4d8b-9021-29e54297aea7 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:01.059074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383495c-f7e6-4d8b-9021-29e54297aea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:01.059397 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383495c-f7e6-4d8b-9021-29e54297aea7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:01.063864 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2cbc37-e2a2-470a-805b-e19ea0754cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:01.064753 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cbc37-e2a2-470a-805b-e19ea0754cc6 None admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:01.065224 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cbc37-e2a2-470a-805b-e19ea0754cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:01.065688 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cbc37-e2a2-470a-805b-e19ea0754cc6 None admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:01.066618 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2cbc37-e2a2-470a-805b-e19ea0754cc6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:01.068276 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2cbc37-e2a2-470a-805b-e19ea0754cc6 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:01.094985 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 46/86] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jul 19 15:18:00 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:18:01.101887 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2cbc37-e2a2-470a-805b-e19ea0754cc6 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:01.106271 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:01.155412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383495c-f7e6-4d8b-9021-29e54297aea7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:01.156946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383495c-f7e6-4d8b-9021-29e54297aea7 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:01.158811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:01.262703 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2cbc37-e2a2-470a-805b-e19ea0754cc6 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:01.286924 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 41/87] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:18:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:18:01.287787 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383495c-f7e6-4d8b-9021-29e54297aea7 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:01.305520 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2dcfd-908c-4e3e-9382-9323509563f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:01.306238 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2dcfd-908c-4e3e-9382-9323509563f8 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:01.306572 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2dcfd-908c-4e3e-9382-9323509563f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:01.306817 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2dcfd-908c-4e3e-9382-9323509563f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:01.307636 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2dcfd-908c-4e3e-9382-9323509563f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:01.307957 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2dcfd-908c-4e3e-9382-9323509563f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:01.309367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2dcfd-908c-4e3e-9382-9323509563f8 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:01.319385 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 47/88] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 19 15:18:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:01.320445 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2dcfd-908c-4e3e-9382-9323509563f8 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:01.381949 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:01.418722 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383495c-f7e6-4d8b-9021-29e54297aea7 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:01.447118 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:01.455413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2dcfd-908c-4e3e-9382-9323509563f8 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:01.464059 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a339222-9bfe-4d84-bee3-9a85c66662ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:01.465064 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a339222-9bfe-4d84-bee3-9a85c66662ba None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:01.465544 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a339222-9bfe-4d84-bee3-9a85c66662ba None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:01.466020 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a339222-9bfe-4d84-bee3-9a85c66662ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:01.504851 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ac181-cd09-4241-b197-8bcdbd6375a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:01.505730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ac181-cd09-4241-b197-8bcdbd6375a0 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:01.506025 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ac181-cd09-4241-b197-8bcdbd6375a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:01.506344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ac181-cd09-4241-b197-8bcdbd6375a0 None admin] PATH_INFO: `/v3/projects/76392ff9ad244418a55302f0aa823f92` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:01.508275 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ac181-cd09-4241-b197-8bcdbd6375a0 None admin] RBAC: Authorizing `identity:get_project(project_id=76392ff9ad244418a55302f0aa823f92)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:01.509058 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ac181-cd09-4241-b197-8bcdbd6375a0 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:01.510819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 48/89] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:01 2022] GET /identity/v3/projects/76392ff9ad244418a55302f0aa823f92 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:01.511634 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ac181-cd09-4241-b197-8bcdbd6375a0 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:01.560768 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a339222-9bfe-4d84-bee3-9a85c66662ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:01.563054 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a339222-9bfe-4d84-bee3-9a85c66662ba None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:01.646370 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ac181-cd09-4241-b197-8bcdbd6375a0 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:01.657908 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:01.683858 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11546fc3-839c-4271-80a0-b37522cf24da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:01.684736 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11546fc3-839c-4271-80a0-b37522cf24da None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:01.685020 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11546fc3-839c-4271-80a0-b37522cf24da None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:01.685300 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11546fc3-839c-4271-80a0-b37522cf24da None admin] PATH_INFO: `/v3/users/f1ce8f6287214ffbb9b21e5891234a01` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:01.686520 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11546fc3-839c-4271-80a0-b37522cf24da None admin] RBAC: Authorizing `identity:get_user(user_id=f1ce8f6287214ffbb9b21e5891234a01)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:01.687993 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11546fc3-839c-4271-80a0-b37522cf24da None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:01.689818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 49/90] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:01 2022] GET /identity/v3/users/f1ce8f6287214ffbb9b21e5891234a01 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:01.690589 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11546fc3-839c-4271-80a0-b37522cf24da None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:01.708791 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 42/91] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:18:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:18:01.710482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a339222-9bfe-4d84-bee3-9a85c66662ba None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:01.789396 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:01.830812 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a339222-9bfe-4d84-bee3-9a85c66662ba None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:01.880626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82675d-6a71-4c1c-9e74-aef03a0e65a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:01.881330 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82675d-6a71-4c1c-9e74-aef03a0e65a8 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:01.881622 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82675d-6a71-4c1c-9e74-aef03a0e65a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:01.881908 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82675d-6a71-4c1c-9e74-aef03a0e65a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:01.947499 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11546fc3-839c-4271-80a0-b37522cf24da None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:01.959823 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:01.993952 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82675d-6a71-4c1c-9e74-aef03a0e65a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:01.995491 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82675d-6a71-4c1c-9e74-aef03a0e65a8 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:02.039154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602ec14-b12e-4369-b7dd-f67eaccaa77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:02.039845 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602ec14-b12e-4369-b7dd-f67eaccaa77d None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:02.040135 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602ec14-b12e-4369-b7dd-f67eaccaa77d None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:02.040417 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602ec14-b12e-4369-b7dd-f67eaccaa77d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:02.041260 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602ec14-b12e-4369-b7dd-f67eaccaa77d None admin] RBAC: Adding query filter params (role.id=361f7a146e9b47e997cf572bae05c96e, scope.project.id=76392ff9ad244418a55302f0aa823f92, user.id=f1ce8f6287214ffbb9b21e5891234a01) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:02.041581 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602ec14-b12e-4369-b7dd-f67eaccaa77d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:02.043027 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602ec14-b12e-4369-b7dd-f67eaccaa77d None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:02.058324 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 50/92] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:18:01 2022] GET /identity/v3/role_assignments?user.id=f1ce8f6287214ffbb9b21e5891234a01&scope.project.id=76392ff9ad244418a55302f0aa823f92&role.id=361f7a146e9b47e997cf572bae05c96e => generated 259 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:02.059087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602ec14-b12e-4369-b7dd-f67eaccaa77d None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:02.110176 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 43/93] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:18:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:18:02.116618 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82675d-6a71-4c1c-9e74-aef03a0e65a8 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:02.223622 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:02.259108 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82675d-6a71-4c1c-9e74-aef03a0e65a8 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:02.319973 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6fa9e-a750-4925-b4ec-a98b7de46362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:02.320866 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6fa9e-a750-4925-b4ec-a98b7de46362 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:02.321179 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6fa9e-a750-4925-b4ec-a98b7de46362 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:02.321443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6fa9e-a750-4925-b4ec-a98b7de46362 None admin] PATH_INFO: `/v3/projects/38d2636ff3eb405083c509b300f7ef01` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:02.328035 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6fa9e-a750-4925-b4ec-a98b7de46362 None admin] RBAC: Authorizing `identity:get_project(project_id=38d2636ff3eb405083c509b300f7ef01)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:02.329546 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6fa9e-a750-4925-b4ec-a98b7de46362 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:02.331371 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 44/94] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:02 2022] GET /identity/v3/projects/38d2636ff3eb405083c509b300f7ef01 => generated 312 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:02.337182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6fa9e-a750-4925-b4ec-a98b7de46362 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:02.358835 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602ec14-b12e-4369-b7dd-f67eaccaa77d None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:02.364670 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:02.462706 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56a92d-a447-4625-a018-159053005fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:02.463629 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56a92d-a447-4625-a018-159053005fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:02.463926 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56a92d-a447-4625-a018-159053005fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:02.464222 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56a92d-a447-4625-a018-159053005fb1 None admin] PATH_INFO: `/v3/projects/76392ff9ad244418a55302f0aa823f92` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:02.468163 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56a92d-a447-4625-a018-159053005fb1 None admin] RBAC: Authorizing `identity:get_project(project_id=76392ff9ad244418a55302f0aa823f92)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:02.469856 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56a92d-a447-4625-a018-159053005fb1 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:02.471687 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 51/95] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:02 2022] GET /identity/v3/projects/76392ff9ad244418a55302f0aa823f92 => generated 298 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:02.481463 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56a92d-a447-4625-a018-159053005fb1 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:02.609415 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6fa9e-a750-4925-b4ec-a98b7de46362 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:02.703046 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56a92d-a447-4625-a018-159053005fb1 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:02.712519 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7d11e-dd08-44e5-b6a2-59bbb6949d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:02.713198 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7d11e-dd08-44e5-b6a2-59bbb6949d8d None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:02.713487 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7d11e-dd08-44e5-b6a2-59bbb6949d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:02.713770 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7d11e-dd08-44e5-b6a2-59bbb6949d8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:02.714624 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7d11e-dd08-44e5-b6a2-59bbb6949d8d None admin] RBAC: Adding query filter params (role.id=ff311e825f2b4a3d809aa772f6cdecb0, scope.project.id=38d2636ff3eb405083c509b300f7ef01, user.id=f1ce8f6287214ffbb9b21e5891234a01) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:02.719247 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7d11e-dd08-44e5-b6a2-59bbb6949d8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:02.719247 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7d11e-dd08-44e5-b6a2-59bbb6949d8d None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:02.733391 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 45/96] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:18:02 2022] GET /identity/v3/role_assignments?user.id=f1ce8f6287214ffbb9b21e5891234a01&scope.project.id=38d2636ff3eb405083c509b300f7ef01&role.id=ff311e825f2b4a3d809aa772f6cdecb0 => generated 259 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:02.758115 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa689910-6acd-46b6-bac2-e368ec5c8d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:02.758821 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa689910-6acd-46b6-bac2-e368ec5c8d96 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:02.759119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa689910-6acd-46b6-bac2-e368ec5c8d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:02.759431 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa689910-6acd-46b6-bac2-e368ec5c8d96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:02.760318 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa689910-6acd-46b6-bac2-e368ec5c8d96 None admin] RBAC: Adding query filter params (role.id=d884ddf33c1440d9b3a3351b85e83e76, scope.project.id=76392ff9ad244418a55302f0aa823f92, user.id=a5979772c3b54e8bb6dcc49d7d98fa0c) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:02.760646 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa689910-6acd-46b6-bac2-e368ec5c8d96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:02.762287 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa689910-6acd-46b6-bac2-e368ec5c8d96 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:02.768718 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 52/97] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:18:02 2022] GET /identity/v3/role_assignments?user.id=a5979772c3b54e8bb6dcc49d7d98fa0c&scope.project.id=76392ff9ad244418a55302f0aa823f92&role.id=d884ddf33c1440d9b3a3351b85e83e76 => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:03.144810 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb499ff0-9ec6-4ee9-8155-dd11eac52068 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:03.145180 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb499ff0-9ec6-4ee9-8155-dd11eac52068 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:03.145379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb499ff0-9ec6-4ee9-8155-dd11eac52068 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:03.147085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 46/98] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:03.152219 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71712b2d-bd9d-4e52-9361-671becf52265 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:03.152520 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71712b2d-bd9d-4e52-9361-671becf52265 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:03.152809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71712b2d-bd9d-4e52-9361-671becf52265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:03.174697 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-71712b2d-bd9d-4e52-9361-671becf52265 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:03.175929 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-71712b2d-bd9d-4e52-9361-671becf52265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:03.207474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:03.263907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 53/99] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:03.299180 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb499ff0-9ec6-4ee9-8155-dd11eac52068 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:03.302235 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:03.424990 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb499ff0-9ec6-4ee9-8155-dd11eac52068 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:03.468305 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b66dd5-2fda-4867-a9f2-836e46388ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:03.469115 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b66dd5-2fda-4867-a9f2-836e46388ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:03.469402 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b66dd5-2fda-4867-a9f2-836e46388ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:03.469680 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b66dd5-2fda-4867-a9f2-836e46388ab5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:03.488888 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b66dd5-2fda-4867-a9f2-836e46388ab5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:03.498836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-81b66dd5-2fda-4867-a9f2-836e46388ab5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:03.498836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:03.498836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:03.498836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:03.498836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:03.498836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:03.498836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:03.498836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:03.498836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:03.498836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:03.498836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:03.498836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:03.498836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:03.498836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:03.498836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:03.498836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:03.499762 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:03.499762 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:03.499762 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:03.499762 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:03.499762 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:03.499762 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:03.499762 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:03.499762 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:03.499762 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:03.499762 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:03.499762 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:03.499762 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:03.499762 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:03.499762 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:03.499762 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:03.499762 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:03.500517 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:03.500517 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:03.500517 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:03.500517 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:03.500517 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:03.500517 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:03.500517 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:03.500517 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:03.500517 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:03.500517 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:03.500517 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:03.500517 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:03.502981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 47/100] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:03.512441 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71712b2d-bd9d-4e52-9361-671becf52265 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:03.664246 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71712b2d-bd9d-4e52-9361-671becf52265 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:03.716001 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b788c-9525-4de8-a477-a1b7aca61380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:03.716610 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b788c-9525-4de8-a477-a1b7aca61380 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:03.716907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b788c-9525-4de8-a477-a1b7aca61380 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:03.717191 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b788c-9525-4de8-a477-a1b7aca61380 None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:03.717959 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b788c-9525-4de8-a477-a1b7aca61380 None admin] RBAC: Adding query filter params (name=member) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:03.718274 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b788c-9525-4de8-a477-a1b7aca61380 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:03.719676 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b788c-9525-4de8-a477-a1b7aca61380 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:03.729187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 54/101] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 19 15:18:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:03.734416 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b66dd5-2fda-4867-a9f2-836e46388ab5 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:03.894515 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:03.950418 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b66dd5-2fda-4867-a9f2-836e46388ab5 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:03.997582 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb464ef-f497-440a-b575-6db49a460c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:03.998383 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb464ef-f497-440a-b575-6db49a460c58 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:03.998670 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb464ef-f497-440a-b575-6db49a460c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:03.998951 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb464ef-f497-440a-b575-6db49a460c58 None admin] PATH_INFO: `/v3/users/f1ce8f6287214ffbb9b21e5891234a01` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:04.000183 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb464ef-f497-440a-b575-6db49a460c58 None admin] RBAC: Authorizing `identity:get_user(user_id=f1ce8f6287214ffbb9b21e5891234a01)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:04.001702 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb464ef-f497-440a-b575-6db49a460c58 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:04.003395 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 48/102] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:03 2022] GET /identity/v3/users/f1ce8f6287214ffbb9b21e5891234a01 => generated 275 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:04.012335 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b788c-9525-4de8-a477-a1b7aca61380 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:04.055892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:04.085373 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c51703-f032-4c34-956f-77f23a8b8777 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:04.085693 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c51703-f032-4c34-956f-77f23a8b8777 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:04.085945 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c51703-f032-4c34-956f-77f23a8b8777 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:04.087349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 49/103] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:04.103200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d3635-48ba-4b2b-870e-ccdf3ab24166 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:04.103498 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d3635-48ba-4b2b-870e-ccdf3ab24166 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:04.103788 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d3635-48ba-4b2b-870e-ccdf3ab24166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:04.131345 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-679d3635-48ba-4b2b-870e-ccdf3ab24166 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:04.132615 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-679d3635-48ba-4b2b-870e-ccdf3ab24166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:04.149655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b788c-9525-4de8-a477-a1b7aca61380 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:04.189467 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03279bf-2f1d-4c4b-ae0c-6c0d5cdfccce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:04.190930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03279bf-2f1d-4c4b-ae0c-6c0d5cdfccce None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:04.192126 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03279bf-2f1d-4c4b-ae0c-6c0d5cdfccce None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:04.192791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03279bf-2f1d-4c4b-ae0c-6c0d5cdfccce None admin] PATH_INFO: `/v3/projects/76392ff9ad244418a55302f0aa823f92` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:04.196309 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03279bf-2f1d-4c4b-ae0c-6c0d5cdfccce None admin] RBAC: Authorizing `identity:get_project(project_id=76392ff9ad244418a55302f0aa823f92)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:04.198169 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03279bf-2f1d-4c4b-ae0c-6c0d5cdfccce None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:04.200851 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 55/104] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:04 2022] GET /identity/v3/projects/76392ff9ad244418a55302f0aa823f92 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:04.208846 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03279bf-2f1d-4c4b-ae0c-6c0d5cdfccce None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:04.305602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 50/105] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:18:04.377018 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:04.394252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03279bf-2f1d-4c4b-ae0c-6c0d5cdfccce None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:04.421678 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d3635-48ba-4b2b-870e-ccdf3ab24166 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:04.459134 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70197a6f-c764-48d6-9fcb-92e112e33aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:04.461380 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70197a6f-c764-48d6-9fcb-92e112e33aea None admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:04.462072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70197a6f-c764-48d6-9fcb-92e112e33aea None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:04.463156 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70197a6f-c764-48d6-9fcb-92e112e33aea None admin] PATH_INFO: `/v3/projects/76392ff9ad244418a55302f0aa823f92/users/f1ce8f6287214ffbb9b21e5891234a01/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:04.467585 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70197a6f-c764-48d6-9fcb-92e112e33aea None admin] RBAC: Authorizing `identity:create_grant(project_id=76392ff9ad244418a55302f0aa823f92, user_id=f1ce8f6287214ffbb9b21e5891234a01, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:04.470157 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70197a6f-c764-48d6-9fcb-92e112e33aea None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:04.499809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 56/106] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 19 15:18:04 2022] PUT /identity/v3/projects/76392ff9ad244418a55302f0aa823f92/users/f1ce8f6287214ffbb9b21e5891234a01/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:18:04.501573 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedcdad-024d-402c-a800-3ab342b62921 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:04.502088 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedcdad-024d-402c-a800-3ab342b62921 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:04.502639 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedcdad-024d-402c-a800-3ab342b62921 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:04.504535 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 57/107] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:04.513239 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:04.513882 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1b7e3-1399-4d8b-b976-b792e3576ec1 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:04.515490 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1b7e3-1399-4d8b-b976-b792e3576ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:04.516040 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1b7e3-1399-4d8b-b976-b792e3576ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:04.556746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-93b1b7e3-1399-4d8b-b976-b792e3576ec1 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:04.558406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-93b1b7e3-1399-4d8b-b976-b792e3576ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:04.624729 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d3635-48ba-4b2b-870e-ccdf3ab24166 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:04.700727 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d41c4a-b3c0-4074-9ca4-487db0309f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:04.701604 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d41c4a-b3c0-4074-9ca4-487db0309f6c None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:04.701901 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d41c4a-b3c0-4074-9ca4-487db0309f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:04.702184 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d41c4a-b3c0-4074-9ca4-487db0309f6c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:04.705764 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d41c4a-b3c0-4074-9ca4-487db0309f6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:04.707646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d41c4a-b3c0-4074-9ca4-487db0309f6c None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:04.707894 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 58/108] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:18:04.709404 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c66bb-2851-482c-9830-281fd98dc781 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:04.709810 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c66bb-2851-482c-9830-281fd98dc781 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:04.710214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c66bb-2851-482c-9830-281fd98dc781 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:04.710522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 51/109] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:18:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:04.712157 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 59/110] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:04.720045 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d41c4a-b3c0-4074-9ca4-487db0309f6c None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:04.720484 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbacc3-fc55-435e-8dc5-111dac8cf068 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:04.720885 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbacc3-fc55-435e-8dc5-111dac8cf068 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:04.721277 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbacc3-fc55-435e-8dc5-111dac8cf068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:04.746950 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-8dcbacc3-fc55-435e-8dc5-111dac8cf068 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:04.748628 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-8dcbacc3-fc55-435e-8dc5-111dac8cf068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:04.831568 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 60/111] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:04.836218 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbacc3-fc55-435e-8dc5-111dac8cf068 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:04.848868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d41c4a-b3c0-4074-9ca4-487db0309f6c None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:04.857681 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:04.896336 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:04.914616 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3b207-9318-421d-9492-883aac8e2496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:04.915316 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3b207-9318-421d-9492-883aac8e2496 None admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:04.915605 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3b207-9318-421d-9492-883aac8e2496 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:04.915885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3b207-9318-421d-9492-883aac8e2496 None admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:04.916686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3b207-9318-421d-9492-883aac8e2496 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:04.918161 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3b207-9318-421d-9492-883aac8e2496 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:04.958025 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 52/112] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jul 19 15:18:04 2022] POST /identity/v3/projects => generated 302 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:18:04.961580 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3b207-9318-421d-9492-883aac8e2496 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:05.044062 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbacc3-fc55-435e-8dc5-111dac8cf068 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:05.089948 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2496320-ac30-4db4-aa2c-9de2176d5fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:05.091136 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2496320-ac30-4db4-aa2c-9de2176d5fed None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:05.091698 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2496320-ac30-4db4-aa2c-9de2176d5fed None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:05.092197 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2496320-ac30-4db4-aa2c-9de2176d5fed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:05.092486 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3b207-9318-421d-9492-883aac8e2496 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:05.105771 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2496320-ac30-4db4-aa2c-9de2176d5fed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:05.114413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-e2496320-ac30-4db4-aa2c-9de2176d5fed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:18:05.114413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:05.114413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:05.114413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:05.114413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:05.114413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:05.114413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:05.114413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:05.114413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:05.114413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:05.114413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:05.114413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:05.114413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:05.114413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:05.114413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:05.114413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:05.115473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:05.115473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:05.115473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:05.115473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:05.115473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:05.115473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:05.115473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:05.115473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:05.115473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:05.115473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:05.115473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:05.115473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:05.115473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:05.115473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:05.115473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:05.115473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:05.116752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:05.116752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:05.116752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:05.116752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:05.116752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:05.116752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:05.116752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:05.116752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:05.116752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:05.116752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:05.116752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:18:05.116752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:05.119497 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 61/113] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:05.125714 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2496320-ac30-4db4-aa2c-9de2176d5fed None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:05.132019 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b46b3-b7c7-4e0d-a80f-e080544dda41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:05.132851 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b46b3-b7c7-4e0d-a80f-e080544dda41 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:05.133137 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b46b3-b7c7-4e0d-a80f-e080544dda41 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:05.133416 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b46b3-b7c7-4e0d-a80f-e080544dda41 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:05.145630 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b46b3-b7c7-4e0d-a80f-e080544dda41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:05.157497 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-4a2b46b3-b7c7-4e0d-a80f-e080544dda41 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:18:05.157497 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:05.157497 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:05.157497 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:05.157497 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:05.157497 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:05.157497 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:05.157497 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:05.157497 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:05.157497 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:05.157497 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:05.157497 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:05.157497 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:05.157497 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:05.157497 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:05.157497 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:05.158414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:05.158414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:05.158414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:05.158414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:05.158414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:05.158414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:05.158414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:05.158414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:05.158414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:05.158414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:05.158414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:05.158414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:05.158414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:05.158414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:05.158414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:05.158414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:05.159162 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:05.159162 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:05.159162 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:05.159162 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:05.159162 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:05.159162 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:05.159162 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:05.159162 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:05.159162 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:05.159162 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:05.159162 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:18:05.159162 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:05.163013 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 53/114] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 19 15:18:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:05.171118 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b46b3-b7c7-4e0d-a80f-e080544dda41 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:05.218277 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:05.220721 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:05.260269 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2496320-ac30-4db4-aa2c-9de2176d5fed None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:05.290306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b46b3-b7c7-4e0d-a80f-e080544dda41 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:05.301618 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd1e6f-aab8-473a-81dc-3f32b8fa9e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:05.302723 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd1e6f-aab8-473a-81dc-3f32b8fa9e6f None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:05.303328 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd1e6f-aab8-473a-81dc-3f32b8fa9e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:05.303831 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd1e6f-aab8-473a-81dc-3f32b8fa9e6f None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:05.304813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dd1e6f-aab8-473a-81dc-3f32b8fa9e6f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:05.305409 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dd1e6f-aab8-473a-81dc-3f32b8fa9e6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:05.307102 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dd1e6f-aab8-473a-81dc-3f32b8fa9e6f None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:05.316889 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 62/115] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 19 15:18:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:05.323521 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd1e6f-aab8-473a-81dc-3f32b8fa9e6f None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:05.336926 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a1abb-c19c-45d5-86e5-017d2a7dec2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:05.337666 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a1abb-c19c-45d5-86e5-017d2a7dec2d None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:05.337956 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a1abb-c19c-45d5-86e5-017d2a7dec2d None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:05.338236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a1abb-c19c-45d5-86e5-017d2a7dec2d None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:05.339290 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a1abb-c19c-45d5-86e5-017d2a7dec2d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:05.339498 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a1abb-c19c-45d5-86e5-017d2a7dec2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:05.341007 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a1abb-c19c-45d5-86e5-017d2a7dec2d None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:05.356036 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 54/116] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:18:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:05.362579 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a1abb-c19c-45d5-86e5-017d2a7dec2d None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:05.438273 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd1e6f-aab8-473a-81dc-3f32b8fa9e6f None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:05.470799 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a1abb-c19c-45d5-86e5-017d2a7dec2d None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:05.471292 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:05.472746 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:05.479967 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262aff5-6a8c-4cf0-a045-aead75903692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:05.481987 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262aff5-6a8c-4cf0-a045-aead75903692 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:05.482533 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262aff5-6a8c-4cf0-a045-aead75903692 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:05.487093 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262aff5-6a8c-4cf0-a045-aead75903692 None admin] PATH_INFO: `/v3/users/3448de74ec1e47b0b635069c80c935f6` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:05.509865 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262aff5-6a8c-4cf0-a045-aead75903692 None admin] RBAC: Authorizing `identity:get_user(user_id=3448de74ec1e47b0b635069c80c935f6)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:05.511666 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262aff5-6a8c-4cf0-a045-aead75903692 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:05.518222 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b3fd0-537e-48f8-acae-db554b28b271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:05.518222 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b3fd0-537e-48f8-acae-db554b28b271 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:05.518222 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b3fd0-537e-48f8-acae-db554b28b271 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:05.518743 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 63/117] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:05 2022] GET /identity/v3/users/3448de74ec1e47b0b635069c80c935f6 => generated 289 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:05.519354 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b3fd0-537e-48f8-acae-db554b28b271 None admin] PATH_INFO: `/v3/users/f1ce8f6287214ffbb9b21e5891234a01` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:05.520261 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262aff5-6a8c-4cf0-a045-aead75903692 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:05.520649 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b3fd0-537e-48f8-acae-db554b28b271 None admin] RBAC: Authorizing `identity:get_user(user_id=f1ce8f6287214ffbb9b21e5891234a01)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:05.522752 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b3fd0-537e-48f8-acae-db554b28b271 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:05.524464 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 55/118] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:05 2022] GET /identity/v3/users/f1ce8f6287214ffbb9b21e5891234a01 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:05.530251 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b3fd0-537e-48f8-acae-db554b28b271 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:05.631388 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262aff5-6a8c-4cf0-a045-aead75903692 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:05.643661 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b3fd0-537e-48f8-acae-db554b28b271 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:05.667907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654bdf6-0686-44e9-a039-21f121b1821c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:05.668874 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654bdf6-0686-44e9-a039-21f121b1821c None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:05.669342 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654bdf6-0686-44e9-a039-21f121b1821c None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:05.669796 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654bdf6-0686-44e9-a039-21f121b1821c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:05.681465 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425bd2a-a4e8-44ab-9203-a5f32b87efb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:05.682440 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425bd2a-a4e8-44ab-9203-a5f32b87efb9 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:05.682792 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425bd2a-a4e8-44ab-9203-a5f32b87efb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:05.683088 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425bd2a-a4e8-44ab-9203-a5f32b87efb9 None admin] PATH_INFO: `/v3/projects/76392ff9ad244418a55302f0aa823f92` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:05.684428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425bd2a-a4e8-44ab-9203-a5f32b87efb9 None admin] RBAC: Authorizing `identity:get_project(project_id=76392ff9ad244418a55302f0aa823f92)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:05.685894 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425bd2a-a4e8-44ab-9203-a5f32b87efb9 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:05.687748 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 56/119] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:05 2022] GET /identity/v3/projects/76392ff9ad244418a55302f0aa823f92 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:05.693901 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425bd2a-a4e8-44ab-9203-a5f32b87efb9 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:05.744150 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:05.759140 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:05.776516 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9654bdf6-0686-44e9-a039-21f121b1821c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:05.785197 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9654bdf6-0686-44e9-a039-21f121b1821c None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:05.805494 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425bd2a-a4e8-44ab-9203-a5f32b87efb9 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:05.843644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98292d69-a4e0-429f-80e7-3797e716a552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:05.843644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98292d69-a4e0-429f-80e7-3797e716a552 None admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:05.843644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98292d69-a4e0-429f-80e7-3797e716a552 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:05.843980 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98292d69-a4e0-429f-80e7-3797e716a552 None admin] PATH_INFO: `/v3/projects/76392ff9ad244418a55302f0aa823f92/users/f1ce8f6287214ffbb9b21e5891234a01/roles/361f7a146e9b47e997cf572bae05c96e` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:05.846219 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98292d69-a4e0-429f-80e7-3797e716a552 None admin] RBAC: Authorizing `identity:create_grant(project_id=76392ff9ad244418a55302f0aa823f92, user_id=f1ce8f6287214ffbb9b21e5891234a01, role_id=361f7a146e9b47e997cf572bae05c96e)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:05.847716 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98292d69-a4e0-429f-80e7-3797e716a552 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:05.870189 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 57/120] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 19 15:18:05 2022] PUT /identity/v3/projects/76392ff9ad244418a55302f0aa823f92/users/f1ce8f6287214ffbb9b21e5891234a01/roles/361f7a146e9b47e997cf572bae05c96e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:18:05.872185 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ced52c-97e6-4633-b5bb-bf3886ae69c5 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:05.872735 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ced52c-97e6-4633-b5bb-bf3886ae69c5 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:05.873260 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ced52c-97e6-4633-b5bb-bf3886ae69c5 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:05.874866 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 58/121] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:05.882033 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870139e-bb91-4aa7-be94-2d4388a4b291 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:05.882653 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870139e-bb91-4aa7-be94-2d4388a4b291 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:05.883200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870139e-bb91-4aa7-be94-2d4388a4b291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:05.906061 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-d870139e-bb91-4aa7-be94-2d4388a4b291 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:05.907796 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-d870139e-bb91-4aa7-be94-2d4388a4b291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:05.999647 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 59/122] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:18:06.026865 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870139e-bb91-4aa7-be94-2d4388a4b291 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:06.030542 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 64/123] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:18:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:18:06.051461 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654bdf6-0686-44e9-a039-21f121b1821c None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:06.066900 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:06.152747 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870139e-bb91-4aa7-be94-2d4388a4b291 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:06.196721 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8190ea8-8e10-4177-a6e0-d5310334b1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:06.198011 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8190ea8-8e10-4177-a6e0-d5310334b1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:06.198497 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8190ea8-8e10-4177-a6e0-d5310334b1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:06.198989 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8190ea8-8e10-4177-a6e0-d5310334b1c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:06.211592 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8190ea8-8e10-4177-a6e0-d5310334b1c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:06.213562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:06.222383 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-e8190ea8-8e10-4177-a6e0-d5310334b1c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:06.222383 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:06.222383 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:06.222383 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:06.222383 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:06.222383 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:06.222383 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:06.222383 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:06.222383 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:06.222383 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:06.222383 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:06.222383 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:06.222383 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:06.222383 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:06.222383 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:06.222383 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:06.223558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:06.223558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:06.223558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:06.223558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:06.223558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:06.223558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:06.223558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:06.223558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:06.223558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:06.223558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:06.223558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:06.223558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:06.223558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:06.223558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:06.223558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:06.223558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:06.224330 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:06.224330 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:06.224330 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:06.224330 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:06.224330 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:06.224330 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:06.224330 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:06.224330 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:06.224330 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:06.224330 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:06.224330 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:06.224330 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:06.226701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 60/124] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:06.234656 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654bdf6-0686-44e9-a039-21f121b1821c None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:06.237422 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8190ea8-8e10-4177-a6e0-d5310334b1c0 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:06.332916 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00101a-0704-46ba-a8c6-08334db8a7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:06.333814 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00101a-0704-46ba-a8c6-08334db8a7da None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:06.334636 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00101a-0704-46ba-a8c6-08334db8a7da None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:06.334927 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00101a-0704-46ba-a8c6-08334db8a7da None admin] PATH_INFO: `/v3/projects/76392ff9ad244418a55302f0aa823f92` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:06.336215 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00101a-0704-46ba-a8c6-08334db8a7da None admin] RBAC: Authorizing `identity:get_project(project_id=76392ff9ad244418a55302f0aa823f92)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:06.337683 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00101a-0704-46ba-a8c6-08334db8a7da None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:06.339780 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 65/125] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:06 2022] GET /identity/v3/projects/76392ff9ad244418a55302f0aa823f92 => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:06.346177 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00101a-0704-46ba-a8c6-08334db8a7da None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:06.413507 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:06.423898 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8190ea8-8e10-4177-a6e0-d5310334b1c0 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:06.479822 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e34a2-81cb-4c0a-adf7-205aea63cc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:06.480962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e34a2-81cb-4c0a-adf7-205aea63cc13 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:06.481450 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e34a2-81cb-4c0a-adf7-205aea63cc13 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:06.481974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e34a2-81cb-4c0a-adf7-205aea63cc13 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:06.482935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e34a2-81cb-4c0a-adf7-205aea63cc13 None admin] RBAC: Adding query filter params (name=member) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:06.483549 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e34a2-81cb-4c0a-adf7-205aea63cc13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:06.485208 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e34a2-81cb-4c0a-adf7-205aea63cc13 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:06.517778 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 61/126] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 19 15:18:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:06.523787 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e34a2-81cb-4c0a-adf7-205aea63cc13 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:06.656560 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00101a-0704-46ba-a8c6-08334db8a7da None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:06.695704 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7243729-0686-44d4-b668-1ff6ac9abac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:06.696297 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7243729-0686-44d4-b668-1ff6ac9abac3 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:06.696599 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7243729-0686-44d4-b668-1ff6ac9abac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:06.696857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7243729-0686-44d4-b668-1ff6ac9abac3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:06.697714 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7243729-0686-44d4-b668-1ff6ac9abac3 None admin] RBAC: Adding query filter params (role.id=d528f237588f49489344fe727d4662e5, scope.project.id=76392ff9ad244418a55302f0aa823f92, user.id=3448de74ec1e47b0b635069c80c935f6) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:06.698019 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7243729-0686-44d4-b668-1ff6ac9abac3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:06.699506 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7243729-0686-44d4-b668-1ff6ac9abac3 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:06.705311 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 66/127] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:18:06 2022] GET /identity/v3/role_assignments?user.id=3448de74ec1e47b0b635069c80c935f6&scope.project.id=76392ff9ad244418a55302f0aa823f92&role.id=d528f237588f49489344fe727d4662e5 => generated 259 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:06.706749 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d96951-da46-4d72-ba7e-314833874e99 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:06.707045 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d96951-da46-4d72-ba7e-314833874e99 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:06.707357 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d96951-da46-4d72-ba7e-314833874e99 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:06.708624 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 67/128] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:06.715127 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b12520-1dec-47ba-9194-d13dfb971346 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:06.715453 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b12520-1dec-47ba-9194-d13dfb971346 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:06.715742 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b12520-1dec-47ba-9194-d13dfb971346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:06.733818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-90b12520-1dec-47ba-9194-d13dfb971346 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:06.734995 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-90b12520-1dec-47ba-9194-d13dfb971346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:06.759987 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:06.793736 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e34a2-81cb-4c0a-adf7-205aea63cc13 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:06.822021 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 68/129] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:18:06.841086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b12520-1dec-47ba-9194-d13dfb971346 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:06.868012 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dbbae-13d9-4157-9fc4-fc0cc9ab3463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:06.869237 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dbbae-13d9-4157-9fc4-fc0cc9ab3463 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:06.869784 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dbbae-13d9-4157-9fc4-fc0cc9ab3463 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:06.870287 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dbbae-13d9-4157-9fc4-fc0cc9ab3463 None admin] PATH_INFO: `/v3/users/f1ce8f6287214ffbb9b21e5891234a01` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:06.871863 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dbbae-13d9-4157-9fc4-fc0cc9ab3463 None admin] RBAC: Authorizing `identity:get_user(user_id=f1ce8f6287214ffbb9b21e5891234a01)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:06.873733 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dbbae-13d9-4157-9fc4-fc0cc9ab3463 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:06.875873 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 62/130] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:06 2022] GET /identity/v3/users/f1ce8f6287214ffbb9b21e5891234a01 => generated 275 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:06.883670 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dbbae-13d9-4157-9fc4-fc0cc9ab3463 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:06.908794 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:07.017284 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dbbae-13d9-4157-9fc4-fc0cc9ab3463 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:07.038903 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b12520-1dec-47ba-9194-d13dfb971346 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:07.076106 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a5877-7151-4e71-b27b-394a824cf07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:07.077142 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a5877-7151-4e71-b27b-394a824cf07b None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:07.077594 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a5877-7151-4e71-b27b-394a824cf07b None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:07.078070 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a5877-7151-4e71-b27b-394a824cf07b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:07.090049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a5877-7151-4e71-b27b-394a824cf07b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:07.097896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-ee2a5877-7151-4e71-b27b-394a824cf07b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:18:07.097896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:07.097896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:07.097896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:07.097896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:07.097896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:07.097896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:07.097896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:07.097896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:07.097896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:07.097896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:07.097896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:07.097896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:07.097896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:07.097896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:07.097896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:07.098972 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:07.098972 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:07.098972 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:07.098972 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:07.098972 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:07.098972 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:07.098972 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:07.098972 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:07.098972 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:07.098972 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:07.098972 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:07.098972 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:07.098972 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:07.098972 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:07.098972 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:07.098972 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:07.100516 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:07.100516 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:07.100516 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:07.100516 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:07.100516 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:07.100516 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:07.100516 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:07.100516 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:07.100516 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:07.100516 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:07.100516 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:18:07.100516 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:07.107214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 69/131] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:18:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:07.108665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a5877-7151-4e71-b27b-394a824cf07b None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:07.116004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24034031-fcde-4d11-a274-b7937f69c2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:07.116904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24034031-fcde-4d11-a274-b7937f69c2ef None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:07.117200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24034031-fcde-4d11-a274-b7937f69c2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:07.117491 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24034031-fcde-4d11-a274-b7937f69c2ef None admin] PATH_INFO: `/v3/projects/38d2636ff3eb405083c509b300f7ef01` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:07.118761 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24034031-fcde-4d11-a274-b7937f69c2ef None admin] RBAC: Authorizing `identity:get_project(project_id=38d2636ff3eb405083c509b300f7ef01)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:07.120257 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24034031-fcde-4d11-a274-b7937f69c2ef None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:07.126623 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 63/132] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:06 2022] GET /identity/v3/projects/38d2636ff3eb405083c509b300f7ef01 => generated 312 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:07.127896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:07.144711 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24034031-fcde-4d11-a274-b7937f69c2ef None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:07.221280 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a5877-7151-4e71-b27b-394a824cf07b None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:07.256496 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d0e6d-bf1e-43ed-9ea7-5c536bac471f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:07.257440 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d0e6d-bf1e-43ed-9ea7-5c536bac471f None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:07.257880 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d0e6d-bf1e-43ed-9ea7-5c536bac471f None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:07.258308 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d0e6d-bf1e-43ed-9ea7-5c536bac471f None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:07.259213 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d0e6d-bf1e-43ed-9ea7-5c536bac471f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:07.259699 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d0e6d-bf1e-43ed-9ea7-5c536bac471f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:07.261229 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d0e6d-bf1e-43ed-9ea7-5c536bac471f None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:07.275412 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 70/133] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:07.276891 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d0e6d-bf1e-43ed-9ea7-5c536bac471f None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:07.350659 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:07.358217 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:07.360859 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24034031-fcde-4d11-a274-b7937f69c2ef None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:07.384651 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d0e6d-bf1e-43ed-9ea7-5c536bac471f None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:07.417065 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea62d01-d159-48aa-9309-3e023ef06abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:07.418240 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea62d01-d159-48aa-9309-3e023ef06abb None admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:07.418684 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea62d01-d159-48aa-9309-3e023ef06abb None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:07.419169 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea62d01-d159-48aa-9309-3e023ef06abb None admin] PATH_INFO: `/v3/projects/38d2636ff3eb405083c509b300f7ef01/users/f1ce8f6287214ffbb9b21e5891234a01/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:07.421087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf540b-2777-4c5d-baa6-b1f893dcfd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:07.421719 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea62d01-d159-48aa-9309-3e023ef06abb None admin] RBAC: Authorizing `identity:create_grant(project_id=38d2636ff3eb405083c509b300f7ef01, user_id=f1ce8f6287214ffbb9b21e5891234a01, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:07.422285 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf540b-2777-4c5d-baa6-b1f893dcfd3a None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:07.422716 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf540b-2777-4c5d-baa6-b1f893dcfd3a None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:07.423129 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf540b-2777-4c5d-baa6-b1f893dcfd3a None admin] PATH_INFO: `/v3/users/a5979772c3b54e8bb6dcc49d7d98fa0c` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:07.423606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea62d01-d159-48aa-9309-3e023ef06abb None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:07.424691 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf540b-2777-4c5d-baa6-b1f893dcfd3a None admin] RBAC: Authorizing `identity:get_user(user_id=a5979772c3b54e8bb6dcc49d7d98fa0c)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:07.426265 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf540b-2777-4c5d-baa6-b1f893dcfd3a None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:07.432675 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 71/134] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:07 2022] GET /identity/v3/users/a5979772c3b54e8bb6dcc49d7d98fa0c => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:07.434048 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf540b-2777-4c5d-baa6-b1f893dcfd3a None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:07.451270 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 64/135] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 19 15:18:07 2022] PUT /identity/v3/projects/38d2636ff3eb405083c509b300f7ef01/users/f1ce8f6287214ffbb9b21e5891234a01/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:18:07.573652 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf540b-2777-4c5d-baa6-b1f893dcfd3a None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:07.619527 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb4524-3de7-4547-bff6-5f5a4ce0f791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:07.620412 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb4524-3de7-4547-bff6-5f5a4ce0f791 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:07.620704 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb4524-3de7-4547-bff6-5f5a4ce0f791 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:07.620990 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb4524-3de7-4547-bff6-5f5a4ce0f791 None admin] PATH_INFO: `/v3/projects/76392ff9ad244418a55302f0aa823f92` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:07.623447 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb4524-3de7-4547-bff6-5f5a4ce0f791 None admin] RBAC: Authorizing `identity:get_project(project_id=76392ff9ad244418a55302f0aa823f92)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:07.624921 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb4524-3de7-4547-bff6-5f5a4ce0f791 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:07.626973 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 72/136] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:07 2022] GET /identity/v3/projects/76392ff9ad244418a55302f0aa823f92 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:07.633580 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea62d01-d159-48aa-9309-3e023ef06abb None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:07.785882 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea62d01-d159-48aa-9309-3e023ef06abb None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:07.824988 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2ecd7-b156-48b1-afc1-46a2c3349038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:07.825819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2ecd7-b156-48b1-afc1-46a2c3349038 None admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:07.826111 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2ecd7-b156-48b1-afc1-46a2c3349038 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:07.826399 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2ecd7-b156-48b1-afc1-46a2c3349038 None admin] PATH_INFO: `/v3/projects/76392ff9ad244418a55302f0aa823f92/users/a5979772c3b54e8bb6dcc49d7d98fa0c/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:07.828448 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2ecd7-b156-48b1-afc1-46a2c3349038 None admin] RBAC: Authorizing `identity:create_grant(project_id=76392ff9ad244418a55302f0aa823f92, user_id=a5979772c3b54e8bb6dcc49d7d98fa0c, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:07.829984 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2ecd7-b156-48b1-afc1-46a2c3349038 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:07.846673 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 65/137] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 19 15:18:07 2022] PUT /identity/v3/projects/76392ff9ad244418a55302f0aa823f92/users/a5979772c3b54e8bb6dcc49d7d98fa0c/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:18:08.034715 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c19d5-5353-4f7e-a830-62acafd48301 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:08.035278 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c19d5-5353-4f7e-a830-62acafd48301 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:08.035371 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c19d5-5353-4f7e-a830-62acafd48301 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:08.036823 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 73/138] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:08.043137 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7fe81-f593-420d-bb46-19aff6b88f2b None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:08.043535 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7fe81-f593-420d-bb46-19aff6b88f2b None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:08.043826 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7fe81-f593-420d-bb46-19aff6b88f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:08.057727 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:08.069646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-46e7fe81-f593-420d-bb46-19aff6b88f2b None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:08.071669 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-46e7fe81-f593-420d-bb46-19aff6b88f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:08.182218 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 66/139] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:08.207573 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c19d5-5353-4f7e-a830-62acafd48301 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:08.230045 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:08.392595 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c19d5-5353-4f7e-a830-62acafd48301 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:08.457123 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e338e17-5630-43fe-901b-1e360486a341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:08.457871 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e338e17-5630-43fe-901b-1e360486a341 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:08.458169 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e338e17-5630-43fe-901b-1e360486a341 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:08.458458 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e338e17-5630-43fe-901b-1e360486a341 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:08.488233 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e338e17-5630-43fe-901b-1e360486a341 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:08.496720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-0e338e17-5630-43fe-901b-1e360486a341 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:08.496720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:08.496720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:08.496720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:08.496720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:08.496720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:08.496720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:08.496720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:08.496720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:08.496720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:08.496720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:08.496720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:08.496720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:08.496720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:08.496720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:08.496720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:08.497559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:08.497559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:08.497559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:08.497559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:08.497559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:08.497559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:08.497559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:08.497559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:08.497559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:08.497559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:08.497559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:08.497559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:08.497559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:08.497559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:08.497559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:08.497559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:08.498778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:08.498778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:08.498778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:08.498778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:08.498778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:08.498778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:08.498778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:08.498778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:08.498778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:08.498778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:08.498778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:08.498778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:08.498778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 74/140] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:08.510886 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7fe81-f593-420d-bb46-19aff6b88f2b None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:08.573620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8ae6a-a0f7-4df1-b103-dd4414874f8b None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:08.573965 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8ae6a-a0f7-4df1-b103-dd4414874f8b None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:08.574207 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8ae6a-a0f7-4df1-b103-dd4414874f8b None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:08.575822 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 75/141] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:08.581064 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ae4a6-1a03-49d9-838a-3bf3db5c5381 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:08.581365 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ae4a6-1a03-49d9-838a-3bf3db5c5381 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:08.581655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ae4a6-1a03-49d9-838a-3bf3db5c5381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:08.610253 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-7b3ae4a6-1a03-49d9-838a-3bf3db5c5381 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:08.611535 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-7b3ae4a6-1a03-49d9-838a-3bf3db5c5381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:08.793038 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:08.797645 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 76/142] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:08.813410 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7fe81-f593-420d-bb46-19aff6b88f2b None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:08.834288 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ae4a6-1a03-49d9-838a-3bf3db5c5381 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:08.895983 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d430e87-f8de-4106-a0a0-19083eb83b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:08.897091 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d430e87-f8de-4106-a0a0-19083eb83b62 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:08.897610 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d430e87-f8de-4106-a0a0-19083eb83b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:08.898101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d430e87-f8de-4106-a0a0-19083eb83b62 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:08.899090 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d430e87-f8de-4106-a0a0-19083eb83b62 None admin] RBAC: Adding query filter params (name=member) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:08.899661 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d430e87-f8de-4106-a0a0-19083eb83b62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:08.901300 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d430e87-f8de-4106-a0a0-19083eb83b62 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:08.914550 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:08.921207 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 67/143] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 19 15:18:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:08.926728 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d430e87-f8de-4106-a0a0-19083eb83b62 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:09.025356 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ae4a6-1a03-49d9-838a-3bf3db5c5381 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:09.085908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98dd90b-b4b6-42b2-8d4b-82d36e5f2bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:09.086728 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dd90b-b4b6-42b2-8d4b-82d36e5f2bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:09.087018 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dd90b-b4b6-42b2-8d4b-82d36e5f2bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:09.087323 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dd90b-b4b6-42b2-8d4b-82d36e5f2bd6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:09.089164 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98dd90b-b4b6-42b2-8d4b-82d36e5f2bd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:09.090800 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98dd90b-b4b6-42b2-8d4b-82d36e5f2bd6 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:09.093206 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 77/144] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:18:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:09.098880 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98dd90b-b4b6-42b2-8d4b-82d36e5f2bd6 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:09.211646 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:09.229664 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d430e87-f8de-4106-a0a0-19083eb83b62 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:09.279632 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98dd90b-b4b6-42b2-8d4b-82d36e5f2bd6 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:09.300980 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fc87e-82f7-44ad-8d00-3a3acf7f381f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:09.301883 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fc87e-82f7-44ad-8d00-3a3acf7f381f None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:09.302163 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fc87e-82f7-44ad-8d00-3a3acf7f381f None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:09.302442 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fc87e-82f7-44ad-8d00-3a3acf7f381f None admin] PATH_INFO: `/v3/users/f1ce8f6287214ffbb9b21e5891234a01` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:09.303850 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fc87e-82f7-44ad-8d00-3a3acf7f381f None admin] RBAC: Authorizing `identity:get_user(user_id=f1ce8f6287214ffbb9b21e5891234a01)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:09.305314 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fc87e-82f7-44ad-8d00-3a3acf7f381f None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:09.307207 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 68/145] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:08 2022] GET /identity/v3/users/f1ce8f6287214ffbb9b21e5891234a01 => generated 275 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:09.310979 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575f702-3982-4692-aa07-4be0668896ba None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:09.311313 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575f702-3982-4692-aa07-4be0668896ba None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:09.311616 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575f702-3982-4692-aa07-4be0668896ba None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:09.313070 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 69/146] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:09.313628 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575f702-3982-4692-aa07-4be0668896ba None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:09.352627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb360331-b5f3-41bc-b156-3344b0083301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:09.353235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb360331-b5f3-41bc-b156-3344b0083301 None admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:09.353527 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb360331-b5f3-41bc-b156-3344b0083301 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:09.353812 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb360331-b5f3-41bc-b156-3344b0083301 None admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:09.354543 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb360331-b5f3-41bc-b156-3344b0083301 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:09.356034 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb360331-b5f3-41bc-b156-3344b0083301 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:09.399193 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 78/147] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jul 19 15:18:09 2022] POST /identity/v3/users => generated 283 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:18:09.400484 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cb498-b4bc-4c39-a16a-7062a2dc2f8c None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:09.400781 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cb498-b4bc-4c39-a16a-7062a2dc2f8c None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:09.401065 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cb498-b4bc-4c39-a16a-7062a2dc2f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:09.409076 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:09.448378 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-7d7cb498-b4bc-4c39-a16a-7062a2dc2f8c None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:09.449612 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-7d7cb498-b4bc-4c39-a16a-7062a2dc2f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:09.492796 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575f702-3982-4692-aa07-4be0668896ba None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:09.548478 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cd3c3-470c-40c9-ad22-c0528fd01a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:09.550042 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cd3c3-470c-40c9-ad22-c0528fd01a4b None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:09.550551 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cd3c3-470c-40c9-ad22-c0528fd01a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:09.551027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cd3c3-470c-40c9-ad22-c0528fd01a4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:09.629140 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 79/148] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:09.630502 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad50fe4-86e3-4bf5-a36e-19eb11ece432 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:09.630799 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad50fe4-86e3-4bf5-a36e-19eb11ece432 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:09.631821 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad50fe4-86e3-4bf5-a36e-19eb11ece432 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:09.634146 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 80/149] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:09.640110 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cc431-fb64-43d4-a230-44f76d3e3a31 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:09.640404 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cc431-fb64-43d4-a230-44f76d3e3a31 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:09.640738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cc431-fb64-43d4-a230-44f76d3e3a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:09.659160 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-633cc431-fb64-43d4-a230-44f76d3e3a31 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:09.660396 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-633cc431-fb64-43d4-a230-44f76d3e3a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:09.689773 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6cd3c3-470c-40c9-ad22-c0528fd01a4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:09.692149 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6cd3c3-470c-40c9-ad22-c0528fd01a4b None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:09.731103 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:09.752884 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 81/150] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:18:09.754077 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cc431-fb64-43d4-a230-44f76d3e3a31 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:09.799816 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:09.850208 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 70/151] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:18:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:18:09.853580 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cd3c3-470c-40c9-ad22-c0528fd01a4b None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:09.901778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cc431-fb64-43d4-a230-44f76d3e3a31 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:09.951652 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebef65-1863-4101-b577-f7bd45bdd839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:09.952863 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebef65-1863-4101-b577-f7bd45bdd839 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:09.953353 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebef65-1863-4101-b577-f7bd45bdd839 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:09.953832 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebef65-1863-4101-b577-f7bd45bdd839 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:09.971166 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebef65-1863-4101-b577-f7bd45bdd839 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:09.980367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-2eebef65-1863-4101-b577-f7bd45bdd839 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:18:09.980367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:09.980367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:09.980367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:09.980367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:09.980367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:09.980367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:09.980367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:09.980367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:09.980367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:09.980367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:09.980367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:09.980367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:09.980367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:09.980367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:09.980367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:09.981225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:09.981225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:09.981225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:09.981225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:09.981225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:09.981225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:09.981225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:09.981225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:09.981225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:09.981225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:09.981225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:09.981225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:09.981225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:09.981225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:09.981225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:09.981225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:09.982059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:09.982059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:09.982059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:09.982059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:09.982059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:09.982059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:09.982059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:09.982059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:09.982059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:09.982059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:09.982059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:18:09.982059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:09.984463 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 82/152] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 19 15:18:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:09.985468 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebef65-1863-4101-b577-f7bd45bdd839 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:09.997009 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cd3c3-470c-40c9-ad22-c0528fd01a4b None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:10.038853 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67739c75-a43e-4e12-9cac-7a49a72161eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:10.039719 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67739c75-a43e-4e12-9cac-7a49a72161eb None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:10.040002 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67739c75-a43e-4e12-9cac-7a49a72161eb None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:10.040285 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67739c75-a43e-4e12-9cac-7a49a72161eb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:10.042284 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:10.053390 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67739c75-a43e-4e12-9cac-7a49a72161eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:10.061951 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-67739c75-a43e-4e12-9cac-7a49a72161eb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:18:10.061951 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:10.061951 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:10.061951 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:10.061951 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:10.061951 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:10.061951 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:10.061951 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:10.061951 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:10.061951 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:10.061951 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:10.061951 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:10.061951 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:10.061951 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:10.061951 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:10.061951 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:10.062860 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:10.062860 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:10.062860 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:10.062860 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:10.062860 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:10.062860 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:10.062860 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:10.062860 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:10.062860 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:10.062860 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:10.062860 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:10.062860 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:10.062860 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:10.062860 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:10.062860 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:10.062860 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:10.063659 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:10.063659 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:10.063659 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:10.063659 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:10.063659 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:10.063659 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:10.063659 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:10.063659 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:10.063659 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:10.063659 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:10.063659 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:18:10.063659 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:10.063659 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 71/153] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:10.064409 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67739c75-a43e-4e12-9cac-7a49a72161eb None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:10.098764 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:10.123604 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebef65-1863-4101-b577-f7bd45bdd839 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:10.188590 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e0d4b-b669-4043-909c-330248081632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:10.189383 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e0d4b-b669-4043-909c-330248081632 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:10.189666 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e0d4b-b669-4043-909c-330248081632 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:10.190003 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e0d4b-b669-4043-909c-330248081632 None admin] PATH_INFO: `/v3/projects/76392ff9ad244418a55302f0aa823f92` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:10.192289 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e0d4b-b669-4043-909c-330248081632 None admin] RBAC: Authorizing `identity:get_project(project_id=76392ff9ad244418a55302f0aa823f92)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:10.193798 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e0d4b-b669-4043-909c-330248081632 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:10.195727 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 83/154] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:09 2022] GET /identity/v3/projects/76392ff9ad244418a55302f0aa823f92 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:10.196321 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e0d4b-b669-4043-909c-330248081632 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:10.215340 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67739c75-a43e-4e12-9cac-7a49a72161eb None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:10.279568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27d3ad-67c0-4383-bb7a-2712f8e03841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:10.280513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27d3ad-67c0-4383-bb7a-2712f8e03841 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:10.280802 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27d3ad-67c0-4383-bb7a-2712f8e03841 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:10.281080 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27d3ad-67c0-4383-bb7a-2712f8e03841 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:10.281846 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27d3ad-67c0-4383-bb7a-2712f8e03841 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:10.282169 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27d3ad-67c0-4383-bb7a-2712f8e03841 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:10.283581 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27d3ad-67c0-4383-bb7a-2712f8e03841 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:10.300937 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 72/155] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:18:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:10.301788 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27d3ad-67c0-4383-bb7a-2712f8e03841 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:10.393146 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e0d4b-b669-4043-909c-330248081632 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:10.410601 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:10.456934 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:10.478438 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e250423-826a-4adf-8243-d478d04dc0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:10.478438 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e250423-826a-4adf-8243-d478d04dc0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:10.478438 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e250423-826a-4adf-8243-d478d04dc0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:10.478438 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e250423-826a-4adf-8243-d478d04dc0e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:10.478887 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e250423-826a-4adf-8243-d478d04dc0e1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:10.478887 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e250423-826a-4adf-8243-d478d04dc0e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:10.478887 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e250423-826a-4adf-8243-d478d04dc0e1 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:10.480724 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27d3ad-67c0-4383-bb7a-2712f8e03841 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:10.491723 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 84/156] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 19 15:18:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:10.492680 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e250423-826a-4adf-8243-d478d04dc0e1 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:10.524119 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1536667-37f7-46f3-a012-e0c31307c609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:10.525287 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1536667-37f7-46f3-a012-e0c31307c609 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:10.525748 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1536667-37f7-46f3-a012-e0c31307c609 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:10.526228 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1536667-37f7-46f3-a012-e0c31307c609 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:10.527446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1536667-37f7-46f3-a012-e0c31307c609 None admin] RBAC: Adding query filter params (role.id=ff311e825f2b4a3d809aa772f6cdecb0, scope.project.id=76392ff9ad244418a55302f0aa823f92, user.id=f1ce8f6287214ffbb9b21e5891234a01) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:10.528560 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1536667-37f7-46f3-a012-e0c31307c609 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:10.531426 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1536667-37f7-46f3-a012-e0c31307c609 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:10.539275 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 73/157] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:18:10 2022] GET /identity/v3/role_assignments?user.id=f1ce8f6287214ffbb9b21e5891234a01&scope.project.id=76392ff9ad244418a55302f0aa823f92&role.id=ff311e825f2b4a3d809aa772f6cdecb0 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:10.540551 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1536667-37f7-46f3-a012-e0c31307c609 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:10.669525 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1536667-37f7-46f3-a012-e0c31307c609 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:10.693971 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e250423-826a-4adf-8243-d478d04dc0e1 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:10.736059 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f2d09-b5f0-43a3-a88f-966d3aaf62be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:10.737358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f2d09-b5f0-43a3-a88f-966d3aaf62be None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:10.737871 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ea90e-deb4-4506-9ee3-26cdba4c6a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:10.738002 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f2d09-b5f0-43a3-a88f-966d3aaf62be None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:10.738470 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f2d09-b5f0-43a3-a88f-966d3aaf62be None admin] PATH_INFO: `/v3/users/3448de74ec1e47b0b635069c80c935f6` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:10.738770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ea90e-deb4-4506-9ee3-26cdba4c6a86 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:10.739062 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ea90e-deb4-4506-9ee3-26cdba4c6a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:10.739385 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ea90e-deb4-4506-9ee3-26cdba4c6a86 None admin] PATH_INFO: `/v3/users/f1ce8f6287214ffbb9b21e5891234a01` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:10.741250 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ea90e-deb4-4506-9ee3-26cdba4c6a86 None admin] RBAC: Authorizing `identity:get_user(user_id=f1ce8f6287214ffbb9b21e5891234a01)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:10.742180 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f2d09-b5f0-43a3-a88f-966d3aaf62be None admin] RBAC: Authorizing `identity:get_user(user_id=3448de74ec1e47b0b635069c80c935f6)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:10.742709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ea90e-deb4-4506-9ee3-26cdba4c6a86 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:10.744222 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f2d09-b5f0-43a3-a88f-966d3aaf62be None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:10.744677 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 85/158] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:10 2022] GET /identity/v3/users/f1ce8f6287214ffbb9b21e5891234a01 => generated 275 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:10.746852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 74/159] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:10 2022] GET /identity/v3/users/3448de74ec1e47b0b635069c80c935f6 => generated 289 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:10.750952 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ea90e-deb4-4506-9ee3-26cdba4c6a86 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:10.752146 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f2d09-b5f0-43a3-a88f-966d3aaf62be None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:10.786596 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:10.815116 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:10.917885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f2d09-b5f0-43a3-a88f-966d3aaf62be None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:10.944956 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ea90e-deb4-4506-9ee3-26cdba4c6a86 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:10.960762 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfc3dd-8bc6-43a4-a359-e3a432a0f6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:10.961655 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfc3dd-8bc6-43a4-a359-e3a432a0f6cd None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:10.961945 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfc3dd-8bc6-43a4-a359-e3a432a0f6cd None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:10.962228 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfc3dd-8bc6-43a4-a359-e3a432a0f6cd None admin] PATH_INFO: `/v3/projects/76392ff9ad244418a55302f0aa823f92` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:10.963510 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cfc3dd-8bc6-43a4-a359-e3a432a0f6cd None admin] RBAC: Authorizing `identity:get_project(project_id=76392ff9ad244418a55302f0aa823f92)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:10.965494 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cfc3dd-8bc6-43a4-a359-e3a432a0f6cd None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:10.969168 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 75/160] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:10 2022] GET /identity/v3/projects/76392ff9ad244418a55302f0aa823f92 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:10.970493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10952360-37bb-4daf-a16f-3b6cab4d4ab8 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:10.970789 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10952360-37bb-4daf-a16f-3b6cab4d4ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:10.971076 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10952360-37bb-4daf-a16f-3b6cab4d4ab8 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:10.972630 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 76/161] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:10.976173 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10952360-37bb-4daf-a16f-3b6cab4d4ab8 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:11.008972 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61b008-1e97-4c87-aad7-fc9dd9bcb133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:11.009555 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61b008-1e97-4c87-aad7-fc9dd9bcb133 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:11.009841 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61b008-1e97-4c87-aad7-fc9dd9bcb133 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:11.010121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61b008-1e97-4c87-aad7-fc9dd9bcb133 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:11.143590 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:11.165690 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61b008-1e97-4c87-aad7-fc9dd9bcb133 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:11.167197 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61b008-1e97-4c87-aad7-fc9dd9bcb133 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:11.185360 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10952360-37bb-4daf-a16f-3b6cab4d4ab8 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:11.248984 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be0a40-e45f-49db-bce9-2b212c4421b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:11.249221 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:11.249902 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be0a40-e45f-49db-bce9-2b212c4421b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:11.250190 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be0a40-e45f-49db-bce9-2b212c4421b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:11.250474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be0a40-e45f-49db-bce9-2b212c4421b8 None admin] PATH_INFO: `/v3/projects/76392ff9ad244418a55302f0aa823f92/users/3448de74ec1e47b0b635069c80c935f6/roles/d528f237588f49489344fe727d4662e5` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:11.257184 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be0a40-e45f-49db-bce9-2b212c4421b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=76392ff9ad244418a55302f0aa823f92, user_id=3448de74ec1e47b0b635069c80c935f6, role_id=d528f237588f49489344fe727d4662e5)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:11.258637 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be0a40-e45f-49db-bce9-2b212c4421b8 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:11.290062 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 77/162] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 19 15:18:10 2022] PUT /identity/v3/projects/76392ff9ad244418a55302f0aa823f92/users/3448de74ec1e47b0b635069c80c935f6/roles/d528f237588f49489344fe727d4662e5 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:18:11.291293 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2e883-3c1d-4a71-8360-b4166c80e39c None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:11.291984 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2e883-3c1d-4a71-8360-b4166c80e39c None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:11.291984 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2e883-3c1d-4a71-8360-b4166c80e39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:11.344430 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-0ca2e883-3c1d-4a71-8360-b4166c80e39c None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:11.345680 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-0ca2e883-3c1d-4a71-8360-b4166c80e39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:11.388257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 86/163] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:18:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:18:11.389820 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ee453-7e36-4b32-9dc5-bc3e4fe92b45 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:11.390123 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ee453-7e36-4b32-9dc5-bc3e4fe92b45 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:11.390409 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ee453-7e36-4b32-9dc5-bc3e4fe92b45 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:11.391877 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 87/164] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:11.401674 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ee453-7e36-4b32-9dc5-bc3e4fe92b45 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:11.466247 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 78/165] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:11.467503 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099beb5-cbe0-4994-b040-114e9701930f None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:11.467801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099beb5-cbe0-4994-b040-114e9701930f None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:11.468086 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099beb5-cbe0-4994-b040-114e9701930f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:11.487508 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-a099beb5-cbe0-4994-b040-114e9701930f None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:11.488722 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-a099beb5-cbe0-4994-b040-114e9701930f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:11.564121 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 79/166] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:11.564721 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099beb5-cbe0-4994-b040-114e9701930f None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:11.575593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:11.617523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ee453-7e36-4b32-9dc5-bc3e4fe92b45 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:11.676908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d6716-8ab5-40d4-9965-8815474caab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:11.677266 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099beb5-cbe0-4994-b040-114e9701930f None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:11.678297 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d6716-8ab5-40d4-9965-8815474caab7 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:11.679254 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d6716-8ab5-40d4-9965-8815474caab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:11.679254 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d6716-8ab5-40d4-9965-8815474caab7 None admin] PATH_INFO: `/v3/projects/76392ff9ad244418a55302f0aa823f92` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:11.680091 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d6716-8ab5-40d4-9965-8815474caab7 None admin] RBAC: Authorizing `identity:get_project(project_id=76392ff9ad244418a55302f0aa823f92)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:11.681549 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d6716-8ab5-40d4-9965-8815474caab7 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:11.687346 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 88/167] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:11 2022] GET /identity/v3/projects/76392ff9ad244418a55302f0aa823f92 => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:11.688363 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d6716-8ab5-40d4-9965-8815474caab7 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:11.701938 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:11.716287 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc466a51-7cef-4d13-a6a1-ae454f55ddda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:11.717268 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc466a51-7cef-4d13-a6a1-ae454f55ddda None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:11.717559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc466a51-7cef-4d13-a6a1-ae454f55ddda None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:11.717837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc466a51-7cef-4d13-a6a1-ae454f55ddda None admin] PATH_INFO: `/v3/roles/member` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:11.731104 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc466a51-7cef-4d13-a6a1-ae454f55ddda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:11.739833 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-dc466a51-7cef-4d13-a6a1-ae454f55ddda None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:11.739833 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:11.739833 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:11.739833 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:11.739833 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:11.739833 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:11.739833 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:11.739833 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:11.739833 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:11.739833 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:11.739833 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:11.739833 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:11.739833 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:11.739833 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:11.739833 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:11.739833 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:11.741782 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:11.741782 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:11.741782 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:11.741782 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:11.741782 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:11.741782 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:11.741782 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:11.741782 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:11.741782 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:11.741782 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:11.741782 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:11.741782 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:11.741782 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:11.741782 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:11.741782 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:11.741782 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:11.742827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:11.742827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:11.742827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:11.742827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:11.742827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:11.742827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:11.742827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:11.742827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:11.742827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:11.742827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:11.742827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:11.742827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:11.742827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 80/168] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:11.742827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc466a51-7cef-4d13-a6a1-ae454f55ddda None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:11.825058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:11.858012 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc466a51-7cef-4d13-a6a1-ae454f55ddda None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:11.896603 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335625a0-3a0d-49e9-8410-006ac4134c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:11.897733 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335625a0-3a0d-49e9-8410-006ac4134c54 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:11.898027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335625a0-3a0d-49e9-8410-006ac4134c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:11.898313 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335625a0-3a0d-49e9-8410-006ac4134c54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:11.899171 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335625a0-3a0d-49e9-8410-006ac4134c54 None admin] RBAC: Adding query filter params (role.id=361f7a146e9b47e997cf572bae05c96e, scope.project.id=76392ff9ad244418a55302f0aa823f92, user.id=f1ce8f6287214ffbb9b21e5891234a01) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:11.899925 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335625a0-3a0d-49e9-8410-006ac4134c54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:11.901634 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335625a0-3a0d-49e9-8410-006ac4134c54 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:11.908790 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 81/169] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:18:11 2022] GET /identity/v3/role_assignments?user.id=f1ce8f6287214ffbb9b21e5891234a01&scope.project.id=76392ff9ad244418a55302f0aa823f92&role.id=361f7a146e9b47e997cf572bae05c96e => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:11.909754 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335625a0-3a0d-49e9-8410-006ac4134c54 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:11.981362 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d6716-8ab5-40d4-9965-8815474caab7 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:12.027482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335625a0-3a0d-49e9-8410-006ac4134c54 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:12.063604 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:12.067639 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8f2ea-16ac-462f-9495-898992af94c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:12.068896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8f2ea-16ac-462f-9495-898992af94c2 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:12.069269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8f2ea-16ac-462f-9495-898992af94c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:12.069560 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8f2ea-16ac-462f-9495-898992af94c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:12.070696 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8f2ea-16ac-462f-9495-898992af94c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:12.071121 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8f2ea-16ac-462f-9495-898992af94c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:12.073020 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8f2ea-16ac-462f-9495-898992af94c2 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:12.083679 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 82/170] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 19 15:18:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:12.090014 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8f2ea-16ac-462f-9495-898992af94c2 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:12.100349 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79c679-b082-4b70-8969-8bc12fb660f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:12.101265 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79c679-b082-4b70-8969-8bc12fb660f8 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:12.101553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79c679-b082-4b70-8969-8bc12fb660f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:12.101829 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79c679-b082-4b70-8969-8bc12fb660f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:12.121017 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79c679-b082-4b70-8969-8bc12fb660f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:12.128908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-fd79c679-b082-4b70-8969-8bc12fb660f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:18:12.128908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:12.128908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:12.128908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:12.128908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:12.128908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:12.128908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:12.128908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:12.128908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:12.128908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:12.128908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:12.128908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:12.128908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:12.128908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:12.128908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:12.128908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:12.129778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:12.129778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:12.129778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:12.129778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:12.129778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:12.129778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:12.129778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:12.129778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:12.129778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:12.129778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:12.129778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:12.129778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:12.129778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:12.129778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:12.129778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:12.129778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:12.130557 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:12.130557 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:12.130557 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:12.130557 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:12.130557 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:12.130557 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:12.130557 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:12.130557 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:12.130557 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:12.130557 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:12.130557 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:18:12.130557 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:12.130557 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 89/171] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:18:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 442 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:12.140330 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79c679-b082-4b70-8969-8bc12fb660f8 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:12.204160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8f2ea-16ac-462f-9495-898992af94c2 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:12.241827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53dcb1-5ad1-40d5-8cdc-07ca0778b4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:12.242840 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53dcb1-5ad1-40d5-8cdc-07ca0778b4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:12.243136 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53dcb1-5ad1-40d5-8cdc-07ca0778b4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:12.243460 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53dcb1-5ad1-40d5-8cdc-07ca0778b4e4 None admin] PATH_INFO: `/v3/users/f1ce8f6287214ffbb9b21e5891234a01` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:12.244769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53dcb1-5ad1-40d5-8cdc-07ca0778b4e4 None admin] RBAC: Authorizing `identity:get_user(user_id=f1ce8f6287214ffbb9b21e5891234a01)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:12.246459 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53dcb1-5ad1-40d5-8cdc-07ca0778b4e4 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:12.248480 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 83/172] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:12 2022] GET /identity/v3/users/f1ce8f6287214ffbb9b21e5891234a01 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:12.257427 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53dcb1-5ad1-40d5-8cdc-07ca0778b4e4 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:12.260960 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:12.335551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79c679-b082-4b70-8969-8bc12fb660f8 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:12.381513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:12.405824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e70395-8631-4931-bf0c-d4803cd350bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:12.406517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e70395-8631-4931-bf0c-d4803cd350bc None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:12.406805 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e70395-8631-4931-bf0c-d4803cd350bc None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:12.407085 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e70395-8631-4931-bf0c-d4803cd350bc None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:12.407881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e70395-8631-4931-bf0c-d4803cd350bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:12.408195 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e70395-8631-4931-bf0c-d4803cd350bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:12.409587 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e70395-8631-4931-bf0c-d4803cd350bc None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:12.435796 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 90/173] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:12.441317 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e70395-8631-4931-bf0c-d4803cd350bc None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:12.466958 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53dcb1-5ad1-40d5-8cdc-07ca0778b4e4 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:12.534056 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7c0fe-2817-42e7-9b82-84b329d1fff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:12.534728 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7c0fe-2817-42e7-9b82-84b329d1fff8 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:12.535183 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7c0fe-2817-42e7-9b82-84b329d1fff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:12.535493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7c0fe-2817-42e7-9b82-84b329d1fff8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:12.664641 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e70395-8631-4931-bf0c-d4803cd350bc None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:12.680559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7c0fe-2817-42e7-9b82-84b329d1fff8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:12.682031 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7c0fe-2817-42e7-9b82-84b329d1fff8 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:12.731584 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:12.743988 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebaafe5-7c26-4718-a3d7-490bfd08d196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:12.744888 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebaafe5-7c26-4718-a3d7-490bfd08d196 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:12.745173 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebaafe5-7c26-4718-a3d7-490bfd08d196 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:12.745449 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebaafe5-7c26-4718-a3d7-490bfd08d196 None admin] PATH_INFO: `/v3/users/a5979772c3b54e8bb6dcc49d7d98fa0c` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:12.746745 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebaafe5-7c26-4718-a3d7-490bfd08d196 None admin] RBAC: Authorizing `identity:get_user(user_id=a5979772c3b54e8bb6dcc49d7d98fa0c)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:12.748225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebaafe5-7c26-4718-a3d7-490bfd08d196 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:12.750079 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 91/174] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:12 2022] GET /identity/v3/users/a5979772c3b54e8bb6dcc49d7d98fa0c => generated 247 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:12.755721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebaafe5-7c26-4718-a3d7-490bfd08d196 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:12.842096 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:12.916584 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 84/175] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:18:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 15:18:12.922042 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7c0fe-2817-42e7-9b82-84b329d1fff8 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:12.949019 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebaafe5-7c26-4718-a3d7-490bfd08d196 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:13.029476 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5dc48-b298-4d8a-98f6-6e22aeca1e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:13.030765 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5dc48-b298-4d8a-98f6-6e22aeca1e7c None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:13.031287 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5dc48-b298-4d8a-98f6-6e22aeca1e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:13.031889 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5dc48-b298-4d8a-98f6-6e22aeca1e7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:13.043962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7c0fe-2817-42e7-9b82-84b329d1fff8 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:13.078808 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41374c-6b0f-447a-9790-54f9bb37746c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:13.079853 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41374c-6b0f-447a-9790-54f9bb37746c None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:13.080238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41374c-6b0f-447a-9790-54f9bb37746c None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:13.080610 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41374c-6b0f-447a-9790-54f9bb37746c None admin] PATH_INFO: `/v3/projects/38d2636ff3eb405083c509b300f7ef01` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:13.082006 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41374c-6b0f-447a-9790-54f9bb37746c None admin] RBAC: Authorizing `identity:get_project(project_id=38d2636ff3eb405083c509b300f7ef01)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:13.083626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41374c-6b0f-447a-9790-54f9bb37746c None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:13.086165 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 85/176] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:12 2022] GET /identity/v3/projects/38d2636ff3eb405083c509b300f7ef01 => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:13.087318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6af1c0-968e-4bae-ab04-adaf18b38b1a None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:13.087704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6af1c0-968e-4bae-ab04-adaf18b38b1a None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:13.088113 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6af1c0-968e-4bae-ab04-adaf18b38b1a None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:13.089434 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 86/177] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:13.091522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6af1c0-968e-4bae-ab04-adaf18b38b1a None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:13.123647 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:13.200472 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6af1c0-968e-4bae-ab04-adaf18b38b1a None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:13.204792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:13.216065 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5dc48-b298-4d8a-98f6-6e22aeca1e7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:13.217554 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5dc48-b298-4d8a-98f6-6e22aeca1e7c None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:13.238781 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32fd91b-24dd-4593-bb7a-3ddaf4ef62ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:13.239528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fd91b-24dd-4593-bb7a-3ddaf4ef62ae None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:13.239812 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fd91b-24dd-4593-bb7a-3ddaf4ef62ae None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:13.240092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fd91b-24dd-4593-bb7a-3ddaf4ef62ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:13.241471 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32fd91b-24dd-4593-bb7a-3ddaf4ef62ae None admin] RBAC: Adding query filter params (role.id=ff311e825f2b4a3d809aa772f6cdecb0, scope.project.id=38d2636ff3eb405083c509b300f7ef01, user.id=f1ce8f6287214ffbb9b21e5891234a01) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:13.241789 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32fd91b-24dd-4593-bb7a-3ddaf4ef62ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:13.243335 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32fd91b-24dd-4593-bb7a-3ddaf4ef62ae None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:13.250529 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 87/178] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:18:13 2022] GET /identity/v3/role_assignments?user.id=f1ce8f6287214ffbb9b21e5891234a01&scope.project.id=38d2636ff3eb405083c509b300f7ef01&role.id=ff311e825f2b4a3d809aa772f6cdecb0 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:13.251972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c18b2a-a6cb-4ac6-9488-7bfbb5d23bfc None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:13.252267 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c18b2a-a6cb-4ac6-9488-7bfbb5d23bfc None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:13.252695 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c18b2a-a6cb-4ac6-9488-7bfbb5d23bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:13.273304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-95c18b2a-a6cb-4ac6-9488-7bfbb5d23bfc None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:13.274537 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-95c18b2a-a6cb-4ac6-9488-7bfbb5d23bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:13.349226 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 88/179] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:13.392705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c18b2a-a6cb-4ac6-9488-7bfbb5d23bfc None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:13.455694 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:13.475829 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 92/180] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:18:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 721 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:18:13.482071 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5dc48-b298-4d8a-98f6-6e22aeca1e7c None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:13.600275 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c18b2a-a6cb-4ac6-9488-7bfbb5d23bfc None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:13.638682 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca6786-ce0b-4967-9cd8-ef42ad62d36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:13.639896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca6786-ce0b-4967-9cd8-ef42ad62d36e None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:13.640403 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca6786-ce0b-4967-9cd8-ef42ad62d36e None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:13.640881 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca6786-ce0b-4967-9cd8-ef42ad62d36e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:13.652288 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca6786-ce0b-4967-9cd8-ef42ad62d36e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:13.660854 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-e5ca6786-ce0b-4967-9cd8-ef42ad62d36e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:18:13.660854 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:13.660854 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:13.660854 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:13.660854 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:13.660854 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:13.660854 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:13.660854 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:13.660854 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:13.660854 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:13.660854 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:13.660854 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:13.660854 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:13.660854 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:13.660854 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:13.660854 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:13.661779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:13.661779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:13.661779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:13.661779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:13.661779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:13.661779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:13.661779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:13.661779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:13.661779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:13.661779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:13.661779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:13.661779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:13.661779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:13.661779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:13.661779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:13.661779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:13.663123 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:13.663123 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:13.663123 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:13.663123 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:13.663123 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:13.663123 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:13.663123 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:13.663123 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:13.663123 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:13.663123 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:13.663123 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:18:13.663123 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:13.665591 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 89/181] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:18:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:18:13.672266 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca6786-ce0b-4967-9cd8-ef42ad62d36e None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:13.675573 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:13.678826 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5dc48-b298-4d8a-98f6-6e22aeca1e7c None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:13.721459 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fe9be-8aff-4774-90b5-ee39fd67c2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:13.722551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fe9be-8aff-4774-90b5-ee39fd67c2d2 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:13.723009 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fe9be-8aff-4774-90b5-ee39fd67c2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:13.723546 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fe9be-8aff-4774-90b5-ee39fd67c2d2 None admin] PATH_INFO: `/v3/projects/76392ff9ad244418a55302f0aa823f92` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:13.725536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694fe9be-8aff-4774-90b5-ee39fd67c2d2 None admin] RBAC: Authorizing `identity:get_project(project_id=76392ff9ad244418a55302f0aa823f92)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:13.727129 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694fe9be-8aff-4774-90b5-ee39fd67c2d2 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:13.729452 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 93/182] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:13 2022] GET /identity/v3/projects/76392ff9ad244418a55302f0aa823f92 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:13.730839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d152b-5e85-4257-80d8-fc613bd4351f None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:13.731316 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d152b-5e85-4257-80d8-fc613bd4351f None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:13.731759 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d152b-5e85-4257-80d8-fc613bd4351f None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:13.733197 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 94/183] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:13.740173 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d152b-5e85-4257-80d8-fc613bd4351f None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:13.777504 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:13.798283 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca6786-ce0b-4967-9cd8-ef42ad62d36e None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:13.843932 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb09e7-4f49-4140-af49-dd22ec79cdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:13.844607 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb09e7-4f49-4140-af49-dd22ec79cdee None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:13.844892 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb09e7-4f49-4140-af49-dd22ec79cdee None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:13.845172 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb09e7-4f49-4140-af49-dd22ec79cdee None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:13.845974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb09e7-4f49-4140-af49-dd22ec79cdee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:13.846283 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb09e7-4f49-4140-af49-dd22ec79cdee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:13.847774 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb09e7-4f49-4140-af49-dd22ec79cdee None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:13.857385 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 90/184] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:13.858504 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f72943-f1c7-4896-8a07-e9fa0c5507c8 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:13.858807 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f72943-f1c7-4896-8a07-e9fa0c5507c8 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:13.859130 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f72943-f1c7-4896-8a07-e9fa0c5507c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:13.886690 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-f5f72943-f1c7-4896-8a07-e9fa0c5507c8 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:13.888083 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-f5f72943-f1c7-4896-8a07-e9fa0c5507c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:13.895676 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d152b-5e85-4257-80d8-fc613bd4351f None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:13.956688 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73149d-ac8d-481c-8a2f-5b1aba61a195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:13.957393 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73149d-ac8d-481c-8a2f-5b1aba61a195 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:13.957685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73149d-ac8d-481c-8a2f-5b1aba61a195 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:13.957963 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73149d-ac8d-481c-8a2f-5b1aba61a195 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:13.959304 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73149d-ac8d-481c-8a2f-5b1aba61a195 None admin] RBAC: Adding query filter params (role.id=d884ddf33c1440d9b3a3351b85e83e76, scope.project.id=76392ff9ad244418a55302f0aa823f92, user.id=a5979772c3b54e8bb6dcc49d7d98fa0c) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:13.959627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73149d-ac8d-481c-8a2f-5b1aba61a195 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:13.961738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73149d-ac8d-481c-8a2f-5b1aba61a195 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:13.975456 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 95/185] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:18:13 2022] GET /identity/v3/role_assignments?user.id=a5979772c3b54e8bb6dcc49d7d98fa0c&scope.project.id=76392ff9ad244418a55302f0aa823f92&role.id=d884ddf33c1440d9b3a3351b85e83e76 => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:13.976778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73149d-ac8d-481c-8a2f-5b1aba61a195 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:14.020425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:14.021869 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 91/186] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:14.036341 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c43b5-c486-4b36-ab9d-55945ad20eb2 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:14.036535 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c43b5-c486-4b36-ab9d-55945ad20eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:14.036829 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c43b5-c486-4b36-ab9d-55945ad20eb2 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:14.039233 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 92/187] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:14.045044 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710f774-bb35-4806-9143-ae7dddac6797 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:14.045401 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710f774-bb35-4806-9143-ae7dddac6797 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:14.045780 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710f774-bb35-4806-9143-ae7dddac6797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:14.063868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-5710f774-bb35-4806-9143-ae7dddac6797 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:14.065478 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-5710f774-bb35-4806-9143-ae7dddac6797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:14.104737 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73149d-ac8d-481c-8a2f-5b1aba61a195 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:14.141093 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 93/188] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:18:14.143966 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710f774-bb35-4806-9143-ae7dddac6797 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:14.151041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473f9f9-0a13-4ead-b779-5d472aea896d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:14.152315 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473f9f9-0a13-4ead-b779-5d472aea896d None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:14.152787 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473f9f9-0a13-4ead-b779-5d472aea896d None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:14.153356 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473f9f9-0a13-4ead-b779-5d472aea896d None admin] PATH_INFO: `/v3/users/4b22d35f92d5470c999f72ec2c0a145f` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:14.167638 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:14.176449 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473f9f9-0a13-4ead-b779-5d472aea896d None admin] RBAC: Authorizing `identity:get_user(user_id=4b22d35f92d5470c999f72ec2c0a145f)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:14.178069 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473f9f9-0a13-4ead-b779-5d472aea896d None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:14.184297 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 96/189] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:13 2022] GET /identity/v3/users/4b22d35f92d5470c999f72ec2c0a145f => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:14.184297 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473f9f9-0a13-4ead-b779-5d472aea896d None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:14.282419 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:14.295018 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710f774-bb35-4806-9143-ae7dddac6797 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:14.304649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473f9f9-0a13-4ead-b779-5d472aea896d None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:14.341114 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6b4e2-87b4-49c1-a919-bf004e3e15c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:14.341998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6b4e2-87b4-49c1-a919-bf004e3e15c1 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:14.342286 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6b4e2-87b4-49c1-a919-bf004e3e15c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:14.342566 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6b4e2-87b4-49c1-a919-bf004e3e15c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:14.346365 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f3898-48bb-4403-bad4-152220560c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:14.347162 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f3898-48bb-4403-bad4-152220560c6b None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:14.347478 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f3898-48bb-4403-bad4-152220560c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:14.347759 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f3898-48bb-4403-bad4-152220560c6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:14.349031 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f3898-48bb-4403-bad4-152220560c6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:14.350502 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f3898-48bb-4403-bad4-152220560c6b None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:14.352150 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 97/190] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:18:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:14.352906 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f3898-48bb-4403-bad4-152220560c6b None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:14.354268 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6b4e2-87b4-49c1-a919-bf004e3e15c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:14.363469 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-cce6b4e2-87b4-49c1-a919-bf004e3e15c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:18:14.363469 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:14.363469 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:14.363469 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:14.363469 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:14.363469 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:14.363469 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:14.363469 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:14.363469 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:14.363469 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:14.363469 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:14.363469 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:14.363469 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:14.363469 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:14.363469 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:14.363469 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:14.364493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:14.364493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:14.364493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:14.364493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:14.364493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:14.364493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:14.364493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:14.364493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:14.364493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:14.364493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:14.364493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:14.364493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:14.364493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:14.364493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:14.364493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:14.364493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:14.365318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:14.365318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:14.365318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:14.365318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:14.365318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:14.365318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:14.365318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:14.365318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:14.365318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:14.365318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:14.365318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:18:14.365318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:14.365318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 94/191] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 19 15:18:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:14.365971 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6b4e2-87b4-49c1-a919-bf004e3e15c1 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:14.437632 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:14.463071 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f3898-48bb-4403-bad4-152220560c6b None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:14.473518 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6b4e2-87b4-49c1-a919-bf004e3e15c1 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:14.496880 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1cb78-0301-4bda-b0b2-75e3af90f42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:14.497539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1cb78-0301-4bda-b0b2-75e3af90f42b None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:14.497825 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1cb78-0301-4bda-b0b2-75e3af90f42b None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:14.498106 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1cb78-0301-4bda-b0b2-75e3af90f42b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:14.512144 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f2a2b-2bb8-4c4c-985d-437182eeaf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:14.512805 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f2a2b-2bb8-4c4c-985d-437182eeaf49 None admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:14.513085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f2a2b-2bb8-4c4c-985d-437182eeaf49 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:14.513387 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f2a2b-2bb8-4c4c-985d-437182eeaf49 None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:14.514092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78f2a2b-2bb8-4c4c-985d-437182eeaf49 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:14.515553 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78f2a2b-2bb8-4c4c-985d-437182eeaf49 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:14.524477 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:14.535010 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 95/192] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jul 19 15:18:14 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:18:14.536433 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625534a2-fc4c-483b-b53d-324a8ad4fc0a None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:14.536720 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625534a2-fc4c-483b-b53d-324a8ad4fc0a None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:14.537021 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625534a2-fc4c-483b-b53d-324a8ad4fc0a None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:14.542548 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 96/193] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:14.542548 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625534a2-fc4c-483b-b53d-324a8ad4fc0a None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:14.576818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1cb78-0301-4bda-b0b2-75e3af90f42b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:14.578307 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1cb78-0301-4bda-b0b2-75e3af90f42b None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:14.671403 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625534a2-fc4c-483b-b53d-324a8ad4fc0a None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:14.695938 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 98/194] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:18:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:18:14.697135 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6bcfa-d777-4453-8205-1b83aae7a644 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:14.697438 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6bcfa-d777-4453-8205-1b83aae7a644 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:14.697724 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6bcfa-d777-4453-8205-1b83aae7a644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:14.705415 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:14.719204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-22e6bcfa-d777-4453-8205-1b83aae7a644 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:14.720456 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-22e6bcfa-d777-4453-8205-1b83aae7a644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:14.722716 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe96fc9-07d4-4f24-af1d-9655103b8567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:14.723422 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe96fc9-07d4-4f24-af1d-9655103b8567 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:14.723712 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe96fc9-07d4-4f24-af1d-9655103b8567 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:14.723992 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe96fc9-07d4-4f24-af1d-9655103b8567 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:14.724989 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe96fc9-07d4-4f24-af1d-9655103b8567 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:14.725287 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe96fc9-07d4-4f24-af1d-9655103b8567 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:14.727758 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe96fc9-07d4-4f24-af1d-9655103b8567 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:14.738525 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 97/195] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:18:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:14.740762 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe96fc9-07d4-4f24-af1d-9655103b8567 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:14.785647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:14.808958 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 99/196] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:14.809974 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6bcfa-d777-4453-8205-1b83aae7a644 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:14.879102 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe96fc9-07d4-4f24-af1d-9655103b8567 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:14.920463 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88677c-0405-47fa-b5a6-21d5ada586d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:14.921332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88677c-0405-47fa-b5a6-21d5ada586d3 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:14.921610 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88677c-0405-47fa-b5a6-21d5ada586d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:14.921884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88677c-0405-47fa-b5a6-21d5ada586d3 None admin] PATH_INFO: `/v3/projects/057eacfe69e5438fae88b82be96b147a` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:14.923086 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88677c-0405-47fa-b5a6-21d5ada586d3 None admin] RBAC: Authorizing `identity:get_project(project_id=057eacfe69e5438fae88b82be96b147a)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:14.924596 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88677c-0405-47fa-b5a6-21d5ada586d3 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:14.926519 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 98/197] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:14 2022] GET /identity/v3/projects/057eacfe69e5438fae88b82be96b147a => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:14.929712 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88677c-0405-47fa-b5a6-21d5ada586d3 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:14.938977 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6bcfa-d777-4453-8205-1b83aae7a644 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:14.979568 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b67c8-965c-44f0-aba7-071308a42ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:14.980833 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b67c8-965c-44f0-aba7-071308a42ecc None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:14.981272 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b67c8-965c-44f0-aba7-071308a42ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:14.981784 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b67c8-965c-44f0-aba7-071308a42ecc None admin] PATH_INFO: `/v3/users/4b22d35f92d5470c999f72ec2c0a145f` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:14.983179 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b67c8-965c-44f0-aba7-071308a42ecc None admin] RBAC: Authorizing `identity:get_user(user_id=4b22d35f92d5470c999f72ec2c0a145f)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:14.985043 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b67c8-965c-44f0-aba7-071308a42ecc None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:14.986833 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 100/198] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:14 2022] GET /identity/v3/users/4b22d35f92d5470c999f72ec2c0a145f => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:14.987744 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b67c8-965c-44f0-aba7-071308a42ecc None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:14.993469 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:15.060197 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:15.060607 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88677c-0405-47fa-b5a6-21d5ada586d3 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:15.111098 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318200c-0037-4b93-b1fc-e8c2edd1fc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:15.111943 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b67c8-965c-44f0-aba7-071308a42ecc None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:15.112330 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318200c-0037-4b93-b1fc-e8c2edd1fc0b None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:15.112755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318200c-0037-4b93-b1fc-e8c2edd1fc0b None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:15.113198 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318200c-0037-4b93-b1fc-e8c2edd1fc0b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:15.128829 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318200c-0037-4b93-b1fc-e8c2edd1fc0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:15.137262 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-4318200c-0037-4b93-b1fc-e8c2edd1fc0b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:18:15.137262 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:15.137262 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:15.137262 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:15.137262 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:15.137262 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:15.137262 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:15.137262 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:15.137262 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:15.137262 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:15.137262 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:15.137262 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:15.137262 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:15.137262 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:15.137262 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:15.137262 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:15.138161 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:15.138161 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:15.138161 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:15.138161 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:15.138161 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:15.138161 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:15.138161 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:15.138161 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:15.138161 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:15.138161 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:15.138161 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:15.138161 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:15.138161 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:15.138161 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:15.138161 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:15.138161 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:15.138940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:15.138940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:15.138940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:15.138940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:15.138940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:15.138940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:15.138940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:15.138940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:15.138940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:15.138940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:15.138940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:18:15.138940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:15.138940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 99/199] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:15.139638 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318200c-0037-4b93-b1fc-e8c2edd1fc0b None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:15.159511 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37aa005-941f-41d7-8fe6-b79e33ebca7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:15.160911 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37aa005-941f-41d7-8fe6-b79e33ebca7b None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:15.161424 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37aa005-941f-41d7-8fe6-b79e33ebca7b None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:15.161907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37aa005-941f-41d7-8fe6-b79e33ebca7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:15.163026 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37aa005-941f-41d7-8fe6-b79e33ebca7b None admin] RBAC: Adding query filter params (role.id=d884ddf33c1440d9b3a3351b85e83e76, scope.project.id=057eacfe69e5438fae88b82be96b147a, user.id=4b22d35f92d5470c999f72ec2c0a145f) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:15.164169 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37aa005-941f-41d7-8fe6-b79e33ebca7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:15.166122 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37aa005-941f-41d7-8fe6-b79e33ebca7b None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:15.174633 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 101/200] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:18:14 2022] GET /identity/v3/role_assignments?user.id=4b22d35f92d5470c999f72ec2c0a145f&scope.project.id=057eacfe69e5438fae88b82be96b147a&role.id=d884ddf33c1440d9b3a3351b85e83e76 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:15.175513 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37aa005-941f-41d7-8fe6-b79e33ebca7b None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:15.275619 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318200c-0037-4b93-b1fc-e8c2edd1fc0b None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:15.291027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:15.306782 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37aa005-941f-41d7-8fe6-b79e33ebca7b None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:15.328190 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072941f2-b6ed-44e2-90c3-a3e535d4c808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:15.328894 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072941f2-b6ed-44e2-90c3-a3e535d4c808 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:15.329253 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072941f2-b6ed-44e2-90c3-a3e535d4c808 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:15.329618 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072941f2-b6ed-44e2-90c3-a3e535d4c808 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:15.330996 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:15.356612 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe9472-25e4-4abd-854a-6727b43eedce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:15.359320 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe9472-25e4-4abd-854a-6727b43eedce None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:15.360034 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe9472-25e4-4abd-854a-6727b43eedce None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:15.361622 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe9472-25e4-4abd-854a-6727b43eedce None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:15.362700 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe9472-25e4-4abd-854a-6727b43eedce None admin] RBAC: Adding query filter params (name=reader) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:15.365916 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe9472-25e4-4abd-854a-6727b43eedce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:15.369366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe9472-25e4-4abd-854a-6727b43eedce None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:15.388075 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 102/201] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 19 15:18:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:15.393903 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe9472-25e4-4abd-854a-6727b43eedce None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:15.485404 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072941f2-b6ed-44e2-90c3-a3e535d4c808 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:15.486940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072941f2-b6ed-44e2-90c3-a3e535d4c808 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:15.538599 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe9472-25e4-4abd-854a-6727b43eedce None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:15.590089 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a1f95-9896-45d1-990f-2ecd7f7e0c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:15.591958 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a1f95-9896-45d1-990f-2ecd7f7e0c87 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:15.592388 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a1f95-9896-45d1-990f-2ecd7f7e0c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:15.592979 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a1f95-9896-45d1-990f-2ecd7f7e0c87 None admin] PATH_INFO: `/v3/users/3448de74ec1e47b0b635069c80c935f6` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:15.595815 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a1f95-9896-45d1-990f-2ecd7f7e0c87 None admin] RBAC: Authorizing `identity:get_user(user_id=3448de74ec1e47b0b635069c80c935f6)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:15.598204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a1f95-9896-45d1-990f-2ecd7f7e0c87 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:15.601158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 103/202] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:15 2022] GET /identity/v3/users/3448de74ec1e47b0b635069c80c935f6 => generated 289 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:15.611435 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a1f95-9896-45d1-990f-2ecd7f7e0c87 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:15.660175 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 100/203] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:18:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:18:15.667321 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072941f2-b6ed-44e2-90c3-a3e535d4c808 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:15.694820 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:15.762772 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:15.779751 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072941f2-b6ed-44e2-90c3-a3e535d4c808 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:15.816655 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff3af3-7d8f-47c8-b1bd-8e1405a92430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:15.817622 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff3af3-7d8f-47c8-b1bd-8e1405a92430 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:15.817915 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff3af3-7d8f-47c8-b1bd-8e1405a92430 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:15.818708 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff3af3-7d8f-47c8-b1bd-8e1405a92430 None admin] PATH_INFO: `/v3/projects/057eacfe69e5438fae88b82be96b147a` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:15.828132 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff3af3-7d8f-47c8-b1bd-8e1405a92430 None admin] RBAC: Authorizing `identity:get_project(project_id=057eacfe69e5438fae88b82be96b147a)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:15.829810 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff3af3-7d8f-47c8-b1bd-8e1405a92430 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:15.832062 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 101/204] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:15 2022] GET /identity/v3/projects/057eacfe69e5438fae88b82be96b147a => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:15.838249 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff3af3-7d8f-47c8-b1bd-8e1405a92430 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:15.841293 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a1f95-9896-45d1-990f-2ecd7f7e0c87 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:15.896059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25167f-abf8-4d94-aa3c-a012c2e5c8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:15.896801 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25167f-abf8-4d94-aa3c-a012c2e5c8bf None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:15.897091 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25167f-abf8-4d94-aa3c-a012c2e5c8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:15.897373 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25167f-abf8-4d94-aa3c-a012c2e5c8bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:15.943980 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:15.966960 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff3af3-7d8f-47c8-b1bd-8e1405a92430 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:16.003102 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b6915-5c87-46d6-92e6-d3f0603fe1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:16.003896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b6915-5c87-46d6-92e6-d3f0603fe1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:16.004189 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b6915-5c87-46d6-92e6-d3f0603fe1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:16.004470 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b6915-5c87-46d6-92e6-d3f0603fe1e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:16.005311 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b6915-5c87-46d6-92e6-d3f0603fe1e1 None admin] RBAC: Adding query filter params (role.id=361f7a146e9b47e997cf572bae05c96e, scope.project.id=057eacfe69e5438fae88b82be96b147a, user.id=4b22d35f92d5470c999f72ec2c0a145f) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:16.005786 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b6915-5c87-46d6-92e6-d3f0603fe1e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:16.008084 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b6915-5c87-46d6-92e6-d3f0603fe1e1 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:16.014037 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 102/205] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:18:15 2022] GET /identity/v3/role_assignments?user.id=4b22d35f92d5470c999f72ec2c0a145f&scope.project.id=057eacfe69e5438fae88b82be96b147a&role.id=361f7a146e9b47e997cf572bae05c96e => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:16.026434 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25167f-abf8-4d94-aa3c-a012c2e5c8bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:16.027985 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25167f-abf8-4d94-aa3c-a012c2e5c8bf None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:16.102199 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:16.159115 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 104/206] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:18:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 15:18:16.165460 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b6915-5c87-46d6-92e6-d3f0603fe1e1 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:16.305761 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b6915-5c87-46d6-92e6-d3f0603fe1e1 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:16.351255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09de63-24d0-44b7-96b1-13509097103c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:16.352143 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09de63-24d0-44b7-96b1-13509097103c None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:16.352484 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09de63-24d0-44b7-96b1-13509097103c None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:16.352718 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09de63-24d0-44b7-96b1-13509097103c None admin] PATH_INFO: `/v3/projects/76392ff9ad244418a55302f0aa823f92` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:16.353948 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09de63-24d0-44b7-96b1-13509097103c None admin] RBAC: Authorizing `identity:get_project(project_id=76392ff9ad244418a55302f0aa823f92)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:16.355425 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09de63-24d0-44b7-96b1-13509097103c None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:16.357354 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 103/207] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:16 2022] GET /identity/v3/projects/76392ff9ad244418a55302f0aa823f92 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:16.363466 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25167f-abf8-4d94-aa3c-a012c2e5c8bf None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:16.494939 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25167f-abf8-4d94-aa3c-a012c2e5c8bf None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:16.534093 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2a809-bcf5-4278-90eb-434e4c690cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:16.534770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2a809-bcf5-4278-90eb-434e4c690cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:16.535060 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2a809-bcf5-4278-90eb-434e4c690cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:16.535374 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2a809-bcf5-4278-90eb-434e4c690cb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:16.536232 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2a809-bcf5-4278-90eb-434e4c690cb4 None admin] RBAC: Adding query filter params (role.id=d528f237588f49489344fe727d4662e5, scope.project.id=76392ff9ad244418a55302f0aa823f92, user.id=3448de74ec1e47b0b635069c80c935f6) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:16.536554 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2a809-bcf5-4278-90eb-434e4c690cb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:16.538514 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2a809-bcf5-4278-90eb-434e4c690cb4 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:16.545051 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 105/208] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:18:16 2022] GET /identity/v3/role_assignments?user.id=3448de74ec1e47b0b635069c80c935f6&scope.project.id=76392ff9ad244418a55302f0aa823f92&role.id=d528f237588f49489344fe727d4662e5 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:17.021164 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf6575-67aa-4868-b5a1-cab034d5e39a None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:17.022445 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf6575-67aa-4868-b5a1-cab034d5e39a None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:17.022445 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf6575-67aa-4868-b5a1-cab034d5e39a None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:17.023681 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 104/209] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:17.029146 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d6c5f-4cf4-44fa-ad11-06abb3d1f8b6 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:17.029443 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d6c5f-4cf4-44fa-ad11-06abb3d1f8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:17.029730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d6c5f-4cf4-44fa-ad11-06abb3d1f8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:17.052814 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-d01d6c5f-4cf4-44fa-ad11-06abb3d1f8b6 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:17.054003 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-d01d6c5f-4cf4-44fa-ad11-06abb3d1f8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:17.061713 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:17.095260 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d435c7-9534-4dae-a032-fd355c9d5744 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:17.095260 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d435c7-9534-4dae-a032-fd355c9d5744 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:17.095260 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d435c7-9534-4dae-a032-fd355c9d5744 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:17.095260 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 105/210] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:17.101804 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a1664-d472-4928-84a2-2c174b139818 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:17.102326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a1664-d472-4928-84a2-2c174b139818 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:17.102808 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a1664-d472-4928-84a2-2c174b139818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:17.121909 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-843a1664-d472-4928-84a2-2c174b139818 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:17.123624 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-843a1664-d472-4928-84a2-2c174b139818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:17.133778 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:17.152343 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 106/211] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:17.177310 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d6c5f-4cf4-44fa-ad11-06abb3d1f8b6 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:17.204621 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 106/212] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:17.232205 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a1664-d472-4928-84a2-2c174b139818 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:17.290997 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d6c5f-4cf4-44fa-ad11-06abb3d1f8b6 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:17.327947 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f5fe6-7f21-43ec-9c38-e926789378d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:17.328870 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f5fe6-7f21-43ec-9c38-e926789378d3 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:17.329160 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f5fe6-7f21-43ec-9c38-e926789378d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:17.329441 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f5fe6-7f21-43ec-9c38-e926789378d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:17.341500 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f5fe6-7f21-43ec-9c38-e926789378d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:17.349913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-5b1f5fe6-7f21-43ec-9c38-e926789378d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:17.349913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:17.349913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:17.349913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:17.349913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:17.349913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:17.349913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:17.349913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:17.349913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:17.349913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:17.349913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:17.349913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:17.349913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:17.349913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:17.349913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:17.349913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:17.350811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:17.350811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:17.350811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:17.350811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:17.350811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:17.350811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:17.350811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:17.350811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:17.350811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:17.350811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:17.350811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:17.350811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:17.350811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:17.350811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:17.350811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:17.350811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:17.351991 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:17.351991 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:17.351991 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:17.351991 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:17.351991 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:17.351991 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:17.351991 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:17.351991 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:17.351991 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:17.351991 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:17.351991 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:17.351991 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:17.351991 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 107/213] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:18:17.353007 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a1664-d472-4928-84a2-2c174b139818 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:17.358142 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f5fe6-7f21-43ec-9c38-e926789378d3 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:17.360985 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:17.396156 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b8f68-7ff0-4234-a7b1-c130918ba49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:17.397505 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b8f68-7ff0-4234-a7b1-c130918ba49d None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:17.397793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b8f68-7ff0-4234-a7b1-c130918ba49d None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:17.398465 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b8f68-7ff0-4234-a7b1-c130918ba49d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:17.399936 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b8f68-7ff0-4234-a7b1-c130918ba49d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:17.401468 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b8f68-7ff0-4234-a7b1-c130918ba49d None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:17.403297 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 107/214] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:18:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:17.409455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b8f68-7ff0-4234-a7b1-c130918ba49d None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:17.423089 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:17.474680 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f5fe6-7f21-43ec-9c38-e926789378d3 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:17.510806 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc86090-19c6-41d6-bd7a-25dfe4ea3b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:17.511538 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc86090-19c6-41d6-bd7a-25dfe4ea3b53 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:17.511896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc86090-19c6-41d6-bd7a-25dfe4ea3b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:17.512182 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc86090-19c6-41d6-bd7a-25dfe4ea3b53 None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:17.512933 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc86090-19c6-41d6-bd7a-25dfe4ea3b53 None admin] RBAC: Adding query filter params (name=member) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:17.513243 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc86090-19c6-41d6-bd7a-25dfe4ea3b53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:17.514808 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc86090-19c6-41d6-bd7a-25dfe4ea3b53 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:17.517656 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b8f68-7ff0-4234-a7b1-c130918ba49d None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:17.523944 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 108/215] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 19 15:18:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:17.529417 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc86090-19c6-41d6-bd7a-25dfe4ea3b53 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:17.555331 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b6386-c3fa-4721-bb51-d9a07067ab4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:17.556058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b6386-c3fa-4721-bb51-d9a07067ab4e None admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:17.556398 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b6386-c3fa-4721-bb51-d9a07067ab4e None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:17.556675 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b6386-c3fa-4721-bb51-d9a07067ab4e None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:17.557539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b6386-c3fa-4721-bb51-d9a07067ab4e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:17.559142 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b6386-c3fa-4721-bb51-d9a07067ab4e None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:17.587535 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 108/216] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jul 19 15:18:17 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:18:17.597469 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:17.641138 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc86090-19c6-41d6-bd7a-25dfe4ea3b53 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:17.680157 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759d8cd-d3a5-4732-9ab5-e4a73f186536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:17.680972 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759d8cd-d3a5-4732-9ab5-e4a73f186536 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:17.681261 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759d8cd-d3a5-4732-9ab5-e4a73f186536 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:17.681546 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759d8cd-d3a5-4732-9ab5-e4a73f186536 None admin] PATH_INFO: `/v3/users/c558e62140b647c1b2de2b9e398ebcf7` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:17.696491 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759d8cd-d3a5-4732-9ab5-e4a73f186536 None admin] RBAC: Authorizing `identity:get_user(user_id=c558e62140b647c1b2de2b9e398ebcf7)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:17.697988 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759d8cd-d3a5-4732-9ab5-e4a73f186536 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:17.700057 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 109/217] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:17 2022] GET /identity/v3/users/c558e62140b647c1b2de2b9e398ebcf7 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:17.705532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b6386-c3fa-4721-bb51-d9a07067ab4e None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:17.790923 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:17.799800 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7d125-8c1f-4272-a396-71e23063848c None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:17.799800 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7d125-8c1f-4272-a396-71e23063848c None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:17.800151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7d125-8c1f-4272-a396-71e23063848c None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:17.802411 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 110/218] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:18:17.806699 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31fa58-5880-4b48-9b1d-9814ccd8ce47 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:17.807039 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31fa58-5880-4b48-9b1d-9814ccd8ce47 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:17.807308 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31fa58-5880-4b48-9b1d-9814ccd8ce47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:17.831265 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-ee31fa58-5880-4b48-9b1d-9814ccd8ce47 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:17.832471 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-ee31fa58-5880-4b48-9b1d-9814ccd8ce47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:17.836373 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b6386-c3fa-4721-bb51-d9a07067ab4e None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:17.881988 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f4645-d208-4585-a282-db89f325d346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:17.883110 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f4645-d208-4585-a282-db89f325d346 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:17.883793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f4645-d208-4585-a282-db89f325d346 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:17.884083 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f4645-d208-4585-a282-db89f325d346 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:17.935524 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 111/219] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:17.959839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31fa58-5880-4b48-9b1d-9814ccd8ce47 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:17.987502 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f4645-d208-4585-a282-db89f325d346 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:17.989198 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f4645-d208-4585-a282-db89f325d346 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:18.029532 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:18.087056 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:18.108673 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31fa58-5880-4b48-9b1d-9814ccd8ce47 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:18.143951 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 109/220] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:18:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:18:18.149918 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f4645-d208-4585-a282-db89f325d346 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:18.150448 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd026b8-4f49-4a13-a8a9-3029a417e3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:18.151298 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd026b8-4f49-4a13-a8a9-3029a417e3d6 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:18.151586 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd026b8-4f49-4a13-a8a9-3029a417e3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:18.151861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd026b8-4f49-4a13-a8a9-3029a417e3d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:18.163594 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd026b8-4f49-4a13-a8a9-3029a417e3d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:18.171386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-6dd026b8-4f49-4a13-a8a9-3029a417e3d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:18:18.171386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:18.171386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:18.171386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:18.171386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:18.171386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:18.171386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:18.171386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:18.171386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:18.171386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:18.171386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:18.171386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:18.171386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:18.171386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:18.171386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:18.171386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:18.172309 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:18.172309 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:18.172309 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:18.172309 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:18.172309 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:18.172309 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:18.172309 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:18.172309 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:18.172309 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:18.172309 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:18.172309 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:18.172309 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:18.172309 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:18.172309 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:18.172309 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:18.172309 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:18.178530 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:18.178530 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:18.178530 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:18.178530 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:18.178530 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:18.178530 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:18.178530 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:18.178530 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:18.178530 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:18.178530 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:18.178530 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:18:18.178530 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:18.178530 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 112/221] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:18:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:18:18.179191 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd026b8-4f49-4a13-a8a9-3029a417e3d6 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:18.292786 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd026b8-4f49-4a13-a8a9-3029a417e3d6 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:18.306904 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:18.325472 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f4645-d208-4585-a282-db89f325d346 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:18.331786 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b9238-7345-4358-bc37-28310d4224a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:18.331786 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b9238-7345-4358-bc37-28310d4224a6 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:18.331786 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b9238-7345-4358-bc37-28310d4224a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:18.331786 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b9238-7345-4358-bc37-28310d4224a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:18.332831 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b9238-7345-4358-bc37-28310d4224a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:18.333151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b9238-7345-4358-bc37-28310d4224a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:18.335248 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b9238-7345-4358-bc37-28310d4224a6 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:18.344659 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 113/222] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:18.352289 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b9238-7345-4358-bc37-28310d4224a6 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:18.413900 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad5414-07a0-4262-8861-10487bfb8023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:18.415001 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad5414-07a0-4262-8861-10487bfb8023 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:18.415382 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad5414-07a0-4262-8861-10487bfb8023 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:18.415673 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad5414-07a0-4262-8861-10487bfb8023 None admin] PATH_INFO: `/v3/projects/057eacfe69e5438fae88b82be96b147a` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:18.416912 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad5414-07a0-4262-8861-10487bfb8023 None admin] RBAC: Authorizing `identity:get_project(project_id=057eacfe69e5438fae88b82be96b147a)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:18.418829 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad5414-07a0-4262-8861-10487bfb8023 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:18.420975 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 110/223] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:18 2022] GET /identity/v3/projects/057eacfe69e5438fae88b82be96b147a => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:18.422478 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b9a5e-827c-4870-9aa6-d5a372b0d1fa None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:18.422775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b9a5e-827c-4870-9aa6-d5a372b0d1fa None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:18.423132 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b9a5e-827c-4870-9aa6-d5a372b0d1fa None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:18.424670 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 111/224] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:18.429931 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b9a5e-827c-4870-9aa6-d5a372b0d1fa None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:18.480930 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:18.507020 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b9238-7345-4358-bc37-28310d4224a6 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:18.557608 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2b33b-a541-46c1-bc98-0c48ea52555d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:18.559408 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2b33b-a541-46c1-bc98-0c48ea52555d None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:18.559845 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2b33b-a541-46c1-bc98-0c48ea52555d None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:18.560532 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2b33b-a541-46c1-bc98-0c48ea52555d None admin] PATH_INFO: `/v3/users/4b22d35f92d5470c999f72ec2c0a145f` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:18.562724 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2b33b-a541-46c1-bc98-0c48ea52555d None admin] RBAC: Authorizing `identity:get_user(user_id=4b22d35f92d5470c999f72ec2c0a145f)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:18.564862 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2b33b-a541-46c1-bc98-0c48ea52555d None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:18.567473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 114/225] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:18 2022] GET /identity/v3/users/4b22d35f92d5470c999f72ec2c0a145f => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:18.569058 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69453e30-5ba7-4cdf-b01e-bad0c3ecbdf4 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:18.569504 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69453e30-5ba7-4cdf-b01e-bad0c3ecbdf4 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:18.569914 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69453e30-5ba7-4cdf-b01e-bad0c3ecbdf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:18.575667 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b9a5e-827c-4870-9aa6-d5a372b0d1fa None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:18.590671 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-69453e30-5ba7-4cdf-b01e-bad0c3ecbdf4 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:18.592616 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-69453e30-5ba7-4cdf-b01e-bad0c3ecbdf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:18.613596 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b5ea0-2629-4f52-a6f4-c62cd48dc1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:18.614438 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b5ea0-2629-4f52-a6f4-c62cd48dc1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:18.614826 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b5ea0-2629-4f52-a6f4-c62cd48dc1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:18.615830 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b5ea0-2629-4f52-a6f4-c62cd48dc1c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:18.616785 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b5ea0-2629-4f52-a6f4-c62cd48dc1c5 None admin] RBAC: Adding query filter params (role.id=ff311e825f2b4a3d809aa772f6cdecb0, scope.project.id=057eacfe69e5438fae88b82be96b147a, user.id=c558e62140b647c1b2de2b9e398ebcf7) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:18.617254 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b5ea0-2629-4f52-a6f4-c62cd48dc1c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:18.618998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b5ea0-2629-4f52-a6f4-c62cd48dc1c5 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:18.626146 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 112/226] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:18:18 2022] GET /identity/v3/role_assignments?user.id=c558e62140b647c1b2de2b9e398ebcf7&scope.project.id=057eacfe69e5438fae88b82be96b147a&role.id=ff311e825f2b4a3d809aa772f6cdecb0 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:18.627137 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b5ea0-2629-4f52-a6f4-c62cd48dc1c5 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:18.651648 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:18.710068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 115/227] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:18.776554 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69453e30-5ba7-4cdf-b01e-bad0c3ecbdf4 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:18.824140 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b5ea0-2629-4f52-a6f4-c62cd48dc1c5 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:18.826957 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:18.892813 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db5739-7818-4424-81e5-7a7266f04f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:18.893678 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db5739-7818-4424-81e5-7a7266f04f05 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:18.894126 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db5739-7818-4424-81e5-7a7266f04f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:18.894547 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db5739-7818-4424-81e5-7a7266f04f05 None admin] PATH_INFO: `/v3/projects/057eacfe69e5438fae88b82be96b147a` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:18.896040 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db5739-7818-4424-81e5-7a7266f04f05 None admin] RBAC: Authorizing `identity:get_project(project_id=057eacfe69e5438fae88b82be96b147a)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:18.897767 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db5739-7818-4424-81e5-7a7266f04f05 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:18.899965 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 113/228] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:18 2022] GET /identity/v3/projects/057eacfe69e5438fae88b82be96b147a => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:18.909845 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db5739-7818-4424-81e5-7a7266f04f05 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:18.966084 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69453e30-5ba7-4cdf-b01e-bad0c3ecbdf4 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:19.040463 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e97b4-adc4-478b-9b21-95250400ca20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:19.041657 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e97b4-adc4-478b-9b21-95250400ca20 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:19.042167 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e97b4-adc4-478b-9b21-95250400ca20 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:19.042645 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e97b4-adc4-478b-9b21-95250400ca20 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:19.066811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e97b4-adc4-478b-9b21-95250400ca20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:19.080937 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db5739-7818-4424-81e5-7a7266f04f05 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:19.085433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-f17e97b4-adc4-478b-9b21-95250400ca20 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:18:19.085433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:19.085433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:19.085433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:19.085433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:19.085433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:19.085433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:19.085433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:19.085433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:19.085433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:19.085433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:19.085433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:19.085433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:19.085433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:19.085433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:19.085433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:19.086327 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:19.086327 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:19.086327 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:19.086327 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:19.086327 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:19.086327 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:19.086327 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:19.086327 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:19.086327 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:19.086327 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:19.086327 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:19.086327 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:19.086327 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:19.086327 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:19.086327 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:19.086327 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:19.087107 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:19.087107 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:19.087107 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:19.087107 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:19.087107 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:19.087107 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:19.087107 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:19.087107 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:19.087107 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:19.087107 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:19.087107 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:18:19.087107 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:19.094187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 116/229] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 19 15:18:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:19.100386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e97b4-adc4-478b-9b21-95250400ca20 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:19.134048 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259feb0-d80c-4c74-a222-a34531fc938f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:19.135170 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259feb0-d80c-4c74-a222-a34531fc938f None admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:19.136704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259feb0-d80c-4c74-a222-a34531fc938f None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:19.136996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259feb0-d80c-4c74-a222-a34531fc938f None admin] PATH_INFO: `/v3/projects/057eacfe69e5438fae88b82be96b147a/users/4b22d35f92d5470c999f72ec2c0a145f/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:19.142050 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259feb0-d80c-4c74-a222-a34531fc938f None admin] RBAC: Authorizing `identity:create_grant(project_id=057eacfe69e5438fae88b82be96b147a, user_id=4b22d35f92d5470c999f72ec2c0a145f, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:19.144310 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259feb0-d80c-4c74-a222-a34531fc938f None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:19.169604 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:19.176936 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 114/230] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 19 15:18:18 2022] PUT /identity/v3/projects/057eacfe69e5438fae88b82be96b147a/users/4b22d35f92d5470c999f72ec2c0a145f/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:18:19.238871 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e97b4-adc4-478b-9b21-95250400ca20 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:19.290505 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05012fb-d7a6-4d45-a176-044621981857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:19.291205 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05012fb-d7a6-4d45-a176-044621981857 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:19.291519 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05012fb-d7a6-4d45-a176-044621981857 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:19.291811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05012fb-d7a6-4d45-a176-044621981857 None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:19.292590 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05012fb-d7a6-4d45-a176-044621981857 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:19.292910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05012fb-d7a6-4d45-a176-044621981857 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:19.294332 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05012fb-d7a6-4d45-a176-044621981857 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:19.308088 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 117/231] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:18:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:19.314863 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259feb0-d80c-4c74-a222-a34531fc938f None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:19.369985 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:19.476091 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259feb0-d80c-4c74-a222-a34531fc938f None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:19.521568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72906a-cdc8-416e-bd97-593b4a916af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:19.522792 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72906a-cdc8-416e-bd97-593b4a916af7 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:19.523398 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72906a-cdc8-416e-bd97-593b4a916af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:19.523876 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72906a-cdc8-416e-bd97-593b4a916af7 None admin] PATH_INFO: `/v3/users/4b22d35f92d5470c999f72ec2c0a145f` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:19.525306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72906a-cdc8-416e-bd97-593b4a916af7 None admin] RBAC: Authorizing `identity:get_user(user_id=4b22d35f92d5470c999f72ec2c0a145f)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:19.526944 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72906a-cdc8-416e-bd97-593b4a916af7 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:19.529185 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 115/232] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:19 2022] GET /identity/v3/users/4b22d35f92d5470c999f72ec2c0a145f => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:19.534679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05012fb-d7a6-4d45-a176-044621981857 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:19.653298 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:19.661708 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05012fb-d7a6-4d45-a176-044621981857 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:19.713057 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e733b-da80-4dda-9b5b-2c84979176b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:19.713987 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e733b-da80-4dda-9b5b-2c84979176b7 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:19.714328 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e733b-da80-4dda-9b5b-2c84979176b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:19.714616 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e733b-da80-4dda-9b5b-2c84979176b7 None admin] PATH_INFO: `/v3/projects/057eacfe69e5438fae88b82be96b147a` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:19.716017 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e733b-da80-4dda-9b5b-2c84979176b7 None admin] RBAC: Authorizing `identity:get_project(project_id=057eacfe69e5438fae88b82be96b147a)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:19.717496 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e733b-da80-4dda-9b5b-2c84979176b7 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:19.719334 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 118/233] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:19 2022] GET /identity/v3/projects/057eacfe69e5438fae88b82be96b147a => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:19.725181 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72906a-cdc8-416e-bd97-593b4a916af7 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:19.879616 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:19.885617 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72906a-cdc8-416e-bd97-593b4a916af7 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:19.921265 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f131b-9e8a-47e3-aac5-f0b44c3297cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:19.922142 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f131b-9e8a-47e3-aac5-f0b44c3297cd None admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:19.922481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f131b-9e8a-47e3-aac5-f0b44c3297cd None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:19.922771 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f131b-9e8a-47e3-aac5-f0b44c3297cd None admin] PATH_INFO: `/v3/projects/057eacfe69e5438fae88b82be96b147a/users/4b22d35f92d5470c999f72ec2c0a145f/roles/361f7a146e9b47e997cf572bae05c96e` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:19.925131 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f131b-9e8a-47e3-aac5-f0b44c3297cd None admin] RBAC: Authorizing `identity:create_grant(project_id=057eacfe69e5438fae88b82be96b147a, user_id=4b22d35f92d5470c999f72ec2c0a145f, role_id=361f7a146e9b47e997cf572bae05c96e)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:19.926596 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f131b-9e8a-47e3-aac5-f0b44c3297cd None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:19.953630 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 116/234] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 19 15:18:19 2022] PUT /identity/v3/projects/057eacfe69e5438fae88b82be96b147a/users/4b22d35f92d5470c999f72ec2c0a145f/roles/361f7a146e9b47e997cf572bae05c96e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:18:20.218624 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60047ce-12d1-4cd1-94c5-f38a3bf630f5 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:20.218957 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60047ce-12d1-4cd1-94c5-f38a3bf630f5 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:20.219130 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60047ce-12d1-4cd1-94c5-f38a3bf630f5 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:20.221006 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 119/235] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:20.226527 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7f1fa-bb7b-4edc-9b4d-796b4874855d None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:20.227000 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7f1fa-bb7b-4edc-9b4d-796b4874855d None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:20.227078 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7f1fa-bb7b-4edc-9b4d-796b4874855d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:20.245552 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-80a7f1fa-bb7b-4edc-9b4d-796b4874855d None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:20.246745 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-80a7f1fa-bb7b-4edc-9b4d-796b4874855d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:20.261735 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ba99b-1112-41c1-9dbf-e8bc21d3f990 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:20.262033 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ba99b-1112-41c1-9dbf-e8bc21d3f990 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:20.262315 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ba99b-1112-41c1-9dbf-e8bc21d3f990 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:20.263728 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 120/236] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:20.269332 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da14d67-2a9f-4931-b5a2-034704cae912 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:20.269836 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da14d67-2a9f-4931-b5a2-034704cae912 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:20.270351 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da14d67-2a9f-4931-b5a2-034704cae912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:20.292870 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-8da14d67-2a9f-4931-b5a2-034704cae912 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:20.294412 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-8da14d67-2a9f-4931-b5a2-034704cae912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:20.334731 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 117/237] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:20.358171 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7f1fa-bb7b-4edc-9b4d-796b4874855d None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:20.375601 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 121/238] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:18:20.439187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da14d67-2a9f-4931-b5a2-034704cae912 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:20.472235 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:20.488961 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7f1fa-bb7b-4edc-9b4d-796b4874855d None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:20.528965 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca8de5-c6a3-49bd-9c7e-59263d8d2894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:20.531031 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca8de5-c6a3-49bd-9c7e-59263d8d2894 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:20.534162 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca8de5-c6a3-49bd-9c7e-59263d8d2894 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:20.534588 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca8de5-c6a3-49bd-9c7e-59263d8d2894 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:20.552278 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca8de5-c6a3-49bd-9c7e-59263d8d2894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:20.564487 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-d9ca8de5-c6a3-49bd-9c7e-59263d8d2894 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:18:20.564487 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:20.564487 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:20.564487 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:20.564487 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:20.564487 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:20.564487 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:20.564487 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:20.564487 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:20.564487 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:20.564487 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:20.564487 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:20.564487 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:20.564487 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:20.564487 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:20.564487 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:20.565571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:20.565571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:20.565571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:20.565571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:20.565571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:20.565571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:20.565571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:20.565571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:20.565571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:20.565571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:20.565571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:20.565571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:20.565571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:20.565571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:20.565571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:20.565571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:20.566557 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:20.566557 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:20.566557 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:20.566557 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:20.566557 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:20.566557 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:20.566557 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:20.566557 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:20.566557 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:20.566557 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:20.566557 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:18:20.566557 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:20.584396 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 118/239] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:20.585610 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca8de5-c6a3-49bd-9c7e-59263d8d2894 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:20.612354 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:20.623095 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da14d67-2a9f-4931-b5a2-034704cae912 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:20.662401 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d7fbe-ae94-4c19-a668-35dac188a94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:20.664139 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d7fbe-ae94-4c19-a668-35dac188a94a None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:20.664599 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d7fbe-ae94-4c19-a668-35dac188a94a None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:20.665015 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d7fbe-ae94-4c19-a668-35dac188a94a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:20.666380 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d7fbe-ae94-4c19-a668-35dac188a94a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:20.668149 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d7fbe-ae94-4c19-a668-35dac188a94a None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:20.670226 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 122/240] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:18:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:20.676473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d7fbe-ae94-4c19-a668-35dac188a94a None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:20.777834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca8de5-c6a3-49bd-9c7e-59263d8d2894 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:20.827875 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58ff48-878c-4e09-818e-53fc45d73f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:20.828831 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58ff48-878c-4e09-818e-53fc45d73f54 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:20.829274 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58ff48-878c-4e09-818e-53fc45d73f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:20.829695 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58ff48-878c-4e09-818e-53fc45d73f54 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:20.830602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58ff48-878c-4e09-818e-53fc45d73f54 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:20.831308 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58ff48-878c-4e09-818e-53fc45d73f54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:20.835067 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58ff48-878c-4e09-818e-53fc45d73f54 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:20.859389 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 119/241] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 19 15:18:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:20.863912 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58ff48-878c-4e09-818e-53fc45d73f54 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:20.874231 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d7fbe-ae94-4c19-a668-35dac188a94a None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:20.887879 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:20.948406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274fd6e-01ff-44d5-bb11-4d452b11ab2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:20.949102 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274fd6e-01ff-44d5-bb11-4d452b11ab2c None admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:20.949389 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274fd6e-01ff-44d5-bb11-4d452b11ab2c None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:20.949673 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274fd6e-01ff-44d5-bb11-4d452b11ab2c None admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:20.950409 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274fd6e-01ff-44d5-bb11-4d452b11ab2c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:20.951877 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274fd6e-01ff-44d5-bb11-4d452b11ab2c None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:20.994036 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 123/242] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jul 19 15:18:20 2022] POST /identity/v3/users => generated 293 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:18:21.045365 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58ff48-878c-4e09-818e-53fc45d73f54 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:21.076792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d55d4d-64de-44f0-a99d-ebbc0e15ae99 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:21.077124 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d55d4d-64de-44f0-a99d-ebbc0e15ae99 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:21.077366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d55d4d-64de-44f0-a99d-ebbc0e15ae99 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:21.078769 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 124/243] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:21.089732 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39e61b-a91d-4cad-b297-c64d4c63459b None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:21.090012 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39e61b-a91d-4cad-b297-c64d4c63459b None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:21.090325 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39e61b-a91d-4cad-b297-c64d4c63459b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:21.103647 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dce5fc-42f4-46f8-8fc6-c2aee3d7e511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:21.104561 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dce5fc-42f4-46f8-8fc6-c2aee3d7e511 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:21.104849 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dce5fc-42f4-46f8-8fc6-c2aee3d7e511 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:21.105130 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dce5fc-42f4-46f8-8fc6-c2aee3d7e511 None admin] PATH_INFO: `/v3/users/987002535d944f029530840dc99c9294` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:21.114787 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-1a39e61b-a91d-4cad-b297-c64d4c63459b None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:21.116113 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-1a39e61b-a91d-4cad-b297-c64d4c63459b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:21.136546 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dce5fc-42f4-46f8-8fc6-c2aee3d7e511 None admin] RBAC: Authorizing `identity:get_user(user_id=987002535d944f029530840dc99c9294)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:21.138088 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dce5fc-42f4-46f8-8fc6-c2aee3d7e511 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:21.139640 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:21.139968 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 120/244] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:20 2022] GET /identity/v3/users/987002535d944f029530840dc99c9294 => generated 297 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:21.148565 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dce5fc-42f4-46f8-8fc6-c2aee3d7e511 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:21.237373 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 125/245] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:18:21.248235 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:21.261135 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39e61b-a91d-4cad-b297-c64d4c63459b None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:21.297154 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dce5fc-42f4-46f8-8fc6-c2aee3d7e511 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:21.339897 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2a8b9-73fa-430b-93d9-2de31f852dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:21.340564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2a8b9-73fa-430b-93d9-2de31f852dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:21.340848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2a8b9-73fa-430b-93d9-2de31f852dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:21.341125 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2a8b9-73fa-430b-93d9-2de31f852dc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:21.403650 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39e61b-a91d-4cad-b297-c64d4c63459b None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:21.430914 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc2a8b9-73fa-430b-93d9-2de31f852dc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:21.433100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc2a8b9-73fa-430b-93d9-2de31f852dc5 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:21.448270 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74949cdd-3b7b-410c-9dfd-ae87a439fc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:21.449088 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74949cdd-3b7b-410c-9dfd-ae87a439fc60 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:21.449380 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74949cdd-3b7b-410c-9dfd-ae87a439fc60 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:21.449663 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74949cdd-3b7b-410c-9dfd-ae87a439fc60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:21.464226 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74949cdd-3b7b-410c-9dfd-ae87a439fc60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:21.472780 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-74949cdd-3b7b-410c-9dfd-ae87a439fc60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:21.472780 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:21.472780 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:21.472780 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:21.472780 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:21.472780 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:21.472780 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:21.472780 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:21.472780 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:21.472780 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:21.472780 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:21.472780 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:21.472780 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:21.472780 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:21.472780 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:21.472780 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:21.473881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:21.473881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:21.473881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:21.473881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:21.473881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:21.473881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:21.473881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:21.473881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:21.473881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:21.473881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:21.473881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:21.473881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:21.473881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:21.473881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:21.473881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:21.473881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:21.475486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:21.475486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:21.475486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:21.475486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:21.475486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:21.475486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:21.475486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:21.475486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:21.475486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:21.475486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:21.475486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:21.475486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:21.475486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 126/246] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:18:21.480100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74949cdd-3b7b-410c-9dfd-ae87a439fc60 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:21.494339 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:21.534437 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:21.577781 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 121/247] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:18:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 15:18:21.584441 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2a8b9-73fa-430b-93d9-2de31f852dc5 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:21.648515 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74949cdd-3b7b-410c-9dfd-ae87a439fc60 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:21.691325 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd50d5d-db34-44d6-ae56-d408fae981dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:21.692681 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd50d5d-db34-44d6-ae56-d408fae981dc None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:21.693212 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd50d5d-db34-44d6-ae56-d408fae981dc None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:21.693638 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd50d5d-db34-44d6-ae56-d408fae981dc None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:21.695052 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd50d5d-db34-44d6-ae56-d408fae981dc None admin] RBAC: Adding query filter params (name=member) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:21.695556 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd50d5d-db34-44d6-ae56-d408fae981dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:21.697821 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd50d5d-db34-44d6-ae56-d408fae981dc None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:21.707967 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 127/248] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 19 15:18:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:21.713577 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd50d5d-db34-44d6-ae56-d408fae981dc None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:21.750196 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2a8b9-73fa-430b-93d9-2de31f852dc5 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:21.791919 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:21.831719 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd50d5d-db34-44d6-ae56-d408fae981dc None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:21.857459 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edebd9-1772-41a6-8164-e195534a265e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:21.858555 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edebd9-1772-41a6-8164-e195534a265e None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:21.859023 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edebd9-1772-41a6-8164-e195534a265e None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:21.859511 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edebd9-1772-41a6-8164-e195534a265e None admin] PATH_INFO: `/v3/projects/057eacfe69e5438fae88b82be96b147a` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:21.864615 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edebd9-1772-41a6-8164-e195534a265e None admin] RBAC: Authorizing `identity:get_project(project_id=057eacfe69e5438fae88b82be96b147a)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:21.866358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edebd9-1772-41a6-8164-e195534a265e None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:21.868344 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 122/249] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:21 2022] GET /identity/v3/projects/057eacfe69e5438fae88b82be96b147a => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:21.871257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424f9e0-9237-4cb2-a683-7cb2218a7543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:21.871257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424f9e0-9237-4cb2-a683-7cb2218a7543 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:21.871257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424f9e0-9237-4cb2-a683-7cb2218a7543 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:21.871257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424f9e0-9237-4cb2-a683-7cb2218a7543 None admin] PATH_INFO: `/v3/users/c558e62140b647c1b2de2b9e398ebcf7` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:21.876135 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424f9e0-9237-4cb2-a683-7cb2218a7543 None admin] RBAC: Authorizing `identity:get_user(user_id=c558e62140b647c1b2de2b9e398ebcf7)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:21.876714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edebd9-1772-41a6-8164-e195534a265e None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:21.877544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424f9e0-9237-4cb2-a683-7cb2218a7543 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:21.879388 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 128/250] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:21 2022] GET /identity/v3/users/c558e62140b647c1b2de2b9e398ebcf7 => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:21.888291 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424f9e0-9237-4cb2-a683-7cb2218a7543 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:22.000622 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:22.033095 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424f9e0-9237-4cb2-a683-7cb2218a7543 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:22.075791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb7b5b-baf3-4367-8804-da41efa09353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:22.077007 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb7b5b-baf3-4367-8804-da41efa09353 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:22.077471 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb7b5b-baf3-4367-8804-da41efa09353 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:22.077926 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb7b5b-baf3-4367-8804-da41efa09353 None admin] PATH_INFO: `/v3/projects/057eacfe69e5438fae88b82be96b147a` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:22.080411 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb7b5b-baf3-4367-8804-da41efa09353 None admin] RBAC: Authorizing `identity:get_project(project_id=057eacfe69e5438fae88b82be96b147a)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:22.082099 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb7b5b-baf3-4367-8804-da41efa09353 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:22.087340 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 129/251] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:21 2022] GET /identity/v3/projects/057eacfe69e5438fae88b82be96b147a => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:22.089594 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fe93a-d2d8-4870-9eb9-72b9cfc45285 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:22.091558 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fe93a-d2d8-4870-9eb9-72b9cfc45285 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:22.093057 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fe93a-d2d8-4870-9eb9-72b9cfc45285 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:22.095442 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 130/252] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:22.097822 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2fe93a-d2d8-4870-9eb9-72b9cfc45285 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:22.115782 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:22.154298 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edebd9-1772-41a6-8164-e195534a265e None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:22.194949 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fca6f9-8247-4f2c-b3c1-763d5481c0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:22.195876 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fca6f9-8247-4f2c-b3c1-763d5481c0c4 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:22.200691 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fca6f9-8247-4f2c-b3c1-763d5481c0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:22.201200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fca6f9-8247-4f2c-b3c1-763d5481c0c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:22.202228 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fca6f9-8247-4f2c-b3c1-763d5481c0c4 None admin] RBAC: Adding query filter params (role.id=d528f237588f49489344fe727d4662e5, scope.project.id=057eacfe69e5438fae88b82be96b147a, user.id=987002535d944f029530840dc99c9294) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:22.202695 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fca6f9-8247-4f2c-b3c1-763d5481c0c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:22.204395 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fca6f9-8247-4f2c-b3c1-763d5481c0c4 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:22.220585 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 123/253] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:18:21 2022] GET /identity/v3/role_assignments?user.id=987002535d944f029530840dc99c9294&scope.project.id=057eacfe69e5438fae88b82be96b147a&role.id=d528f237588f49489344fe727d4662e5 => generated 259 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:22.222282 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d9ff0-ccb8-48a6-a504-4ac05b94d101 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:22.223621 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d9ff0-ccb8-48a6-a504-4ac05b94d101 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:22.224087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d9ff0-ccb8-48a6-a504-4ac05b94d101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:22.257552 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-309d9ff0-ccb8-48a6-a504-4ac05b94d101 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:22.260813 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-309d9ff0-ccb8-48a6-a504-4ac05b94d101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:22.342926 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 124/254] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:22.367145 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d9ff0-ccb8-48a6-a504-4ac05b94d101 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:22.372024 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2fe93a-d2d8-4870-9eb9-72b9cfc45285 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:22.404455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:22.479969 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742dbd5-beeb-4836-ba85-1e2bcc69a7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:22.480897 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742dbd5-beeb-4836-ba85-1e2bcc69a7cb None admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:22.481185 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742dbd5-beeb-4836-ba85-1e2bcc69a7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:22.481467 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742dbd5-beeb-4836-ba85-1e2bcc69a7cb None admin] PATH_INFO: `/v3/projects/057eacfe69e5438fae88b82be96b147a/users/c558e62140b647c1b2de2b9e398ebcf7/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:22.482062 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d9ff0-ccb8-48a6-a504-4ac05b94d101 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:22.484211 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a742dbd5-beeb-4836-ba85-1e2bcc69a7cb None admin] RBAC: Authorizing `identity:create_grant(project_id=057eacfe69e5438fae88b82be96b147a, user_id=c558e62140b647c1b2de2b9e398ebcf7, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:22.486092 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a742dbd5-beeb-4836-ba85-1e2bcc69a7cb None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:22.513882 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 131/255] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 19 15:18:22 2022] PUT /identity/v3/projects/057eacfe69e5438fae88b82be96b147a/users/c558e62140b647c1b2de2b9e398ebcf7/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:18:22.524070 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc469a1-d55f-4ddc-aa93-e57790bebc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:22.525197 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc469a1-d55f-4ddc-aa93-e57790bebc83 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:22.525631 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc469a1-d55f-4ddc-aa93-e57790bebc83 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:22.526131 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc469a1-d55f-4ddc-aa93-e57790bebc83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:22.540328 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc469a1-d55f-4ddc-aa93-e57790bebc83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:22.548667 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-ecc469a1-d55f-4ddc-aa93-e57790bebc83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:18:22.548667 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:22.548667 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:22.548667 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:22.548667 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:22.548667 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:22.548667 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:22.548667 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:22.548667 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:22.548667 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:22.548667 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:22.548667 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:22.548667 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:22.548667 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:22.548667 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:22.548667 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:22.549801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:22.549801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:22.549801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:22.549801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:22.549801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:22.549801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:22.549801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:22.549801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:22.549801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:22.549801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:22.549801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:22.549801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:22.549801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:22.549801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:22.549801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:22.549801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:22.550779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:22.550779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:22.550779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:22.550779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:22.550779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:22.550779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:22.550779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:22.550779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:22.550779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:22.550779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:22.550779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:18:22.550779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:22.553544 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 125/256] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:18:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:18:22.559757 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742dbd5-beeb-4836-ba85-1e2bcc69a7cb None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:22.635469 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:22.679382 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742dbd5-beeb-4836-ba85-1e2bcc69a7cb None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:22.716825 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f53bcc-b135-4c2f-af7b-74e3c37ecdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:22.718238 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f53bcc-b135-4c2f-af7b-74e3c37ecdcd None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:22.718735 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f53bcc-b135-4c2f-af7b-74e3c37ecdcd None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:22.719154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f53bcc-b135-4c2f-af7b-74e3c37ecdcd None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:22.720079 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f53bcc-b135-4c2f-af7b-74e3c37ecdcd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:22.720534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f53bcc-b135-4c2f-af7b-74e3c37ecdcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:22.722043 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f53bcc-b135-4c2f-af7b-74e3c37ecdcd None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:22.732050 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 132/257] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:22.737951 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc469a1-d55f-4ddc-aa93-e57790bebc83 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:22.837711 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:22.854499 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9705b1-47ec-432a-85b1-be2f52b5f589 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:22.854808 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9705b1-47ec-432a-85b1-be2f52b5f589 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:22.855064 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9705b1-47ec-432a-85b1-be2f52b5f589 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:22.856803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 133/258] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:22.863159 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c379b-3016-417b-a724-7e06cfd75dd4 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:22.863486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c379b-3016-417b-a724-7e06cfd75dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:22.863770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c379b-3016-417b-a724-7e06cfd75dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:22.864668 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc469a1-d55f-4ddc-aa93-e57790bebc83 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:22.897678 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-d01c379b-3016-417b-a724-7e06cfd75dd4 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:22.899244 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-d01c379b-3016-417b-a724-7e06cfd75dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:22.923032 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69512e-5ed7-43fa-9b2b-9a4a59b655c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:22.924509 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69512e-5ed7-43fa-9b2b-9a4a59b655c5 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:22.924805 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69512e-5ed7-43fa-9b2b-9a4a59b655c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:22.925097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69512e-5ed7-43fa-9b2b-9a4a59b655c5 None admin] PATH_INFO: `/v3/users/4b22d35f92d5470c999f72ec2c0a145f` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:22.927851 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69512e-5ed7-43fa-9b2b-9a4a59b655c5 None admin] RBAC: Authorizing `identity:get_user(user_id=4b22d35f92d5470c999f72ec2c0a145f)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:22.929696 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69512e-5ed7-43fa-9b2b-9a4a59b655c5 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:22.932298 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 126/259] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:22 2022] GET /identity/v3/users/4b22d35f92d5470c999f72ec2c0a145f => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:22.937426 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69512e-5ed7-43fa-9b2b-9a4a59b655c5 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:22.996182 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 134/260] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:23.032069 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c379b-3016-417b-a724-7e06cfd75dd4 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:23.114413 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69512e-5ed7-43fa-9b2b-9a4a59b655c5 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:23.132341 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:23.175518 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfa80b-6e5d-42ad-9444-0cacab6a688c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:23.176186 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfa80b-6e5d-42ad-9444-0cacab6a688c None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:23.176556 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfa80b-6e5d-42ad-9444-0cacab6a688c None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:23.176956 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfa80b-6e5d-42ad-9444-0cacab6a688c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:23.225606 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c379b-3016-417b-a724-7e06cfd75dd4 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:23.227958 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:23.303700 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345575f7-6441-4e33-972e-e720fe0125b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:23.304520 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345575f7-6441-4e33-972e-e720fe0125b0 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:23.304812 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345575f7-6441-4e33-972e-e720fe0125b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:23.305092 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345575f7-6441-4e33-972e-e720fe0125b0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:23.311196 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dfa80b-6e5d-42ad-9444-0cacab6a688c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:23.313088 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dfa80b-6e5d-42ad-9444-0cacab6a688c None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:23.334421 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345575f7-6441-4e33-972e-e720fe0125b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:23.347791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-345575f7-6441-4e33-972e-e720fe0125b0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:18:23.347791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:23.347791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:23.347791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:23.347791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:23.347791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:23.347791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:23.347791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:23.347791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:23.347791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:23.347791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:23.347791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:23.347791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:23.347791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:23.347791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:23.347791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:23.348795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:23.348795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:23.348795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:23.348795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:23.348795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:23.348795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:23.348795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:23.348795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:23.348795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:23.348795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:23.348795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:23.348795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:23.348795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:23.348795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:23.348795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:23.348795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:23.349639 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:23.349639 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:23.349639 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:23.349639 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:23.349639 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:23.349639 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:23.349639 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:23.349639 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:23.349639 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:23.349639 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:23.349639 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:18:23.349639 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:23.349639 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 135/261] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 19 15:18:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:23.356541 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345575f7-6441-4e33-972e-e720fe0125b0 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:23.502426 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 127/262] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:18:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 15:18:23.508505 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfa80b-6e5d-42ad-9444-0cacab6a688c None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:23.609288 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:23.621411 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345575f7-6441-4e33-972e-e720fe0125b0 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:23.660981 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:23.695305 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfa80b-6e5d-42ad-9444-0cacab6a688c None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:23.725544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadbce9-7481-4cdd-8d5a-da84d2240da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:23.726294 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadbce9-7481-4cdd-8d5a-da84d2240da6 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:23.726592 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadbce9-7481-4cdd-8d5a-da84d2240da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:23.726876 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadbce9-7481-4cdd-8d5a-da84d2240da6 None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:23.727690 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cadbce9-7481-4cdd-8d5a-da84d2240da6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:23.728004 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cadbce9-7481-4cdd-8d5a-da84d2240da6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:23.729399 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cadbce9-7481-4cdd-8d5a-da84d2240da6 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:23.746948 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 136/263] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:18:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:23.753302 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadbce9-7481-4cdd-8d5a-da84d2240da6 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:23.764143 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9aae5-fe39-48c6-bd18-be4678abc97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:23.765354 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9aae5-fe39-48c6-bd18-be4678abc97f None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:23.765835 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9aae5-fe39-48c6-bd18-be4678abc97f None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:23.766307 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9aae5-fe39-48c6-bd18-be4678abc97f None admin] PATH_INFO: `/v3/projects/057eacfe69e5438fae88b82be96b147a` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:23.767751 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9aae5-fe39-48c6-bd18-be4678abc97f None admin] RBAC: Authorizing `identity:get_project(project_id=057eacfe69e5438fae88b82be96b147a)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:23.769422 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9aae5-fe39-48c6-bd18-be4678abc97f None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:23.772399 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 128/264] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:23 2022] GET /identity/v3/projects/057eacfe69e5438fae88b82be96b147a => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:23.778884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9aae5-fe39-48c6-bd18-be4678abc97f None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:23.898806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9aae5-fe39-48c6-bd18-be4678abc97f None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:23.924853 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:23.938459 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c02488-c42c-4d2f-921b-247f2053cc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:23.939507 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c02488-c42c-4d2f-921b-247f2053cc12 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:23.939999 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c02488-c42c-4d2f-921b-247f2053cc12 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:23.940496 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c02488-c42c-4d2f-921b-247f2053cc12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:23.941556 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c02488-c42c-4d2f-921b-247f2053cc12 None admin] RBAC: Adding query filter params (role.id=d884ddf33c1440d9b3a3351b85e83e76, scope.project.id=057eacfe69e5438fae88b82be96b147a, user.id=4b22d35f92d5470c999f72ec2c0a145f) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:23.942071 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c02488-c42c-4d2f-921b-247f2053cc12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:23.944348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c02488-c42c-4d2f-921b-247f2053cc12 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:23.955595 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 129/265] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:18:23 2022] GET /identity/v3/role_assignments?user.id=4b22d35f92d5470c999f72ec2c0a145f&scope.project.id=057eacfe69e5438fae88b82be96b147a&role.id=d884ddf33c1440d9b3a3351b85e83e76 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:24.014162 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadbce9-7481-4cdd-8d5a-da84d2240da6 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:24.071748 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70d55a-2adf-4f4c-b989-53f232150eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:24.072652 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70d55a-2adf-4f4c-b989-53f232150eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:24.072944 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70d55a-2adf-4f4c-b989-53f232150eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:24.073219 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70d55a-2adf-4f4c-b989-53f232150eb3 None admin] PATH_INFO: `/v3/users/4b22d35f92d5470c999f72ec2c0a145f` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:24.074487 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70d55a-2adf-4f4c-b989-53f232150eb3 None admin] RBAC: Authorizing `identity:get_user(user_id=4b22d35f92d5470c999f72ec2c0a145f)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:24.075988 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70d55a-2adf-4f4c-b989-53f232150eb3 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:24.077679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 137/266] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:23 2022] GET /identity/v3/users/4b22d35f92d5470c999f72ec2c0a145f => generated 283 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:24.083546 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c02488-c42c-4d2f-921b-247f2053cc12 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:24.211475 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c02488-c42c-4d2f-921b-247f2053cc12 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:24.247923 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8d2cf-8aee-4222-8a53-67248f379d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:24.248957 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8d2cf-8aee-4222-8a53-67248f379d67 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:24.249449 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8d2cf-8aee-4222-8a53-67248f379d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:24.249920 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8d2cf-8aee-4222-8a53-67248f379d67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:24.254848 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f8356-95e1-4493-988c-b02c3f10dbf4 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:24.255531 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f8356-95e1-4493-988c-b02c3f10dbf4 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:24.256058 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f8356-95e1-4493-988c-b02c3f10dbf4 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:24.258943 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 138/267] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:24.264104 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff2199-a684-44e6-9a5c-f5f0219d2078 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:24.264712 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff2199-a684-44e6-9a5c-f5f0219d2078 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:24.265252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff2199-a684-44e6-9a5c-f5f0219d2078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:24.308392 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-e1ff2199-a684-44e6-9a5c-f5f0219d2078 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:24.309939 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-e1ff2199-a684-44e6-9a5c-f5f0219d2078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:24.315718 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:24.328478 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8d2cf-8aee-4222-8a53-67248f379d67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:24.330667 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8d2cf-8aee-4222-8a53-67248f379d67 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:24.420060 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:24.444343 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 130/268] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:18:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:18:24.450350 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8d2cf-8aee-4222-8a53-67248f379d67 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:24.461913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 139/269] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:24.516459 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff2199-a684-44e6-9a5c-f5f0219d2078 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:24.552065 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:24.563024 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8d2cf-8aee-4222-8a53-67248f379d67 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:24.600780 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263b4dd-1a5f-4028-8b3c-ee87368e6113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:24.601958 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263b4dd-1a5f-4028-8b3c-ee87368e6113 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:24.602378 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263b4dd-1a5f-4028-8b3c-ee87368e6113 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:24.602797 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263b4dd-1a5f-4028-8b3c-ee87368e6113 None admin] PATH_INFO: `/v3/projects/057eacfe69e5438fae88b82be96b147a` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:24.604228 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263b4dd-1a5f-4028-8b3c-ee87368e6113 None admin] RBAC: Authorizing `identity:get_project(project_id=057eacfe69e5438fae88b82be96b147a)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:24.605803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263b4dd-1a5f-4028-8b3c-ee87368e6113 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:24.608018 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 131/270] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:24 2022] GET /identity/v3/projects/057eacfe69e5438fae88b82be96b147a => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:24.613995 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e363cf-0915-41ae-82b5-2e82bb2a7f5e None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:24.614543 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e363cf-0915-41ae-82b5-2e82bb2a7f5e None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:24.615652 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e363cf-0915-41ae-82b5-2e82bb2a7f5e None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:24.617104 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 132/271] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:24.618014 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e363cf-0915-41ae-82b5-2e82bb2a7f5e None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:24.634528 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff2199-a684-44e6-9a5c-f5f0219d2078 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:24.669877 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e45698-0936-44d6-b348-d19ee1d662fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:24.670682 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e45698-0936-44d6-b348-d19ee1d662fb None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:24.670966 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e45698-0936-44d6-b348-d19ee1d662fb None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:24.671257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e45698-0936-44d6-b348-d19ee1d662fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:24.672436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e45698-0936-44d6-b348-d19ee1d662fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:24.673933 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e45698-0936-44d6-b348-d19ee1d662fb None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:24.680697 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 140/272] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:18:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:24.680697 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab405b7d-3be0-4896-84de-3ae2134d687c None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:24.680697 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab405b7d-3be0-4896-84de-3ae2134d687c None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:24.680697 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab405b7d-3be0-4896-84de-3ae2134d687c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:24.694959 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-ab405b7d-3be0-4896-84de-3ae2134d687c None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:24.696398 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-ab405b7d-3be0-4896-84de-3ae2134d687c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:24.743690 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:24.764124 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e363cf-0915-41ae-82b5-2e82bb2a7f5e None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:24.772508 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 141/273] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:24.779513 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab405b7d-3be0-4896-84de-3ae2134d687c None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:24.821292 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fccbd1-767c-46f0-ac58-117df33c5223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:24.822609 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fccbd1-767c-46f0-ac58-117df33c5223 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:24.823255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fccbd1-767c-46f0-ac58-117df33c5223 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:24.823923 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fccbd1-767c-46f0-ac58-117df33c5223 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:24.825638 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fccbd1-767c-46f0-ac58-117df33c5223 None admin] RBAC: Adding query filter params (role.id=361f7a146e9b47e997cf572bae05c96e, scope.project.id=057eacfe69e5438fae88b82be96b147a, user.id=4b22d35f92d5470c999f72ec2c0a145f) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:24.826166 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fccbd1-767c-46f0-ac58-117df33c5223 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:24.827846 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fccbd1-767c-46f0-ac58-117df33c5223 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:24.835542 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 133/274] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:18:24 2022] GET /identity/v3/role_assignments?user.id=4b22d35f92d5470c999f72ec2c0a145f&scope.project.id=057eacfe69e5438fae88b82be96b147a&role.id=361f7a146e9b47e997cf572bae05c96e => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:24.836584 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fccbd1-767c-46f0-ac58-117df33c5223 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:24.860945 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:24.912508 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab405b7d-3be0-4896-84de-3ae2134d687c None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:24.952974 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d288059-fe61-43d6-9081-c6b595400ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:24.953819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d288059-fe61-43d6-9081-c6b595400ba9 None admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:24.954205 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d288059-fe61-43d6-9081-c6b595400ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:24.954587 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d288059-fe61-43d6-9081-c6b595400ba9 None admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:24.955460 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d288059-fe61-43d6-9081-c6b595400ba9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:24.956647 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fccbd1-767c-46f0-ac58-117df33c5223 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:24.957208 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d288059-fe61-43d6-9081-c6b595400ba9 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:24.987529 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 142/275] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jul 19 15:18:24 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:18:24.996972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf090b74-5c28-41e8-88a7-d3091be01df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:24.998073 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf090b74-5c28-41e8-88a7-d3091be01df3 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:24.998503 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf090b74-5c28-41e8-88a7-d3091be01df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:24.998920 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf090b74-5c28-41e8-88a7-d3091be01df3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:25.012656 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf090b74-5c28-41e8-88a7-d3091be01df3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:25.020783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-bf090b74-5c28-41e8-88a7-d3091be01df3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:25.020783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:25.020783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:25.020783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:25.020783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:25.020783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:25.020783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:25.020783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:25.020783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:25.020783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:25.020783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:25.020783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:25.020783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:25.020783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:25.020783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:25.020783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:25.021917 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:25.021917 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:25.021917 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:25.021917 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:25.021917 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:25.021917 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:25.021917 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:25.021917 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:25.021917 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:25.021917 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:25.021917 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:25.021917 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:25.021917 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:25.021917 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:25.021917 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:25.021917 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:25.022890 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:25.022890 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:25.022890 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:25.022890 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:25.022890 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:25.022890 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:25.022890 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:25.022890 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:25.022890 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:25.022890 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:25.022890 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:25.022890 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:25.025346 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 134/276] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:25.036496 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d288059-fe61-43d6-9081-c6b595400ba9 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:25.086495 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:25.178040 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d288059-fe61-43d6-9081-c6b595400ba9 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:25.214595 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76ee02-e9ef-4c24-b93a-142b08389b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:25.215307 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76ee02-e9ef-4c24-b93a-142b08389b41 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:25.215598 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76ee02-e9ef-4c24-b93a-142b08389b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:25.215882 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76ee02-e9ef-4c24-b93a-142b08389b41 None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:25.216664 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76ee02-e9ef-4c24-b93a-142b08389b41 None admin] RBAC: Adding query filter params (name=member) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:25.216956 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76ee02-e9ef-4c24-b93a-142b08389b41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:25.218391 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76ee02-e9ef-4c24-b93a-142b08389b41 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:25.231341 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 143/277] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 19 15:18:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:25.233367 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf090b74-5c28-41e8-88a7-d3091be01df3 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:25.324079 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:25.348120 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf090b74-5c28-41e8-88a7-d3091be01df3 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:25.385882 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af66bb-d853-440a-b220-1e1e9f2c6de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:25.386772 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af66bb-d853-440a-b220-1e1e9f2c6de8 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:25.387053 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af66bb-d853-440a-b220-1e1e9f2c6de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:25.387359 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af66bb-d853-440a-b220-1e1e9f2c6de8 None admin] PATH_INFO: `/v3/users/0ecd03674d244216923b05f9613ab9be` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:25.401846 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af66bb-d853-440a-b220-1e1e9f2c6de8 None admin] RBAC: Authorizing `identity:get_user(user_id=0ecd03674d244216923b05f9613ab9be)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:25.403364 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af66bb-d853-440a-b220-1e1e9f2c6de8 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:25.406577 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 135/278] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:25 2022] GET /identity/v3/users/0ecd03674d244216923b05f9613ab9be => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:25.411562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76ee02-e9ef-4c24-b93a-142b08389b41 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:25.414590 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939e9f5-4520-4ec7-a325-71c51ac800b8 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:25.415102 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939e9f5-4520-4ec7-a325-71c51ac800b8 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:25.415751 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939e9f5-4520-4ec7-a325-71c51ac800b8 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:25.417451 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 136/279] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:18:25.424737 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed863f25-87d9-4a71-a6b3-8684a08825be None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:25.426942 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed863f25-87d9-4a71-a6b3-8684a08825be None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:25.429019 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed863f25-87d9-4a71-a6b3-8684a08825be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:25.448916 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-ed863f25-87d9-4a71-a6b3-8684a08825be None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:25.450378 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-ed863f25-87d9-4a71-a6b3-8684a08825be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:25.538727 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:25.551246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 137/280] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:25.551246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ac09a-16c4-4028-92c5-099c6790fa49 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:25.551246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ac09a-16c4-4028-92c5-099c6790fa49 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:25.551246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ac09a-16c4-4028-92c5-099c6790fa49 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:25.551246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 138/281] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:25.554460 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76ee02-e9ef-4c24-b93a-142b08389b41 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:25.556576 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e37cc9-87cf-4f98-8fc2-c6a0252cb982 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:25.556872 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e37cc9-87cf-4f98-8fc2-c6a0252cb982 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:25.557295 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e37cc9-87cf-4f98-8fc2-c6a0252cb982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:25.576589 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-21e37cc9-87cf-4f98-8fc2-c6a0252cb982 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:25.577801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-21e37cc9-87cf-4f98-8fc2-c6a0252cb982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:25.591893 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f47be-927f-4675-8579-00c9cd6dfe24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:25.592555 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f47be-927f-4675-8579-00c9cd6dfe24 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:25.592890 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f47be-927f-4675-8579-00c9cd6dfe24 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:25.593304 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f47be-927f-4675-8579-00c9cd6dfe24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:25.594149 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f47be-927f-4675-8579-00c9cd6dfe24 None admin] RBAC: Adding query filter params (role.id=ff311e825f2b4a3d809aa772f6cdecb0, user.id=0ecd03674d244216923b05f9613ab9be, scope.system=all) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:25.594468 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f47be-927f-4675-8579-00c9cd6dfe24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:25.595985 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f47be-927f-4675-8579-00c9cd6dfe24 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:25.607396 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 144/282] 10.222.0.44 () {56 vars in 1308 bytes} [Tue Jul 19 15:18:25 2022] GET /identity/v3/role_assignments?user.id=0ecd03674d244216923b05f9613ab9be&scope.system=all&role.id=ff311e825f2b4a3d809aa772f6cdecb0 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:25.608413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f47be-927f-4675-8579-00c9cd6dfe24 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:25.645682 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:25.655784 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 139/283] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:18:25.706511 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e37cc9-87cf-4f98-8fc2-c6a0252cb982 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:25.760784 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f47be-927f-4675-8579-00c9cd6dfe24 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:25.800009 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f16ee-0525-4b67-a870-d2032ccaa921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:25.800833 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f16ee-0525-4b67-a870-d2032ccaa921 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:25.801176 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f16ee-0525-4b67-a870-d2032ccaa921 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:25.801459 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f16ee-0525-4b67-a870-d2032ccaa921 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:25.813903 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f16ee-0525-4b67-a870-d2032ccaa921 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:25.822746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-744f16ee-0525-4b67-a870-d2032ccaa921 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:18:25.822746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:25.822746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:25.822746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:25.822746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:25.822746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:25.822746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:25.822746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:25.822746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:25.822746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:25.822746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:25.822746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:25.822746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:25.822746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:25.822746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:25.822746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:25.823721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:25.823721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:25.823721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:25.823721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:25.823721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:25.823721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:25.823721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:25.823721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:25.823721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:25.823721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:25.823721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:25.823721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:25.823721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:25.823721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:25.823721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:25.823721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:25.824540 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:25.824540 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:25.824540 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:25.824540 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:25.824540 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:25.824540 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:25.824540 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:25.824540 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:25.824540 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:25.824540 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:25.824540 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:18:25.824540 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:25.824540 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 145/284] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:25.834815 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f16ee-0525-4b67-a870-d2032ccaa921 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:25.870391 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:25.926802 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e37cc9-87cf-4f98-8fc2-c6a0252cb982 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:26.002614 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2294e-7008-438d-9dbd-5acabeb03807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:26.004372 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2294e-7008-438d-9dbd-5acabeb03807 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:26.005027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2294e-7008-438d-9dbd-5acabeb03807 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:26.007144 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f16ee-0525-4b67-a870-d2032ccaa921 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:26.007665 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2294e-7008-438d-9dbd-5acabeb03807 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:26.029477 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2294e-7008-438d-9dbd-5acabeb03807 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:26.042210 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-d9e2294e-7008-438d-9dbd-5acabeb03807 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:26.042210 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:26.042210 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:26.042210 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:26.042210 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:26.042210 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:26.042210 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:26.042210 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:26.042210 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:26.042210 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:26.042210 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:26.042210 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:26.042210 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:26.042210 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:26.042210 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:26.042210 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:26.043136 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:26.043136 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:26.043136 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:26.043136 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:26.043136 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:26.043136 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:26.043136 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:26.043136 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:26.043136 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:26.043136 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:26.043136 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:26.043136 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:26.043136 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:26.043136 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:26.043136 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:26.043136 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:26.043958 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:26.043958 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:26.043958 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:26.043958 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:26.043958 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:26.043958 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:26.043958 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:26.043958 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:26.043958 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:26.043958 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:26.043958 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:26.043958 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:26.048764 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 140/285] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:26.054847 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2294e-7008-438d-9dbd-5acabeb03807 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:26.078447 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a181fc-bbb9-4a87-9eb8-7c84cbcc26df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:26.079188 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a181fc-bbb9-4a87-9eb8-7c84cbcc26df None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:26.079502 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a181fc-bbb9-4a87-9eb8-7c84cbcc26df None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:26.079784 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a181fc-bbb9-4a87-9eb8-7c84cbcc26df None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:26.081995 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a181fc-bbb9-4a87-9eb8-7c84cbcc26df None admin] RBAC: Adding query filter params (name=reader) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:26.082318 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a181fc-bbb9-4a87-9eb8-7c84cbcc26df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:26.084576 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a181fc-bbb9-4a87-9eb8-7c84cbcc26df None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:26.103540 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 146/286] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 19 15:18:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:26.110596 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a181fc-bbb9-4a87-9eb8-7c84cbcc26df None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:26.171657 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:26.235368 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2294e-7008-438d-9dbd-5acabeb03807 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:26.288673 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15983aa4-de86-4ef9-a10e-eff6fb52e6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:26.289874 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15983aa4-de86-4ef9-a10e-eff6fb52e6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:26.290394 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15983aa4-de86-4ef9-a10e-eff6fb52e6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:26.290891 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15983aa4-de86-4ef9-a10e-eff6fb52e6d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:26.292272 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15983aa4-de86-4ef9-a10e-eff6fb52e6d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:26.292739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15983aa4-de86-4ef9-a10e-eff6fb52e6d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:26.295333 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15983aa4-de86-4ef9-a10e-eff6fb52e6d9 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:26.319619 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:26.331326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 141/287] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 19 15:18:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:26.333406 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15983aa4-de86-4ef9-a10e-eff6fb52e6d9 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:26.377242 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a181fc-bbb9-4a87-9eb8-7c84cbcc26df None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:26.451458 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a83e1-a16a-4471-a3c8-2e2b0632c1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:26.452809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a83e1-a16a-4471-a3c8-2e2b0632c1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:26.453391 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a83e1-a16a-4471-a3c8-2e2b0632c1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:26.453944 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a83e1-a16a-4471-a3c8-2e2b0632c1c5 None admin] PATH_INFO: `/v3/users/987002535d944f029530840dc99c9294` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:26.456735 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a83e1-a16a-4471-a3c8-2e2b0632c1c5 None admin] RBAC: Authorizing `identity:get_user(user_id=987002535d944f029530840dc99c9294)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:26.459043 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a83e1-a16a-4471-a3c8-2e2b0632c1c5 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:26.463700 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 147/288] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:26 2022] GET /identity/v3/users/987002535d944f029530840dc99c9294 => generated 297 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:26.467152 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a83e1-a16a-4471-a3c8-2e2b0632c1c5 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:26.552061 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15983aa4-de86-4ef9-a10e-eff6fb52e6d9 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:26.603714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:26.619646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6038316-a2c5-4060-9781-483fd10f1c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:26.623687 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6038316-a2c5-4060-9781-483fd10f1c9c None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:26.625335 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6038316-a2c5-4060-9781-483fd10f1c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:26.625832 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6038316-a2c5-4060-9781-483fd10f1c9c None admin] PATH_INFO: `/v3/users/c558e62140b647c1b2de2b9e398ebcf7` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:26.629307 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6038316-a2c5-4060-9781-483fd10f1c9c None admin] RBAC: Authorizing `identity:get_user(user_id=c558e62140b647c1b2de2b9e398ebcf7)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:26.632789 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6038316-a2c5-4060-9781-483fd10f1c9c None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:26.638050 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 142/289] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:26 2022] GET /identity/v3/users/c558e62140b647c1b2de2b9e398ebcf7 => generated 297 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:26.640564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6038316-a2c5-4060-9781-483fd10f1c9c None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:26.695091 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a83e1-a16a-4471-a3c8-2e2b0632c1c5 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:26.776423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b1ffac-3934-41a4-a9ed-6947dcd7eaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:26.780710 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1ffac-3934-41a4-a9ed-6947dcd7eaeb None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:26.781219 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1ffac-3934-41a4-a9ed-6947dcd7eaeb None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:26.781739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1ffac-3934-41a4-a9ed-6947dcd7eaeb None admin] PATH_INFO: `/v3/projects/057eacfe69e5438fae88b82be96b147a` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:26.785916 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b1ffac-3934-41a4-a9ed-6947dcd7eaeb None admin] RBAC: Authorizing `identity:get_project(project_id=057eacfe69e5438fae88b82be96b147a)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:26.787678 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b1ffac-3934-41a4-a9ed-6947dcd7eaeb None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:26.797952 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 148/290] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:26 2022] GET /identity/v3/projects/057eacfe69e5438fae88b82be96b147a => generated 302 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:26.799063 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b1ffac-3934-41a4-a9ed-6947dcd7eaeb None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:26.831290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:26.858466 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6038316-a2c5-4060-9781-483fd10f1c9c None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:26.916973 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c5bc7-a11d-40ff-bfe0-06b5ce8c6227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:26.917959 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c5bc7-a11d-40ff-bfe0-06b5ce8c6227 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:26.918495 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c5bc7-a11d-40ff-bfe0-06b5ce8c6227 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:26.919306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c5bc7-a11d-40ff-bfe0-06b5ce8c6227 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:27.035582 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:27.041926 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b1ffac-3934-41a4-a9ed-6947dcd7eaeb None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:27.060560 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c5bc7-a11d-40ff-bfe0-06b5ce8c6227 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:27.062040 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c5bc7-a11d-40ff-bfe0-06b5ce8c6227 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:27.124495 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ec156-0c5a-4917-9573-53d448250b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:27.125982 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ec156-0c5a-4917-9573-53d448250b2f None admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:27.126282 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ec156-0c5a-4917-9573-53d448250b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:27.126577 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ec156-0c5a-4917-9573-53d448250b2f None admin] PATH_INFO: `/v3/projects/057eacfe69e5438fae88b82be96b147a/users/987002535d944f029530840dc99c9294/roles/d528f237588f49489344fe727d4662e5` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:27.132108 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ec156-0c5a-4917-9573-53d448250b2f None admin] RBAC: Authorizing `identity:create_grant(project_id=057eacfe69e5438fae88b82be96b147a, user_id=987002535d944f029530840dc99c9294, role_id=d528f237588f49489344fe727d4662e5)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:27.133578 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ec156-0c5a-4917-9573-53d448250b2f None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:27.157492 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 149/291] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 19 15:18:26 2022] PUT /identity/v3/projects/057eacfe69e5438fae88b82be96b147a/users/987002535d944f029530840dc99c9294/roles/d528f237588f49489344fe727d4662e5 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:18:27.188605 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 143/292] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:18:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:18:27.194549 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ec156-0c5a-4917-9573-53d448250b2f None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:27.296712 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:27.338157 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ec156-0c5a-4917-9573-53d448250b2f None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:27.379131 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5050979-8730-4bc8-8425-479970622286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:27.380090 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5050979-8730-4bc8-8425-479970622286 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:27.380411 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5050979-8730-4bc8-8425-479970622286 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:27.380698 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5050979-8730-4bc8-8425-479970622286 None admin] PATH_INFO: `/v3/projects/057eacfe69e5438fae88b82be96b147a` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:27.381916 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5050979-8730-4bc8-8425-479970622286 None admin] RBAC: Authorizing `identity:get_project(project_id=057eacfe69e5438fae88b82be96b147a)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:27.383372 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5050979-8730-4bc8-8425-479970622286 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:27.385264 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 150/293] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:27 2022] GET /identity/v3/projects/057eacfe69e5438fae88b82be96b147a => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:27.391034 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c5bc7-a11d-40ff-bfe0-06b5ce8c6227 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:27.487661 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:27.492993 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bad2da-8bb5-452c-9757-087e42340f12 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:27.493319 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bad2da-8bb5-452c-9757-087e42340f12 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:27.493561 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bad2da-8bb5-452c-9757-087e42340f12 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:27.495137 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 151/294] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:27.504639 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04a351-2c52-42fd-be9f-c5d25a2ab96d None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:27.505268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04a351-2c52-42fd-be9f-c5d25a2ab96d None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:27.506471 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04a351-2c52-42fd-be9f-c5d25a2ab96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:27.506656 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c5bc7-a11d-40ff-bfe0-06b5ce8c6227 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:27.532701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-1b04a351-2c52-42fd-be9f-c5d25a2ab96d None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:27.534849 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-1b04a351-2c52-42fd-be9f-c5d25a2ab96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:27.548295 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7fc6e-9491-4c3d-a868-e275e4484b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:27.548991 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7fc6e-9491-4c3d-a868-e275e4484b6f None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:27.549273 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7fc6e-9491-4c3d-a868-e275e4484b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:27.549542 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7fc6e-9491-4c3d-a868-e275e4484b6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:27.550720 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7fc6e-9491-4c3d-a868-e275e4484b6f None admin] RBAC: Adding query filter params (role.id=ff311e825f2b4a3d809aa772f6cdecb0, scope.project.id=057eacfe69e5438fae88b82be96b147a, user.id=c558e62140b647c1b2de2b9e398ebcf7) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:27.551237 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7fc6e-9491-4c3d-a868-e275e4484b6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:27.553443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7fc6e-9491-4c3d-a868-e275e4484b6f None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:27.561747 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 144/295] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:18:27 2022] GET /identity/v3/role_assignments?user.id=c558e62140b647c1b2de2b9e398ebcf7&scope.project.id=057eacfe69e5438fae88b82be96b147a&role.id=ff311e825f2b4a3d809aa772f6cdecb0 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:27.668136 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 152/296] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:27.677029 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6ea11-ffbe-4f17-ab34-70b2c93ec0c6 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:27.678254 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6ea11-ffbe-4f17-ab34-70b2c93ec0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:27.678730 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6ea11-ffbe-4f17-ab34-70b2c93ec0c6 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:27.680715 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 145/297] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:27.686140 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb2c01-9dbb-41d2-acbd-8ee2b29be30d None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:27.686435 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb2c01-9dbb-41d2-acbd-8ee2b29be30d None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:27.686723 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb2c01-9dbb-41d2-acbd-8ee2b29be30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:27.719130 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-33eb2c01-9dbb-41d2-acbd-8ee2b29be30d None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:27.721633 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-33eb2c01-9dbb-41d2-acbd-8ee2b29be30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:27.735873 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6ea11-ffbe-4f17-ab34-70b2c93ec0c6 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:27.801282 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 153/298] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:27.825323 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb2c01-9dbb-41d2-acbd-8ee2b29be30d None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:27.827498 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:27.871498 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6ea11-ffbe-4f17-ab34-70b2c93ec0c6 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:27.909041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dd3a9-4762-484b-9992-18e4f835282a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:27.910177 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dd3a9-4762-484b-9992-18e4f835282a None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:27.910679 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dd3a9-4762-484b-9992-18e4f835282a None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:27.911157 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dd3a9-4762-484b-9992-18e4f835282a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:27.924312 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dd3a9-4762-484b-9992-18e4f835282a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:27.931080 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb2c01-9dbb-41d2-acbd-8ee2b29be30d None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:27.933705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-4b3dd3a9-4762-484b-9992-18e4f835282a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:18:27.933705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:27.933705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:27.933705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:27.933705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:27.933705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:27.933705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:27.933705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:27.933705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:27.933705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:27.933705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:27.933705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:27.933705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:27.933705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:27.933705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:27.933705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:27.934606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:27.934606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:27.934606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:27.934606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:27.934606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:27.934606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:27.934606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:27.934606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:27.934606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:27.934606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:27.934606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:27.934606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:27.934606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:27.934606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:27.934606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:27.934606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:27.935412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:27.935412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:27.935412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:27.935412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:27.935412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:27.935412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:27.935412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:27.935412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:27.935412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:27.935412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:27.935412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:18:27.935412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:27.937810 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 146/299] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:27.943934 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dd3a9-4762-484b-9992-18e4f835282a None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:27.959188 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:27.971449 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c38026-1274-4b07-96fc-7df1f9509369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:27.972263 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c38026-1274-4b07-96fc-7df1f9509369 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:27.972559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c38026-1274-4b07-96fc-7df1f9509369 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:27.972842 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c38026-1274-4b07-96fc-7df1f9509369 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:27.975413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c38026-1274-4b07-96fc-7df1f9509369 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:27.977047 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c38026-1274-4b07-96fc-7df1f9509369 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:27.979776 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 154/300] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:18:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:27.985648 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c38026-1274-4b07-96fc-7df1f9509369 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:28.078010 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:28.081415 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dd3a9-4762-484b-9992-18e4f835282a None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:28.114877 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c38026-1274-4b07-96fc-7df1f9509369 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:28.132561 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35266f-52eb-496e-a643-2f5db65cc83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:28.133629 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35266f-52eb-496e-a643-2f5db65cc83e None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:28.134081 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35266f-52eb-496e-a643-2f5db65cc83e None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:28.134519 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35266f-52eb-496e-a643-2f5db65cc83e None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:28.135451 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35266f-52eb-496e-a643-2f5db65cc83e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:28.136449 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35266f-52eb-496e-a643-2f5db65cc83e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:28.138354 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35266f-52eb-496e-a643-2f5db65cc83e None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:28.150555 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8195dbf-a513-404d-b2b1-5fb8450b44b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:28.151591 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8195dbf-a513-404d-b2b1-5fb8450b44b1 None admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:28.152075 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8195dbf-a513-404d-b2b1-5fb8450b44b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:28.152547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8195dbf-a513-404d-b2b1-5fb8450b44b1 None admin] PATH_INFO: `/v3/groups` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:28.153474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8195dbf-a513-404d-b2b1-5fb8450b44b1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:28.155365 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8195dbf-a513-404d-b2b1-5fb8450b44b1 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:28.155760 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 147/301] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 19 15:18:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:28.156980 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35266f-52eb-496e-a643-2f5db65cc83e None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:28.173932 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 155/302] 10.222.0.44 () {60 vars in 1134 bytes} [Tue Jul 19 15:18:27 2022] POST /identity/v3/groups => generated 229 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:18:28.175723 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3261e-9bd3-4d69-8981-ad1ea4fdde51 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:28.176237 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3261e-9bd3-4d69-8981-ad1ea4fdde51 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:28.176715 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3261e-9bd3-4d69-8981-ad1ea4fdde51 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:28.178456 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 156/303] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:28.184979 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a658ea-f1d6-4f91-8451-06086550032c None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:28.185627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a658ea-f1d6-4f91-8451-06086550032c None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:28.186140 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a658ea-f1d6-4f91-8451-06086550032c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:28.204543 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-37a658ea-f1d6-4f91-8451-06086550032c None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:28.206160 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-37a658ea-f1d6-4f91-8451-06086550032c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:28.261706 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:28.283255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35266f-52eb-496e-a643-2f5db65cc83e None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:28.302124 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 157/304] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:18:28.318472 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a658ea-f1d6-4f91-8451-06086550032c None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:28.330714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1053f1-7cc7-4579-9033-e58c05ff60ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:28.332065 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1053f1-7cc7-4579-9033-e58c05ff60ec None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:28.332706 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1053f1-7cc7-4579-9033-e58c05ff60ec None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:28.333210 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1053f1-7cc7-4579-9033-e58c05ff60ec None admin] PATH_INFO: `/v3/users/1e96c8ab5e384ba78b4e4f094332eb3f` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:28.349892 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1053f1-7cc7-4579-9033-e58c05ff60ec None admin] RBAC: Authorizing `identity:get_user(user_id=1e96c8ab5e384ba78b4e4f094332eb3f)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:28.351890 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1053f1-7cc7-4579-9033-e58c05ff60ec None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:28.353596 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 148/305] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:28 2022] GET /identity/v3/users/1e96c8ab5e384ba78b4e4f094332eb3f => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:28.359590 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1053f1-7cc7-4579-9033-e58c05ff60ec None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:28.397337 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:28.441959 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a658ea-f1d6-4f91-8451-06086550032c None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:28.483618 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1053f1-7cc7-4579-9033-e58c05ff60ec None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:28.486350 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f78f00-b056-4bda-bdad-d9b38f427e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:28.487562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f78f00-b056-4bda-bdad-d9b38f427e83 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:28.487562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f78f00-b056-4bda-bdad-d9b38f427e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:28.487845 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f78f00-b056-4bda-bdad-d9b38f427e83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:28.499172 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f78f00-b056-4bda-bdad-d9b38f427e83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:28.507861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-13f78f00-b056-4bda-bdad-d9b38f427e83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:28.507861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:28.507861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:28.507861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:28.507861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:28.507861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:28.507861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:28.507861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:28.507861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:28.507861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:28.507861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:28.507861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:28.507861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:28.507861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:28.507861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:28.507861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:28.508752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:28.508752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:28.508752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:28.508752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:28.508752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:28.508752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:28.508752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:28.508752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:28.508752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:28.508752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:28.508752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:28.508752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:28.508752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:28.508752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:28.508752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:28.508752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:28.509602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:28.509602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:28.509602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:28.509602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:28.509602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:28.509602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:28.509602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:28.509602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:28.509602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:28.509602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:28.509602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:28.509602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:28.509602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 158/306] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:28.515030 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f78f00-b056-4bda-bdad-d9b38f427e83 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:28.524834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:28.533392 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2cea1-de68-4b72-87e0-d721e1cf4b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:28.534589 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2cea1-de68-4b72-87e0-d721e1cf4b8b None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:28.535595 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2cea1-de68-4b72-87e0-d721e1cf4b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:28.536073 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2cea1-de68-4b72-87e0-d721e1cf4b8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:28.537377 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2cea1-de68-4b72-87e0-d721e1cf4b8b None admin] RBAC: Adding query filter params (role.id=d528f237588f49489344fe727d4662e5, user.id=1e96c8ab5e384ba78b4e4f094332eb3f, scope.system=all) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:28.538123 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2cea1-de68-4b72-87e0-d721e1cf4b8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:28.540160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2cea1-de68-4b72-87e0-d721e1cf4b8b None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:28.547781 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 149/307] 10.222.0.44 () {56 vars in 1308 bytes} [Tue Jul 19 15:18:28 2022] GET /identity/v3/role_assignments?user.id=1e96c8ab5e384ba78b4e4f094332eb3f&scope.system=all&role.id=d528f237588f49489344fe727d4662e5 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:28.638156 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f78f00-b056-4bda-bdad-d9b38f427e83 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:28.667244 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:28.690562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb331425-1561-4b15-9f5b-1c9a2fab758b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:28.691636 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb331425-1561-4b15-9f5b-1c9a2fab758b None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:28.692120 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb331425-1561-4b15-9f5b-1c9a2fab758b None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:28.692619 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb331425-1561-4b15-9f5b-1c9a2fab758b None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:28.694139 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb331425-1561-4b15-9f5b-1c9a2fab758b None admin] RBAC: Adding query filter params (name=member) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:28.694655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb331425-1561-4b15-9f5b-1c9a2fab758b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:28.696295 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb331425-1561-4b15-9f5b-1c9a2fab758b None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:28.706050 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 159/308] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 19 15:18:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:28.711901 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2cea1-de68-4b72-87e0-d721e1cf4b8b None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:28.832544 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2cea1-de68-4b72-87e0-d721e1cf4b8b None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:28.874112 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b899d77-7bc1-43f4-8e60-7a89cbe5e91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:28.875038 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b899d77-7bc1-43f4-8e60-7a89cbe5e91f None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:28.875350 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b899d77-7bc1-43f4-8e60-7a89cbe5e91f None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:28.875634 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b899d77-7bc1-43f4-8e60-7a89cbe5e91f None admin] PATH_INFO: `/v3/users/0ecd03674d244216923b05f9613ab9be` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:28.876943 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b899d77-7bc1-43f4-8e60-7a89cbe5e91f None admin] RBAC: Authorizing `identity:get_user(user_id=0ecd03674d244216923b05f9613ab9be)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:28.878395 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b899d77-7bc1-43f4-8e60-7a89cbe5e91f None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:28.881070 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 150/309] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:28 2022] GET /identity/v3/users/0ecd03674d244216923b05f9613ab9be => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:28.886183 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb331425-1561-4b15-9f5b-1c9a2fab758b None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:28.992656 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb331425-1561-4b15-9f5b-1c9a2fab758b None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:29.028428 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8bad5c-5991-49a4-858b-0c800fbaf5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:29.029648 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bad5c-5991-49a4-858b-0c800fbaf5a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:29.030427 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bad5c-5991-49a4-858b-0c800fbaf5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:29.030908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bad5c-5991-49a4-858b-0c800fbaf5a8 None admin] PATH_INFO: `/v3/system/users/0ecd03674d244216923b05f9613ab9be/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:29.032714 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8bad5c-5991-49a4-858b-0c800fbaf5a8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0ecd03674d244216923b05f9613ab9be, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:29.034314 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8bad5c-5991-49a4-858b-0c800fbaf5a8 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:29.044916 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 160/310] 10.222.0.44 () {58 vars in 1334 bytes} [Tue Jul 19 15:18:28 2022] PUT /identity/v3/system/users/0ecd03674d244216923b05f9613ab9be/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:18:29.627968 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b5981-6b13-4ca6-9b8e-9272a792bcf7 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:29.628484 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b5981-6b13-4ca6-9b8e-9272a792bcf7 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:29.628560 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b5981-6b13-4ca6-9b8e-9272a792bcf7 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:29.630170 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 151/311] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:29.635460 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee095ab-c6dd-45f5-8b31-f7488433db8b None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:29.635758 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee095ab-c6dd-45f5-8b31-f7488433db8b None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:29.636041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee095ab-c6dd-45f5-8b31-f7488433db8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:29.653791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-bee095ab-c6dd-45f5-8b31-f7488433db8b None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:29.654981 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-bee095ab-c6dd-45f5-8b31-f7488433db8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:29.700965 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:29.728765 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 161/312] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:29.752180 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b5981-6b13-4ca6-9b8e-9272a792bcf7 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:29.824446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:29.865115 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b5981-6b13-4ca6-9b8e-9272a792bcf7 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:29.902128 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c080e-95f7-4464-97e6-5c88d5acd769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:29.902872 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c080e-95f7-4464-97e6-5c88d5acd769 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:29.903158 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c080e-95f7-4464-97e6-5c88d5acd769 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:29.903483 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c080e-95f7-4464-97e6-5c88d5acd769 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:29.916021 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c080e-95f7-4464-97e6-5c88d5acd769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:29.924114 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-734c080e-95f7-4464-97e6-5c88d5acd769 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:18:29.924114 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:29.924114 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:29.924114 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:29.924114 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:29.924114 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:29.924114 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:29.924114 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:29.924114 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:29.924114 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:29.924114 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:29.924114 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:29.924114 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:29.924114 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:29.924114 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:29.924114 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:29.925602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:29.925602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:29.925602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:29.925602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:29.925602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:29.925602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:29.925602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:29.925602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:29.925602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:29.925602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:29.925602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:29.925602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:29.925602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:29.925602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:29.925602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:29.925602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:29.926878 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:29.926878 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:29.926878 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:29.926878 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:29.926878 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:29.926878 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:29.926878 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:29.926878 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:29.926878 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:29.926878 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:29.926878 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:18:29.926878 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:29.926878 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 152/313] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:29.935255 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee095ab-c6dd-45f5-8b31-f7488433db8b None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:30.038001 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee095ab-c6dd-45f5-8b31-f7488433db8b None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:30.080853 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa4369-3a1a-4875-ac8e-7926e596c6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:30.081631 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa4369-3a1a-4875-ac8e-7926e596c6aa None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:30.081921 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa4369-3a1a-4875-ac8e-7926e596c6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:30.082203 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa4369-3a1a-4875-ac8e-7926e596c6aa None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:30.083015 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa4369-3a1a-4875-ac8e-7926e596c6aa None admin] RBAC: Adding query filter params (name=reader) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:30.083362 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa4369-3a1a-4875-ac8e-7926e596c6aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:30.084832 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa4369-3a1a-4875-ac8e-7926e596c6aa None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:30.093781 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 162/314] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 19 15:18:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:30.099840 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c080e-95f7-4464-97e6-5c88d5acd769 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:30.217477 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c080e-95f7-4464-97e6-5c88d5acd769 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:30.245078 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:30.258354 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa47c4-ba98-44c2-b75a-01ed4aa79c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:30.259248 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa47c4-ba98-44c2-b75a-01ed4aa79c88 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:30.259543 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa47c4-ba98-44c2-b75a-01ed4aa79c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:30.259821 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa47c4-ba98-44c2-b75a-01ed4aa79c88 None admin] PATH_INFO: `/v3/users/987002535d944f029530840dc99c9294` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:30.261047 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa47c4-ba98-44c2-b75a-01ed4aa79c88 None admin] RBAC: Authorizing `identity:get_user(user_id=987002535d944f029530840dc99c9294)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:30.262497 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa47c4-ba98-44c2-b75a-01ed4aa79c88 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:30.264554 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 153/315] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:30 2022] GET /identity/v3/users/987002535d944f029530840dc99c9294 => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:30.270030 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa4369-3a1a-4875-ac8e-7926e596c6aa None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:30.312928 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:30.376365 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa4369-3a1a-4875-ac8e-7926e596c6aa None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:30.411640 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a71d5-1cb2-42c3-b451-cfc8d807976d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:30.412316 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a71d5-1cb2-42c3-b451-cfc8d807976d None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:30.412603 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a71d5-1cb2-42c3-b451-cfc8d807976d None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:30.412884 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a71d5-1cb2-42c3-b451-cfc8d807976d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:30.455396 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2012c1-9410-40bf-b00a-3a7929e3149d None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:30.455724 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2012c1-9410-40bf-b00a-3a7929e3149d None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:30.455958 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2012c1-9410-40bf-b00a-3a7929e3149d None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:30.457802 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 154/316] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:18:30.462862 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73992028-73e7-4439-aaa1-8d3177bc7514 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:30.463155 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73992028-73e7-4439-aaa1-8d3177bc7514 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:30.463470 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73992028-73e7-4439-aaa1-8d3177bc7514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:30.481392 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-73992028-73e7-4439-aaa1-8d3177bc7514 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:30.482610 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-73992028-73e7-4439-aaa1-8d3177bc7514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:30.484536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a71d5-1cb2-42c3-b451-cfc8d807976d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:30.486918 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a71d5-1cb2-42c3-b451-cfc8d807976d None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:30.534999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:30.564017 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 155/317] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:18:30.587378 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73992028-73e7-4439-aaa1-8d3177bc7514 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:30.614316 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 163/318] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:18:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:18:30.621193 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a71d5-1cb2-42c3-b451-cfc8d807976d None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:30.698026 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73992028-73e7-4439-aaa1-8d3177bc7514 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:30.719105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:30.725903 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a71d5-1cb2-42c3-b451-cfc8d807976d None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:30.734807 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dc8ba-fe02-4284-bb15-e867ca934822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:30.735560 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dc8ba-fe02-4284-bb15-e867ca934822 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:30.735853 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dc8ba-fe02-4284-bb15-e867ca934822 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:30.736138 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dc8ba-fe02-4284-bb15-e867ca934822 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:30.737378 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6dc8ba-fe02-4284-bb15-e867ca934822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:30.738808 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6dc8ba-fe02-4284-bb15-e867ca934822 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:30.740726 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 156/319] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:18:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:30.744696 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe953d3b-a386-49d0-bf2f-c34e08dd2306 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:30.745209 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe953d3b-a386-49d0-bf2f-c34e08dd2306 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:30.745497 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe953d3b-a386-49d0-bf2f-c34e08dd2306 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:30.746797 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 157/320] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:30.747813 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe953d3b-a386-49d0-bf2f-c34e08dd2306 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:30.766039 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe6c0c-42ac-4568-a7eb-d1e0f4a93ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:30.766908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe6c0c-42ac-4568-a7eb-d1e0f4a93ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:30.767196 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe6c0c-42ac-4568-a7eb-d1e0f4a93ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:30.767761 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe6c0c-42ac-4568-a7eb-d1e0f4a93ed7 None admin] PATH_INFO: `/v3/projects/057eacfe69e5438fae88b82be96b147a` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:30.768692 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe6c0c-42ac-4568-a7eb-d1e0f4a93ed7 None admin] RBAC: Authorizing `identity:get_project(project_id=057eacfe69e5438fae88b82be96b147a)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:30.770099 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe6c0c-42ac-4568-a7eb-d1e0f4a93ed7 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:30.772549 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 164/321] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:30 2022] GET /identity/v3/projects/057eacfe69e5438fae88b82be96b147a => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:30.773712 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b8a6a-2b07-4780-aa29-6a7e3f8fce69 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:30.773982 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b8a6a-2b07-4780-aa29-6a7e3f8fce69 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:30.774263 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b8a6a-2b07-4780-aa29-6a7e3f8fce69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:30.786582 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:30.793101 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-db8b8a6a-2b07-4780-aa29-6a7e3f8fce69 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:30.794293 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-db8b8a6a-2b07-4780-aa29-6a7e3f8fce69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:30.870401 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 165/322] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:30.871045 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b8a6a-2b07-4780-aa29-6a7e3f8fce69 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:30.891379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe953d3b-a386-49d0-bf2f-c34e08dd2306 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:30.933329 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fcd09-1dca-44b2-a27c-689d3889ff4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:30.934330 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fcd09-1dca-44b2-a27c-689d3889ff4f None admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:30.934870 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fcd09-1dca-44b2-a27c-689d3889ff4f None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:30.935473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fcd09-1dca-44b2-a27c-689d3889ff4f None admin] PATH_INFO: `/v3/groups` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:30.936181 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fcd09-1dca-44b2-a27c-689d3889ff4f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:30.937736 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fcd09-1dca-44b2-a27c-689d3889ff4f None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:30.959263 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 158/323] 10.222.0.44 () {60 vars in 1134 bytes} [Tue Jul 19 15:18:30 2022] POST /identity/v3/groups => generated 226 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:18:30.959263 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fcd09-1dca-44b2-a27c-689d3889ff4f None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:31.011065 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:31.016278 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b8a6a-2b07-4780-aa29-6a7e3f8fce69 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:31.071059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe6c45-bd97-4eb1-b931-c75eef8723c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:31.082009 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe6c45-bd97-4eb1-b931-c75eef8723c1 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:31.082009 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe6c45-bd97-4eb1-b931-c75eef8723c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:31.082009 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe6c45-bd97-4eb1-b931-c75eef8723c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:31.082009 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe6c45-bd97-4eb1-b931-c75eef8723c1 None admin] RBAC: Adding query filter params (role.id=d528f237588f49489344fe727d4662e5, scope.project.id=057eacfe69e5438fae88b82be96b147a, user.id=987002535d944f029530840dc99c9294) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:31.082009 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe6c45-bd97-4eb1-b931-c75eef8723c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:31.082009 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe6c45-bd97-4eb1-b931-c75eef8723c1 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:31.085243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fcd09-1dca-44b2-a27c-689d3889ff4f None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:31.087140 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:31.093030 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 166/324] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:18:30 2022] GET /identity/v3/role_assignments?user.id=987002535d944f029530840dc99c9294&scope.project.id=057eacfe69e5438fae88b82be96b147a&role.id=d528f237588f49489344fe727d4662e5 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:31.135580 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b225295-f38d-4dd0-a7fe-cc43d2fb6edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:31.136771 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b225295-f38d-4dd0-a7fe-cc43d2fb6edd None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:31.137322 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b225295-f38d-4dd0-a7fe-cc43d2fb6edd None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:31.137740 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b225295-f38d-4dd0-a7fe-cc43d2fb6edd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:31.151451 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b225295-f38d-4dd0-a7fe-cc43d2fb6edd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:31.156533 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ee829-3da4-481b-b288-a2525db45013 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:31.156828 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ee829-3da4-481b-b288-a2525db45013 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:31.157128 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ee829-3da4-481b-b288-a2525db45013 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:31.158525 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 167/325] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:31.161646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-3b225295-f38d-4dd0-a7fe-cc43d2fb6edd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:18:31.161646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:31.161646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:31.161646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:31.161646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:31.161646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:31.161646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:31.161646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:31.161646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:31.161646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:31.161646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:31.161646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:31.161646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:31.161646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:31.161646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:31.161646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:31.162769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:31.162769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:31.162769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:31.162769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:31.162769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:31.162769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:31.162769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:31.162769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:31.162769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:31.162769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:31.162769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:31.162769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:31.162769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:31.162769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:31.162769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:31.162769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:31.163708 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:31.163708 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:31.163708 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:31.163708 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:31.163708 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:31.163708 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:31.163708 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:31.163708 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:31.163708 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:31.163708 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:31.163708 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:18:31.163708 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:31.165643 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 159/326] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:31.168803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e580b44-ebb7-4a47-a70d-1412b2812032 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:31.169097 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e580b44-ebb7-4a47-a70d-1412b2812032 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:31.169385 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e580b44-ebb7-4a47-a70d-1412b2812032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:31.172124 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b225295-f38d-4dd0-a7fe-cc43d2fb6edd None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:31.206651 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-1e580b44-ebb7-4a47-a70d-1412b2812032 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:31.207917 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-1e580b44-ebb7-4a47-a70d-1412b2812032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:31.304797 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 168/327] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:31.323106 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b225295-f38d-4dd0-a7fe-cc43d2fb6edd None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:31.334539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:31.335716 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e580b44-ebb7-4a47-a70d-1412b2812032 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:31.367307 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83f2dd-20f4-422e-bff2-18aa850f3285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:31.367998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83f2dd-20f4-422e-bff2-18aa850f3285 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:31.368389 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83f2dd-20f4-422e-bff2-18aa850f3285 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:31.368947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83f2dd-20f4-422e-bff2-18aa850f3285 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:31.369445 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83f2dd-20f4-422e-bff2-18aa850f3285 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:31.369760 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83f2dd-20f4-422e-bff2-18aa850f3285 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:31.371308 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83f2dd-20f4-422e-bff2-18aa850f3285 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:31.381630 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 160/328] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 19 15:18:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:31.388356 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83f2dd-20f4-422e-bff2-18aa850f3285 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:31.478582 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e580b44-ebb7-4a47-a70d-1412b2812032 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:31.519850 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83f2dd-20f4-422e-bff2-18aa850f3285 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:31.523259 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:31.531923 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ddb32-970e-421a-b285-70e966541108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:31.533008 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ddb32-970e-421a-b285-70e966541108 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:31.533624 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ddb32-970e-421a-b285-70e966541108 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:31.534434 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ddb32-970e-421a-b285-70e966541108 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:31.548748 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ddb32-970e-421a-b285-70e966541108 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:31.559480 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-f58ddb32-970e-421a-b285-70e966541108 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:31.559480 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:31.559480 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:31.559480 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:31.559480 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:31.559480 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:31.559480 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:31.559480 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:31.559480 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:31.559480 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:31.559480 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:31.559480 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:31.559480 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:31.559480 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:31.559480 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:31.559480 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:31.560341 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:31.560341 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:31.560341 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:31.560341 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:31.560341 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:31.560341 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:31.560341 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:31.560341 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:31.560341 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:31.560341 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:31.560341 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:31.560341 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:31.560341 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:31.560341 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:31.560341 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:31.560341 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:31.561238 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:31.561238 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:31.561238 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:31.561238 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:31.561238 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:31.561238 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:31.561238 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:31.561238 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:31.561238 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:31.561238 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:31.561238 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:31.561238 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:31.563627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 169/329] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:18:31.563843 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092392e4-13b8-4b98-b55c-773021d0f2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:31.564724 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092392e4-13b8-4b98-b55c-773021d0f2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:31.565006 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092392e4-13b8-4b98-b55c-773021d0f2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:31.565283 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092392e4-13b8-4b98-b55c-773021d0f2f2 None admin] PATH_INFO: `/v3/users/1e96c8ab5e384ba78b4e4f094332eb3f` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:31.571263 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092392e4-13b8-4b98-b55c-773021d0f2f2 None admin] RBAC: Authorizing `identity:get_user(user_id=1e96c8ab5e384ba78b4e4f094332eb3f)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:31.571696 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092392e4-13b8-4b98-b55c-773021d0f2f2 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:31.572544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ddb32-970e-421a-b285-70e966541108 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:31.573500 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 161/330] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:31 2022] GET /identity/v3/users/1e96c8ab5e384ba78b4e4f094332eb3f => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:31.579567 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092392e4-13b8-4b98-b55c-773021d0f2f2 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:31.628102 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:31.692386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ddb32-970e-421a-b285-70e966541108 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:31.711478 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092392e4-13b8-4b98-b55c-773021d0f2f2 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:31.740879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a1eaa-560e-492d-af2b-bcca56b162f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:31.740879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a1eaa-560e-492d-af2b-bcca56b162f6 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:31.741138 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a1eaa-560e-492d-af2b-bcca56b162f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:31.741450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a1eaa-560e-492d-af2b-bcca56b162f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:31.742212 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a1eaa-560e-492d-af2b-bcca56b162f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:31.742522 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a1eaa-560e-492d-af2b-bcca56b162f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:31.743946 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a1eaa-560e-492d-af2b-bcca56b162f6 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:31.753483 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 170/331] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 19 15:18:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:31.759034 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a1eaa-560e-492d-af2b-bcca56b162f6 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:31.760104 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60034e43-8092-49dc-b22e-d81b9b7a11f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:31.760985 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60034e43-8092-49dc-b22e-d81b9b7a11f9 None admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:31.761269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60034e43-8092-49dc-b22e-d81b9b7a11f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:31.761549 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60034e43-8092-49dc-b22e-d81b9b7a11f9 None admin] PATH_INFO: `/v3/system/users/1e96c8ab5e384ba78b4e4f094332eb3f/roles/d528f237588f49489344fe727d4662e5` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:31.763432 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60034e43-8092-49dc-b22e-d81b9b7a11f9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1e96c8ab5e384ba78b4e4f094332eb3f, role_id=d528f237588f49489344fe727d4662e5)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:31.764810 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60034e43-8092-49dc-b22e-d81b9b7a11f9 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:31.781834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 162/332] 10.222.0.44 () {58 vars in 1334 bytes} [Tue Jul 19 15:18:31 2022] PUT /identity/v3/system/users/1e96c8ab5e384ba78b4e4f094332eb3f/roles/d528f237588f49489344fe727d4662e5 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:18:31.846207 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:31.908023 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a1eaa-560e-492d-af2b-bcca56b162f6 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:31.955491 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a08c1-cf1c-4d17-a4d6-dfb7206ff391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:31.956390 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a08c1-cf1c-4d17-a4d6-dfb7206ff391 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:31.956678 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a08c1-cf1c-4d17-a4d6-dfb7206ff391 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:31.956957 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a08c1-cf1c-4d17-a4d6-dfb7206ff391 None admin] PATH_INFO: `/v3/users/0ecd03674d244216923b05f9613ab9be` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:31.959349 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a08c1-cf1c-4d17-a4d6-dfb7206ff391 None admin] RBAC: Authorizing `identity:get_user(user_id=0ecd03674d244216923b05f9613ab9be)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:31.960804 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a08c1-cf1c-4d17-a4d6-dfb7206ff391 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:31.962767 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 171/333] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:31 2022] GET /identity/v3/users/0ecd03674d244216923b05f9613ab9be => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:31.968492 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60034e43-8092-49dc-b22e-d81b9b7a11f9 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:32.103891 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60034e43-8092-49dc-b22e-d81b9b7a11f9 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:32.105553 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:32.142091 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20147c-9508-456e-a379-35bfc16f434e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:32.142753 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20147c-9508-456e-a379-35bfc16f434e None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:32.143042 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20147c-9508-456e-a379-35bfc16f434e None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:32.143361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20147c-9508-456e-a379-35bfc16f434e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:32.144205 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20147c-9508-456e-a379-35bfc16f434e None admin] RBAC: Adding query filter params (role.id=ff311e825f2b4a3d809aa772f6cdecb0, user.id=0ecd03674d244216923b05f9613ab9be, scope.system=all) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:32.144524 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20147c-9508-456e-a379-35bfc16f434e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:32.146010 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20147c-9508-456e-a379-35bfc16f434e None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:32.158921 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 163/334] 10.222.0.44 () {56 vars in 1308 bytes} [Tue Jul 19 15:18:31 2022] GET /identity/v3/role_assignments?user.id=0ecd03674d244216923b05f9613ab9be&scope.system=all&role.id=ff311e825f2b4a3d809aa772f6cdecb0 => generated 510 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:33.641032 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ab176-7137-42db-b3c1-48ce1498efaf None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:33.642081 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ab176-7137-42db-b3c1-48ce1498efaf None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:33.642707 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ab176-7137-42db-b3c1-48ce1498efaf None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:33.644900 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 172/335] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:33.650695 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea001d61-f1ae-4b42-890b-687dc1bd83d9 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:33.651623 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea001d61-f1ae-4b42-890b-687dc1bd83d9 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:33.652135 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea001d61-f1ae-4b42-890b-687dc1bd83d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:33.684701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-ea001d61-f1ae-4b42-890b-687dc1bd83d9 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:33.686439 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-ea001d61-f1ae-4b42-890b-687dc1bd83d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:33.721004 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4058f4e-5e3e-41c5-8907-d8112a095c86 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:33.721328 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4058f4e-5e3e-41c5-8907-d8112a095c86 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:33.721564 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4058f4e-5e3e-41c5-8907-d8112a095c86 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:33.723368 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 173/336] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:33.740668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be591fb-4af4-4ad0-9593-28c5c377225f None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:33.740970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be591fb-4af4-4ad0-9593-28c5c377225f None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:33.741247 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be591fb-4af4-4ad0-9593-28c5c377225f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:33.784398 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-9be591fb-4af4-4ad0-9593-28c5c377225f None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:33.785618 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 164/337] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:18:33.785793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-9be591fb-4af4-4ad0-9593-28c5c377225f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:33.821516 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea001d61-f1ae-4b42-890b-687dc1bd83d9 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:33.922271 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 174/338] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:18:33.948265 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be591fb-4af4-4ad0-9593-28c5c377225f None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:34.013294 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:34.051132 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:34.081230 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be591fb-4af4-4ad0-9593-28c5c377225f None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:34.097263 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea001d61-f1ae-4b42-890b-687dc1bd83d9 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:34.137330 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e0e95-8199-47e5-ae5e-ba0e8c43d8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:34.138158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e0e95-8199-47e5-ae5e-ba0e8c43d8cf None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:34.138446 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e0e95-8199-47e5-ae5e-ba0e8c43d8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:34.138727 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e0e95-8199-47e5-ae5e-ba0e8c43d8cf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:34.148546 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58919e8-5403-4d33-b3f1-fbe487d254b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:34.149366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58919e8-5403-4d33-b3f1-fbe487d254b0 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:34.149654 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58919e8-5403-4d33-b3f1-fbe487d254b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:34.149935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58919e8-5403-4d33-b3f1-fbe487d254b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:34.160894 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e0e95-8199-47e5-ae5e-ba0e8c43d8cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:34.166386 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58919e8-5403-4d33-b3f1-fbe487d254b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:34.169657 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-1a1e0e95-8199-47e5-ae5e-ba0e8c43d8cf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:18:34.169657 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:34.169657 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:34.169657 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:34.169657 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:34.169657 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:34.169657 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:34.169657 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:34.169657 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:34.169657 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:34.169657 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:34.169657 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:34.169657 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:34.169657 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:34.169657 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:34.169657 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:34.170544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:34.170544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:34.170544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:34.170544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:34.170544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:34.170544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:34.170544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:34.170544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:34.170544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:34.170544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:34.170544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:34.170544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:34.170544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:34.170544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:34.170544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:34.170544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:34.171366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:34.171366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:34.171366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:34.171366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:34.171366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:34.171366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:34.171366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:34.171366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:34.171366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:34.171366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:34.171366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:18:34.171366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:34.175819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 175/339] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 19 15:18:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:34.176669 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e0e95-8199-47e5-ae5e-ba0e8c43d8cf None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:34.182494 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-b58919e8-5403-4d33-b3f1-fbe487d254b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:34.182494 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:34.182494 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:34.182494 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:34.182494 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:34.182494 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:34.182494 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:34.182494 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:34.182494 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:34.182494 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:34.182494 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:34.182494 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:34.182494 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:34.182494 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:34.182494 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:34.182494 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:34.183513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:34.183513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:34.183513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:34.183513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:34.183513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:34.183513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:34.183513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:34.183513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:34.183513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:34.183513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:34.183513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:34.183513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:34.183513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:34.183513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:34.183513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:34.183513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:34.184291 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:34.184291 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:34.184291 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:34.184291 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:34.184291 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:34.184291 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:34.184291 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:34.184291 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:34.184291 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:34.184291 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:34.184291 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:34.184291 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:34.184291 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 165/340] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:18:34.192193 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58919e8-5403-4d33-b3f1-fbe487d254b0 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:34.337381 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e0e95-8199-47e5-ae5e-ba0e8c43d8cf None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:34.359202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:34.388229 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58919e8-5403-4d33-b3f1-fbe487d254b0 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:34.408895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa073d-9cb6-4e58-b96c-c9a148c0bf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:34.409642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa073d-9cb6-4e58-b96c-c9a148c0bf49 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:34.409868 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa073d-9cb6-4e58-b96c-c9a148c0bf49 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:34.410150 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa073d-9cb6-4e58-b96c-c9a148c0bf49 None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:34.410917 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa073d-9cb6-4e58-b96c-c9a148c0bf49 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:34.411235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa073d-9cb6-4e58-b96c-c9a148c0bf49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:34.413153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa073d-9cb6-4e58-b96c-c9a148c0bf49 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:34.426659 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 176/341] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:18:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:34.432594 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa073d-9cb6-4e58-b96c-c9a148c0bf49 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:34.447268 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684bc4f2-c9f5-44d7-af92-7a8edd50264d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:34.448350 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bc4f2-c9f5-44d7-af92-7a8edd50264d None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:34.448852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bc4f2-c9f5-44d7-af92-7a8edd50264d None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:34.449321 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bc4f2-c9f5-44d7-af92-7a8edd50264d None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:34.450272 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684bc4f2-c9f5-44d7-af92-7a8edd50264d None admin] RBAC: Adding query filter params (name=member) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:34.450773 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684bc4f2-c9f5-44d7-af92-7a8edd50264d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:34.452565 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684bc4f2-c9f5-44d7-af92-7a8edd50264d None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:34.471241 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 166/342] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 19 15:18:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:34.477044 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684bc4f2-c9f5-44d7-af92-7a8edd50264d None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:34.505072 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:34.564701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa073d-9cb6-4e58-b96c-c9a148c0bf49 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:34.602220 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a379677-1253-4609-acd3-b65a51d62f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:34.602881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a379677-1253-4609-acd3-b65a51d62f12 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:34.603171 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a379677-1253-4609-acd3-b65a51d62f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:34.603482 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a379677-1253-4609-acd3-b65a51d62f12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:34.648119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:34.657781 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684bc4f2-c9f5-44d7-af92-7a8edd50264d None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:34.679353 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a379677-1253-4609-acd3-b65a51d62f12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:34.680762 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a379677-1253-4609-acd3-b65a51d62f12 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:34.718299 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc3cb8-e049-4cf9-bffe-09c283900d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:34.720006 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc3cb8-e049-4cf9-bffe-09c283900d60 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:34.720796 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc3cb8-e049-4cf9-bffe-09c283900d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:34.721531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc3cb8-e049-4cf9-bffe-09c283900d60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:34.818027 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 177/343] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:18:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 15:18:34.823758 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a379677-1253-4609-acd3-b65a51d62f12 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:34.876428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc3cb8-e049-4cf9-bffe-09c283900d60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:34.878256 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc3cb8-e049-4cf9-bffe-09c283900d60 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:34.893728 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:34.904900 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:34.941226 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a379677-1253-4609-acd3-b65a51d62f12 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:34.988976 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b59908-5a16-4927-9962-ea6aeaa887b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:34.991001 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b59908-5a16-4927-9962-ea6aeaa887b6 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:34.991758 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b59908-5a16-4927-9962-ea6aeaa887b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:34.992264 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b59908-5a16-4927-9962-ea6aeaa887b6 None admin] PATH_INFO: `/v3/projects/76392ff9ad244418a55302f0aa823f92` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:34.994487 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b59908-5a16-4927-9962-ea6aeaa887b6 None admin] RBAC: Authorizing `identity:get_project(project_id=76392ff9ad244418a55302f0aa823f92)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:34.996872 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b59908-5a16-4927-9962-ea6aeaa887b6 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:34.999642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 178/344] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:34 2022] GET /identity/v3/projects/76392ff9ad244418a55302f0aa823f92 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:35.001192 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78fe3d-d277-45a4-bfb0-7e8daa7edaf8 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:35.001704 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78fe3d-d277-45a4-bfb0-7e8daa7edaf8 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:35.002175 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78fe3d-d277-45a4-bfb0-7e8daa7edaf8 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:35.004054 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 179/345] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:35.005905 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcdd50-03db-4b02-9cef-cadad522f75d None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:35.010196 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcdd50-03db-4b02-9cef-cadad522f75d None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:35.010196 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcdd50-03db-4b02-9cef-cadad522f75d None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:35.010196 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 180/346] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:35.010196 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bcdd50-03db-4b02-9cef-cadad522f75d None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:35.025113 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 167/347] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:18:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 15:18:35.026501 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1a40a-65fe-4661-9adc-a901366b8909 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:35.026792 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1a40a-65fe-4661-9adc-a901366b8909 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:35.027068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1a40a-65fe-4661-9adc-a901366b8909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:35.050533 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-17c1a40a-65fe-4661-9adc-a901366b8909 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:35.051770 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-17c1a40a-65fe-4661-9adc-a901366b8909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:35.138172 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 168/348] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:35.140779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20f417-153c-4e96-9df4-865b540b180b None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:35.141305 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20f417-153c-4e96-9df4-865b540b180b None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:35.142023 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20f417-153c-4e96-9df4-865b540b180b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:35.146291 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bcdd50-03db-4b02-9cef-cadad522f75d None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:35.165901 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-8c20f417-153c-4e96-9df4-865b540b180b None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:35.167910 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-8c20f417-153c-4e96-9df4-865b540b180b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:35.187298 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314a726-e81d-4709-8dd2-9b7ec2ec4cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:35.188744 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314a726-e81d-4709-8dd2-9b7ec2ec4cad None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:35.189104 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314a726-e81d-4709-8dd2-9b7ec2ec4cad None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:35.189497 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314a726-e81d-4709-8dd2-9b7ec2ec4cad None admin] PATH_INFO: `/v3/groups/fbfc0ee38bd44cbcb5a1c469ff975534` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:35.197069 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f314a726-e81d-4709-8dd2-9b7ec2ec4cad None admin] RBAC: Authorizing `identity:get_group(group_id=fbfc0ee38bd44cbcb5a1c469ff975534)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:35.198580 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f314a726-e81d-4709-8dd2-9b7ec2ec4cad None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:35.201274 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 181/349] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jul 19 15:18:35 2022] GET /identity/v3/groups/fbfc0ee38bd44cbcb5a1c469ff975534 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:35.202122 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314a726-e81d-4709-8dd2-9b7ec2ec4cad None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:35.213257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:35.232249 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:35.272811 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 169/350] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:35.273683 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c20f417-153c-4e96-9df4-865b540b180b None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:35.332388 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314a726-e81d-4709-8dd2-9b7ec2ec4cad None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:35.369301 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308dae5-43a6-40db-b985-343a40d2e671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:35.370609 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308dae5-43a6-40db-b985-343a40d2e671 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:35.371101 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308dae5-43a6-40db-b985-343a40d2e671 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:35.371710 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308dae5-43a6-40db-b985-343a40d2e671 None admin] PATH_INFO: `/v3/projects/76392ff9ad244418a55302f0aa823f92` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:35.373133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308dae5-43a6-40db-b985-343a40d2e671 None admin] RBAC: Authorizing `identity:get_project(project_id=76392ff9ad244418a55302f0aa823f92)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:35.375059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308dae5-43a6-40db-b985-343a40d2e671 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:35.377329 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 182/351] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:35 2022] GET /identity/v3/projects/76392ff9ad244418a55302f0aa823f92 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:35.378350 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308dae5-43a6-40db-b985-343a40d2e671 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:35.382741 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c20f417-153c-4e96-9df4-865b540b180b None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:35.430890 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f89e2-8be5-403e-8b93-888a48be5e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:35.431746 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f89e2-8be5-403e-8b93-888a48be5e08 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:35.432031 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f89e2-8be5-403e-8b93-888a48be5e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:35.432354 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f89e2-8be5-403e-8b93-888a48be5e08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:35.444561 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f89e2-8be5-403e-8b93-888a48be5e08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:35.453555 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-747f89e2-8be5-403e-8b93-888a48be5e08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:35.453555 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:35.453555 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:35.453555 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:35.453555 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:35.453555 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:35.453555 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:35.453555 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:35.453555 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:35.453555 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:35.453555 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:35.453555 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:35.453555 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:35.453555 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:35.453555 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:35.453555 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:35.454501 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:35.454501 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:35.454501 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:35.454501 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:35.454501 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:35.454501 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:35.454501 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:35.454501 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:35.454501 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:35.454501 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:35.454501 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:35.454501 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:35.454501 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:35.454501 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:35.454501 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:35.454501 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:35.455799 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:35.455799 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:35.455799 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:35.455799 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:35.455799 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:35.455799 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:35.455799 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:35.455799 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:35.455799 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:35.455799 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:35.455799 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:35.455799 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:35.455799 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 170/352] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:35.455799 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f89e2-8be5-403e-8b93-888a48be5e08 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:35.466190 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:35.490777 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:35.500239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308dae5-43a6-40db-b985-343a40d2e671 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:35.537131 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c37ab-4f3a-4b42-af23-334dea04a5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:35.538148 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c37ab-4f3a-4b42-af23-334dea04a5ba None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:35.538641 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c37ab-4f3a-4b42-af23-334dea04a5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:35.539123 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c37ab-4f3a-4b42-af23-334dea04a5ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:35.540193 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c37ab-4f3a-4b42-af23-334dea04a5ba None admin] RBAC: Adding query filter params (group.id=fbfc0ee38bd44cbcb5a1c469ff975534, role.id=361f7a146e9b47e997cf572bae05c96e, scope.project.id=76392ff9ad244418a55302f0aa823f92) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:35.540743 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c37ab-4f3a-4b42-af23-334dea04a5ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:35.542365 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c37ab-4f3a-4b42-af23-334dea04a5ba None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:35.549074 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 183/353] 10.222.0.44 () {56 vars in 1376 bytes} [Tue Jul 19 15:18:35 2022] GET /identity/v3/role_assignments?group.id=fbfc0ee38bd44cbcb5a1c469ff975534&scope.project.id=76392ff9ad244418a55302f0aa823f92&role.id=361f7a146e9b47e997cf572bae05c96e => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:35.550170 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c37ab-4f3a-4b42-af23-334dea04a5ba None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:35.574813 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f89e2-8be5-403e-8b93-888a48be5e08 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:35.618428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8aff9f-c88c-4ebb-8c2f-07e022dd5d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:35.619300 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8aff9f-c88c-4ebb-8c2f-07e022dd5d57 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:35.619576 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8aff9f-c88c-4ebb-8c2f-07e022dd5d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:35.619860 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8aff9f-c88c-4ebb-8c2f-07e022dd5d57 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:35.632376 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8aff9f-c88c-4ebb-8c2f-07e022dd5d57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:35.640532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-3a8aff9f-c88c-4ebb-8c2f-07e022dd5d57 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:18:35.640532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:35.640532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:35.640532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:35.640532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:35.640532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:35.640532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:35.640532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:35.640532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:35.640532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:35.640532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:35.640532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:35.640532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:35.640532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:35.640532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:35.640532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:35.641489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:35.641489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:35.641489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:35.641489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:35.641489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:35.641489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:35.641489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:35.641489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:35.641489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:35.641489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:35.641489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:35.641489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:35.641489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:35.641489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:35.641489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:35.641489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:35.642307 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:35.642307 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:35.642307 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:35.642307 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:35.642307 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:35.642307 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:35.642307 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:35.642307 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:35.642307 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:35.642307 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:35.642307 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 15:18:35.642307 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:35.642307 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 171/354] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:35.643633 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8aff9f-c88c-4ebb-8c2f-07e022dd5d57 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:35.669679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c37ab-4f3a-4b42-af23-334dea04a5ba None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:35.708179 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342455e-6aff-45b9-9fe7-84997e821e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:35.709910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342455e-6aff-45b9-9fe7-84997e821e4c None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:35.710403 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342455e-6aff-45b9-9fe7-84997e821e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:35.710885 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342455e-6aff-45b9-9fe7-84997e821e4c None admin] PATH_INFO: `/v3/groups/fbfc0ee38bd44cbcb5a1c469ff975534` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:35.712355 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342455e-6aff-45b9-9fe7-84997e821e4c None admin] RBAC: Authorizing `identity:get_group(group_id=fbfc0ee38bd44cbcb5a1c469ff975534)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:35.714037 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342455e-6aff-45b9-9fe7-84997e821e4c None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:35.716119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 184/355] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jul 19 15:18:35 2022] GET /identity/v3/groups/fbfc0ee38bd44cbcb5a1c469ff975534 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:35.717200 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342455e-6aff-45b9-9fe7-84997e821e4c None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:35.721345 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:35.753000 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:35.764624 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8aff9f-c88c-4ebb-8c2f-07e022dd5d57 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:35.803425 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066c10c-cdc7-48d9-9fe1-7a05c1ee64b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:35.804121 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066c10c-cdc7-48d9-9fe1-7a05c1ee64b1 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:35.804409 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066c10c-cdc7-48d9-9fe1-7a05c1ee64b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:35.804691 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066c10c-cdc7-48d9-9fe1-7a05c1ee64b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:35.805458 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066c10c-cdc7-48d9-9fe1-7a05c1ee64b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:35.805770 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066c10c-cdc7-48d9-9fe1-7a05c1ee64b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:35.807151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066c10c-cdc7-48d9-9fe1-7a05c1ee64b1 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:35.817057 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 172/356] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 19 15:18:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:35.817944 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066c10c-cdc7-48d9-9fe1-7a05c1ee64b1 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:35.840188 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342455e-6aff-45b9-9fe7-84997e821e4c None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:35.884764 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d931f-f7e8-43ba-9a5b-82641237a685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:35.885862 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d931f-f7e8-43ba-9a5b-82641237a685 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:35.886353 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d931f-f7e8-43ba-9a5b-82641237a685 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:35.886853 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d931f-f7e8-43ba-9a5b-82641237a685 None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:35.887947 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d931f-f7e8-43ba-9a5b-82641237a685 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:35.888464 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d931f-f7e8-43ba-9a5b-82641237a685 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:35.890071 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d931f-f7e8-43ba-9a5b-82641237a685 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:35.899693 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 185/357] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 19 15:18:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:35.900928 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d931f-f7e8-43ba-9a5b-82641237a685 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:35.934717 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066c10c-cdc7-48d9-9fe1-7a05c1ee64b1 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:35.972353 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ce0b4-6a56-407b-8843-87dd01c175ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:35.973319 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ce0b4-6a56-407b-8843-87dd01c175ac None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:35.974528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ce0b4-6a56-407b-8843-87dd01c175ac None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:35.975177 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ce0b4-6a56-407b-8843-87dd01c175ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:35.975502 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:35.977143 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ce0b4-6a56-407b-8843-87dd01c175ac None admin] RBAC: Adding query filter params (group.id=fbfc0ee38bd44cbcb5a1c469ff975534, role.id=ff311e825f2b4a3d809aa772f6cdecb0, scope.project.id=76392ff9ad244418a55302f0aa823f92) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:35.977659 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ce0b4-6a56-407b-8843-87dd01c175ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:35.979411 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ce0b4-6a56-407b-8843-87dd01c175ac None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:35.986211 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 173/358] 10.222.0.44 () {56 vars in 1376 bytes} [Tue Jul 19 15:18:35 2022] GET /identity/v3/role_assignments?group.id=fbfc0ee38bd44cbcb5a1c469ff975534&scope.project.id=76392ff9ad244418a55302f0aa823f92&role.id=ff311e825f2b4a3d809aa772f6cdecb0 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:35.987341 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ce0b4-6a56-407b-8843-87dd01c175ac None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:36.010252 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:36.029633 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d931f-f7e8-43ba-9a5b-82641237a685 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:36.081782 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2ed61-a635-4bc9-9748-07d0d75964cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:36.083438 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2ed61-a635-4bc9-9748-07d0d75964cf None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:36.083964 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2ed61-a635-4bc9-9748-07d0d75964cf None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:36.084258 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2ed61-a635-4bc9-9748-07d0d75964cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:36.126308 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ce0b4-6a56-407b-8843-87dd01c175ac None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:36.167729 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198f31c-197c-4f95-8726-df1a7374f7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:36.169000 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198f31c-197c-4f95-8726-df1a7374f7a2 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:36.169547 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198f31c-197c-4f95-8726-df1a7374f7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:36.170041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198f31c-197c-4f95-8726-df1a7374f7a2 None admin] PATH_INFO: `/v3/users/1e96c8ab5e384ba78b4e4f094332eb3f` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:36.171626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2198f31c-197c-4f95-8726-df1a7374f7a2 None admin] RBAC: Authorizing `identity:get_user(user_id=1e96c8ab5e384ba78b4e4f094332eb3f)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:36.173321 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2198f31c-197c-4f95-8726-df1a7374f7a2 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:36.175630 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 174/359] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:18:35 2022] GET /identity/v3/users/1e96c8ab5e384ba78b4e4f094332eb3f => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:36.177842 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e09f8-5af2-433f-9514-1b5f9835c7b2 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:36.178350 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e09f8-5af2-433f-9514-1b5f9835c7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:36.178835 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e09f8-5af2-433f-9514-1b5f9835c7b2 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:36.180847 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 175/360] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:36.181835 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e09f8-5af2-433f-9514-1b5f9835c7b2 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:36.184452 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2ed61-a635-4bc9-9748-07d0d75964cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:36.185773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2ed61-a635-4bc9-9748-07d0d75964cf None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:36.261519 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:36.285992 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:36.306326 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 186/361] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:18:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:18:36.307112 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e09f8-5af2-433f-9514-1b5f9835c7b2 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:36.307560 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9e09f-7624-4d45-b096-bca77ba30215 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:36.307856 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9e09f-7624-4d45-b096-bca77ba30215 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:36.308139 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9e09f-7624-4d45-b096-bca77ba30215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:36.327151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-eff9e09f-7624-4d45-b096-bca77ba30215 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:36.328404 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-eff9e09f-7624-4d45-b096-bca77ba30215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:36.348093 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e379e-b2b5-441e-90d6-360088229959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:36.349689 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e379e-b2b5-441e-90d6-360088229959 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:36.350191 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e379e-b2b5-441e-90d6-360088229959 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:36.350679 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e379e-b2b5-441e-90d6-360088229959 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:36.351775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e379e-b2b5-441e-90d6-360088229959 None admin] RBAC: Adding query filter params (role.id=d528f237588f49489344fe727d4662e5, user.id=1e96c8ab5e384ba78b4e4f094332eb3f, scope.system=all) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:36.352332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e379e-b2b5-441e-90d6-360088229959 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:36.353980 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e379e-b2b5-441e-90d6-360088229959 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:36.369560 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 176/362] 10.222.0.44 () {56 vars in 1308 bytes} [Tue Jul 19 15:18:36 2022] GET /identity/v3/role_assignments?user.id=1e96c8ab5e384ba78b4e4f094332eb3f&scope.system=all&role.id=d528f237588f49489344fe727d4662e5 => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:36.370814 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e379e-b2b5-441e-90d6-360088229959 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:36.409696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 187/363] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:36.434512 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9e09f-7624-4d45-b096-bca77ba30215 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:36.493956 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e379e-b2b5-441e-90d6-360088229959 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:36.533966 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a57d7-5430-4266-90c8-b3c1da550296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:36.535281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a57d7-5430-4266-90c8-b3c1da550296 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:36.535853 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a57d7-5430-4266-90c8-b3c1da550296 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:36.536886 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a57d7-5430-4266-90c8-b3c1da550296 None admin] PATH_INFO: `/v3/projects/057eacfe69e5438fae88b82be96b147a` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:36.538471 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a57d7-5430-4266-90c8-b3c1da550296 None admin] RBAC: Authorizing `identity:get_project(project_id=057eacfe69e5438fae88b82be96b147a)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:36.540198 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a57d7-5430-4266-90c8-b3c1da550296 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:36.542271 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 177/364] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:36 2022] GET /identity/v3/projects/057eacfe69e5438fae88b82be96b147a => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:36.548898 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:36.550298 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a57d7-5430-4266-90c8-b3c1da550296 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:36.559613 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9e09f-7624-4d45-b096-bca77ba30215 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:36.571986 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:36.603536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468bd42-5221-47a6-809e-c5a780255e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:36.604931 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468bd42-5221-47a6-809e-c5a780255e48 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:36.605224 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468bd42-5221-47a6-809e-c5a780255e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:36.605557 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468bd42-5221-47a6-809e-c5a780255e48 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:36.618087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468bd42-5221-47a6-809e-c5a780255e48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:36.626603 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-4468bd42-5221-47a6-809e-c5a780255e48 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:18:36.626603 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:36.626603 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:36.626603 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:36.626603 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:36.626603 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:36.626603 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:36.626603 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:36.626603 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:36.626603 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:36.626603 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:36.626603 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:36.626603 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:36.626603 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:36.626603 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:36.626603 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:36.628041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:36.628041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:36.628041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:36.628041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:36.628041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:36.628041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:36.628041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:36.628041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:36.628041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:36.628041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:36.628041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:36.628041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:36.628041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:36.628041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:36.628041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:36.628041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:36.628862 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:36.628862 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:36.628862 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:36.628862 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:36.628862 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:36.628862 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:36.628862 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:36.628862 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:36.628862 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:36.628862 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:36.628862 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:18:36.628862 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:36.628862 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 188/365] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 19 15:18:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:18:36.631312 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5ae03-8b58-42c7-b69d-e28006379a4e None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:36.631312 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5ae03-8b58-42c7-b69d-e28006379a4e None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:36.631312 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5ae03-8b58-42c7-b69d-e28006379a4e None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:36.635360 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 189/366] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:36.636480 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5ae03-8b58-42c7-b69d-e28006379a4e None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:36.702995 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a57d7-5430-4266-90c8-b3c1da550296 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:36.753909 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893340c6-28ca-4123-8623-d3b5de8c9a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:36.756816 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893340c6-28ca-4123-8623-d3b5de8c9a36 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:36.757437 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893340c6-28ca-4123-8623-d3b5de8c9a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:36.757916 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893340c6-28ca-4123-8623-d3b5de8c9a36 None admin] PATH_INFO: `/v3/groups/fbfc0ee38bd44cbcb5a1c469ff975534` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:36.760115 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893340c6-28ca-4123-8623-d3b5de8c9a36 None admin] RBAC: Authorizing `identity:get_group(group_id=fbfc0ee38bd44cbcb5a1c469ff975534)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:36.762163 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893340c6-28ca-4123-8623-d3b5de8c9a36 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:36.765116 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 178/367] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jul 19 15:18:36 2022] GET /identity/v3/groups/fbfc0ee38bd44cbcb5a1c469ff975534 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:36.766523 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6a2e5-f3d1-4658-8c08-058b7bbfa786 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:36.766981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6a2e5-f3d1-4658-8c08-058b7bbfa786 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:36.767449 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6a2e5-f3d1-4658-8c08-058b7bbfa786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:36.781628 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5ae03-8b58-42c7-b69d-e28006379a4e None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:36.790913 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-7fa6a2e5-f3d1-4658-8c08-058b7bbfa786 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:36.792402 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-7fa6a2e5-f3d1-4658-8c08-058b7bbfa786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:36.823189 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b096e-0293-460d-a6d7-7eb05c578be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:36.824042 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b096e-0293-460d-a6d7-7eb05c578be7 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:36.825410 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b096e-0293-460d-a6d7-7eb05c578be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:36.825766 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b096e-0293-460d-a6d7-7eb05c578be7 None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:36.826830 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b096e-0293-460d-a6d7-7eb05c578be7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:36.827237 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b096e-0293-460d-a6d7-7eb05c578be7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:36.828709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b096e-0293-460d-a6d7-7eb05c578be7 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:36.838335 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 190/368] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:18:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:36.839175 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b096e-0293-460d-a6d7-7eb05c578be7 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:36.875310 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:36.901082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 179/369] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:36.902411 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6a2e5-f3d1-4658-8c08-058b7bbfa786 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:36.918550 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:37.013149 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b096e-0293-460d-a6d7-7eb05c578be7 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:37.040549 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6a2e5-f3d1-4658-8c08-058b7bbfa786 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:37.055032 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43754dd-f5c3-4ce0-a60b-6f501ac7999e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:37.056126 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43754dd-f5c3-4ce0-a60b-6f501ac7999e None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:37.056618 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43754dd-f5c3-4ce0-a60b-6f501ac7999e None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:37.057100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43754dd-f5c3-4ce0-a60b-6f501ac7999e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:37.058252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43754dd-f5c3-4ce0-a60b-6f501ac7999e None admin] RBAC: Adding query filter params (group.id=fbfc0ee38bd44cbcb5a1c469ff975534, role.id=ff311e825f2b4a3d809aa772f6cdecb0, scope.project.id=057eacfe69e5438fae88b82be96b147a) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:37.058938 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43754dd-f5c3-4ce0-a60b-6f501ac7999e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:37.061342 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43754dd-f5c3-4ce0-a60b-6f501ac7999e None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:37.068029 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 191/370] 10.222.0.44 () {56 vars in 1376 bytes} [Tue Jul 19 15:18:36 2022] GET /identity/v3/role_assignments?group.id=fbfc0ee38bd44cbcb5a1c469ff975534&scope.project.id=057eacfe69e5438fae88b82be96b147a&role.id=ff311e825f2b4a3d809aa772f6cdecb0 => generated 260 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:37.069438 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43754dd-f5c3-4ce0-a60b-6f501ac7999e None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:37.084666 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b963753-6666-4d01-8147-eedef6624a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:37.085436 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b963753-6666-4d01-8147-eedef6624a96 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:37.085724 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b963753-6666-4d01-8147-eedef6624a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:37.086003 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b963753-6666-4d01-8147-eedef6624a96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:37.175784 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:37.190402 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b963753-6666-4d01-8147-eedef6624a96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:37.191531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b963753-6666-4d01-8147-eedef6624a96 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:37.205808 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43754dd-f5c3-4ce0-a60b-6f501ac7999e None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:37.208778 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:37.280359 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e8230-a3dc-4d25-afc0-ac8a4b714df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:37.281198 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e8230-a3dc-4d25-afc0-ac8a4b714df3 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:37.281480 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e8230-a3dc-4d25-afc0-ac8a4b714df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:37.281749 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e8230-a3dc-4d25-afc0-ac8a4b714df3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:37.312409 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e8230-a3dc-4d25-afc0-ac8a4b714df3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:37.320790 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-764e8230-a3dc-4d25-afc0-ac8a4b714df3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:18:37.320790 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:37.320790 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:37.320790 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:37.320790 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:37.320790 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:37.320790 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:37.320790 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:37.320790 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:37.320790 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:37.320790 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:37.320790 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:37.320790 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:37.320790 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:37.320790 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:37.320790 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:37.321788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:37.321788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:37.321788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:37.321788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:37.321788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:37.321788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:37.321788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:37.321788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:37.321788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:37.321788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:37.321788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:37.321788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:37.321788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:37.321788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:37.321788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:37.321788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:37.322633 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:37.322633 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:37.322633 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:37.322633 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:37.322633 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:37.322633 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:37.322633 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:37.322633 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:37.322633 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:37.322633 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:37.322633 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:18:37.322633 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:37.327699 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 192/371] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:18:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:37.330492 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 180/372] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:18:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:18:37.334910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e8230-a3dc-4d25-afc0-ac8a4b714df3 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:37.335899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b963753-6666-4d01-8147-eedef6624a96 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:37.482173 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b963753-6666-4d01-8147-eedef6624a96 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:37.508330 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:37.524306 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e8230-a3dc-4d25-afc0-ac8a4b714df3 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:37.557859 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6c620-9981-4015-b552-b936f821452b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:37.559672 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6c620-9981-4015-b552-b936f821452b None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:37.560428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6c620-9981-4015-b552-b936f821452b None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:37.560911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6c620-9981-4015-b552-b936f821452b None admin] PATH_INFO: `/v3/projects/057eacfe69e5438fae88b82be96b147a` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:37.562772 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6c620-9981-4015-b552-b936f821452b None admin] RBAC: Authorizing `identity:get_project(project_id=057eacfe69e5438fae88b82be96b147a)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:37.565688 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6c620-9981-4015-b552-b936f821452b None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:37.568189 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 181/373] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:37 2022] GET /identity/v3/projects/057eacfe69e5438fae88b82be96b147a => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:37.574628 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6c620-9981-4015-b552-b936f821452b None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:37.586974 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50e69e-225d-4ea1-9262-4d246011961c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:37.588092 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50e69e-225d-4ea1-9262-4d246011961c None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:37.588598 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50e69e-225d-4ea1-9262-4d246011961c None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:37.589087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50e69e-225d-4ea1-9262-4d246011961c None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:37.590091 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50e69e-225d-4ea1-9262-4d246011961c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:37.590622 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50e69e-225d-4ea1-9262-4d246011961c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:37.592284 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50e69e-225d-4ea1-9262-4d246011961c None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:37.615675 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 193/374] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:37.619643 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50e69e-225d-4ea1-9262-4d246011961c None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:37.633959 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:37.771579 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6c620-9981-4015-b552-b936f821452b None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:37.775034 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50e69e-225d-4ea1-9262-4d246011961c None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:37.826943 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9914ad1-069b-4449-abc6-7eb5c25c1257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:37.827889 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9914ad1-069b-4449-abc6-7eb5c25c1257 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:37.828177 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9914ad1-069b-4449-abc6-7eb5c25c1257 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:37.828458 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9914ad1-069b-4449-abc6-7eb5c25c1257 None admin] PATH_INFO: `/v3/groups/fbfc0ee38bd44cbcb5a1c469ff975534` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:37.830603 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9914ad1-069b-4449-abc6-7eb5c25c1257 None admin] RBAC: Authorizing `identity:get_group(group_id=fbfc0ee38bd44cbcb5a1c469ff975534)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:37.832132 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9914ad1-069b-4449-abc6-7eb5c25c1257 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:37.834396 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 182/375] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jul 19 15:18:37 2022] GET /identity/v3/groups/fbfc0ee38bd44cbcb5a1c469ff975534 => generated 226 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:37.843473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e85c6-4b19-4351-b901-69c5e6ccd5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:37.844130 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e85c6-4b19-4351-b901-69c5e6ccd5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:37.844425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e85c6-4b19-4351-b901-69c5e6ccd5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:37.844705 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e85c6-4b19-4351-b901-69c5e6ccd5f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:37.846274 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9914ad1-069b-4449-abc6-7eb5c25c1257 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:37.917443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:37.978778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e85c6-4b19-4351-b901-69c5e6ccd5f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:37.980296 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e85c6-4b19-4351-b901-69c5e6ccd5f1 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:37.984395 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9914ad1-069b-4449-abc6-7eb5c25c1257 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:37.988452 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:38.028253 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6ee40-d191-4e52-b370-356c07bc6504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:38.028929 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6ee40-d191-4e52-b370-356c07bc6504 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:38.029215 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6ee40-d191-4e52-b370-356c07bc6504 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:38.029494 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6ee40-d191-4e52-b370-356c07bc6504 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:38.030614 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6ee40-d191-4e52-b370-356c07bc6504 None admin] RBAC: Adding query filter params (group.id=fbfc0ee38bd44cbcb5a1c469ff975534, role.id=361f7a146e9b47e997cf572bae05c96e, scope.project.id=057eacfe69e5438fae88b82be96b147a) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:38.030932 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6ee40-d191-4e52-b370-356c07bc6504 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:38.032411 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6ee40-d191-4e52-b370-356c07bc6504 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:38.041683 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 183/376] 10.222.0.44 () {56 vars in 1376 bytes} [Tue Jul 19 15:18:37 2022] GET /identity/v3/role_assignments?group.id=fbfc0ee38bd44cbcb5a1c469ff975534&scope.project.id=057eacfe69e5438fae88b82be96b147a&role.id=361f7a146e9b47e997cf572bae05c96e => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:38.138876 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 194/377] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:18:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:18:38.144981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6ee40-d191-4e52-b370-356c07bc6504 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:38.277054 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6ee40-d191-4e52-b370-356c07bc6504 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:38.290345 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:38.323912 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdffbdf2-1784-467f-9c8a-87f5f6acf83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:38.325343 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffbdf2-1784-467f-9c8a-87f5f6acf83f None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:38.325837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffbdf2-1784-467f-9c8a-87f5f6acf83f None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:38.326306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffbdf2-1784-467f-9c8a-87f5f6acf83f None admin] PATH_INFO: `/v3/projects/32cd8d80a1f1402daab4eabadc4fd0b7` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:38.329794 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdffbdf2-1784-467f-9c8a-87f5f6acf83f None admin] RBAC: Authorizing `identity:get_project(project_id=32cd8d80a1f1402daab4eabadc4fd0b7)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:38.331542 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdffbdf2-1784-467f-9c8a-87f5f6acf83f None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:38.333560 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 184/378] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:38 2022] GET /identity/v3/projects/32cd8d80a1f1402daab4eabadc4fd0b7 => generated 344 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:38.339469 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e85c6-4b19-4351-b901-69c5e6ccd5f1 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:38.477953 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e85c6-4b19-4351-b901-69c5e6ccd5f1 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:38.485428 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:38.531137 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53364495-063c-4391-9da9-8f43647cbd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:38.532843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53364495-063c-4391-9da9-8f43647cbd74 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:38.533442 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53364495-063c-4391-9da9-8f43647cbd74 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:38.533926 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53364495-063c-4391-9da9-8f43647cbd74 None admin] PATH_INFO: `/v3/groups/cea160a8501b468baaa45feef104888a` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:38.544715 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53364495-063c-4391-9da9-8f43647cbd74 None admin] RBAC: Authorizing `identity:get_group(group_id=cea160a8501b468baaa45feef104888a)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:38.546581 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53364495-063c-4391-9da9-8f43647cbd74 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:38.548566 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 195/379] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jul 19 15:18:38 2022] GET /identity/v3/groups/cea160a8501b468baaa45feef104888a => generated 229 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:38.555001 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdffbdf2-1784-467f-9c8a-87f5f6acf83f None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:38.724057 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdffbdf2-1784-467f-9c8a-87f5f6acf83f None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:38.773477 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274490f-f83f-4634-a549-973b72492387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:38.774087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274490f-f83f-4634-a549-973b72492387 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:38.774342 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274490f-f83f-4634-a549-973b72492387 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:38.774616 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274490f-f83f-4634-a549-973b72492387 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:38.775505 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274490f-f83f-4634-a549-973b72492387 None admin] RBAC: Adding query filter params (group.id=cea160a8501b468baaa45feef104888a, role.id=d884ddf33c1440d9b3a3351b85e83e76, scope.project.id=32cd8d80a1f1402daab4eabadc4fd0b7) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:38.775818 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274490f-f83f-4634-a549-973b72492387 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:38.777264 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274490f-f83f-4634-a549-973b72492387 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:38.785972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 185/380] 10.222.0.44 () {56 vars in 1376 bytes} [Tue Jul 19 15:18:38 2022] GET /identity/v3/role_assignments?group.id=cea160a8501b468baaa45feef104888a&scope.project.id=32cd8d80a1f1402daab4eabadc4fd0b7&role.id=d884ddf33c1440d9b3a3351b85e83e76 => generated 260 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:39.009629 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189a422-fad8-4a5c-b2dc-6d02856f384c None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:39.010625 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189a422-fad8-4a5c-b2dc-6d02856f384c None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:39.011140 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189a422-fad8-4a5c-b2dc-6d02856f384c None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:39.013084 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 196/381] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:39.018314 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5d8c5-583d-4f1a-92b9-0ec68fc969fe None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:39.018598 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5d8c5-583d-4f1a-92b9-0ec68fc969fe None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:39.019043 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5d8c5-583d-4f1a-92b9-0ec68fc969fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:39.043173 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-abc5d8c5-583d-4f1a-92b9-0ec68fc969fe None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:39.044644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-abc5d8c5-583d-4f1a-92b9-0ec68fc969fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:39.090863 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:39.128811 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 186/382] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:39.163723 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189a422-fad8-4a5c-b2dc-6d02856f384c None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:39.249239 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d18592-fb9b-4846-a645-9a712ffa2d1b None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:39.249800 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d18592-fb9b-4846-a645-9a712ffa2d1b None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:39.250224 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d18592-fb9b-4846-a645-9a712ffa2d1b None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:39.251796 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 187/383] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:18:39.257554 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b168d-76e5-4f11-8a98-9525b6bf94f8 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:39.258067 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b168d-76e5-4f11-8a98-9525b6bf94f8 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:39.258489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b168d-76e5-4f11-8a98-9525b6bf94f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:39.296387 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-898b168d-76e5-4f11-8a98-9525b6bf94f8 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:39.297834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-898b168d-76e5-4f11-8a98-9525b6bf94f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:39.308741 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189a422-fad8-4a5c-b2dc-6d02856f384c None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:39.355991 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41873ee8-15dd-4804-9041-04029ba7ec3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:39.357075 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41873ee8-15dd-4804-9041-04029ba7ec3d None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:39.357510 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41873ee8-15dd-4804-9041-04029ba7ec3d None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:39.357940 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41873ee8-15dd-4804-9041-04029ba7ec3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:39.382215 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41873ee8-15dd-4804-9041-04029ba7ec3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:39.396444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-41873ee8-15dd-4804-9041-04029ba7ec3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:39.396444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:39.396444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:39.396444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:39.396444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:39.396444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:39.396444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:39.396444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:39.396444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:39.396444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:39.396444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:39.396444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:39.396444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:39.396444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:39.396444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:39.396444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:39.397602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:39.397602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:39.397602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:39.397602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:39.397602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:39.397602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:39.397602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:39.397602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:39.397602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:39.397602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:39.397602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:39.397602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:39.397602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:39.397602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:39.397602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:39.397602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:39.398423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:39.398423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:39.398423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:39.398423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:39.398423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:39.398423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:39.398423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:39.398423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:39.398423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:39.398423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:39.398423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:39.398423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:39.400922 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 197/384] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:39.408742 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41873ee8-15dd-4804-9041-04029ba7ec3d None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:39.454939 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 188/385] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:39.468004 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:39.494330 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b168d-76e5-4f11-8a98-9525b6bf94f8 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:39.627142 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41873ee8-15dd-4804-9041-04029ba7ec3d None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:39.627484 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b168d-76e5-4f11-8a98-9525b6bf94f8 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:39.631340 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:39.675785 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d1e19-5b3a-4b56-b7a7-6e34bdb16a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:39.677083 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d1e19-5b3a-4b56-b7a7-6e34bdb16a52 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:39.678163 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d1e19-5b3a-4b56-b7a7-6e34bdb16a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:39.678743 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d1e19-5b3a-4b56-b7a7-6e34bdb16a52 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:39.695647 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d1e19-5b3a-4b56-b7a7-6e34bdb16a52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:39.698795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31954327-3395-4407-b291-63cfc2c78ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:39.699977 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31954327-3395-4407-b291-63cfc2c78ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:39.700440 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31954327-3395-4407-b291-63cfc2c78ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:39.700876 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31954327-3395-4407-b291-63cfc2c78ed1 None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:39.701876 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31954327-3395-4407-b291-63cfc2c78ed1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:39.702342 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31954327-3395-4407-b291-63cfc2c78ed1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:39.704032 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31954327-3395-4407-b291-63cfc2c78ed1 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:39.704243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-181d1e19-5b3a-4b56-b7a7-6e34bdb16a52 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:18:39.704243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:39.704243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:39.704243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:39.704243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:39.704243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:39.704243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:39.704243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:39.704243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:39.704243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:39.704243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:39.704243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:39.704243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:39.704243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:39.704243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:39.704243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:39.705300 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:39.705300 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:39.705300 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:39.705300 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:39.705300 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:39.705300 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:39.705300 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:39.705300 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:39.705300 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:39.705300 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:39.705300 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:39.705300 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:39.705300 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:39.705300 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:39.705300 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:39.705300 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:39.706269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:39.706269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:39.706269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:39.706269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:39.706269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:39.706269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:39.706269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:39.706269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:39.706269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:39.706269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:39.706269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:18:39.706269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:39.709536 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 189/386] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 19 15:18:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:18:39.716449 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d1e19-5b3a-4b56-b7a7-6e34bdb16a52 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:39.730733 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 198/387] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 19 15:18:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:39.736427 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31954327-3395-4407-b291-63cfc2c78ed1 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:39.949660 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:39.955855 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d1e19-5b3a-4b56-b7a7-6e34bdb16a52 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:39.972048 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31954327-3395-4407-b291-63cfc2c78ed1 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:40.031179 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e8d4e-7d7a-41e1-94be-51d3779c9dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:40.032072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e8d4e-7d7a-41e1-94be-51d3779c9dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:40.032355 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e8d4e-7d7a-41e1-94be-51d3779c9dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:40.033410 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e8d4e-7d7a-41e1-94be-51d3779c9dd5 None admin] PATH_INFO: `/v3/groups/fbfc0ee38bd44cbcb5a1c469ff975534` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:40.034109 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e8d4e-7d7a-41e1-94be-51d3779c9dd5 None admin] RBAC: Authorizing `identity:get_group(group_id=fbfc0ee38bd44cbcb5a1c469ff975534)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:40.035562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e8d4e-7d7a-41e1-94be-51d3779c9dd5 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:40.037685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 199/388] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jul 19 15:18:39 2022] GET /identity/v3/groups/fbfc0ee38bd44cbcb5a1c469ff975534 => generated 226 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:40.038550 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ffe31-7c25-41e9-9a3d-d9dccc0a015f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:40.039371 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca51f6b-edf3-48ca-ab98-5e6674becf95 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:40.039499 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ffe31-7c25-41e9-9a3d-d9dccc0a015f None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:40.039852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ffe31-7c25-41e9-9a3d-d9dccc0a015f None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:40.040129 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca51f6b-edf3-48ca-ab98-5e6674becf95 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:40.040326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ffe31-7c25-41e9-9a3d-d9dccc0a015f None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:40.040707 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca51f6b-edf3-48ca-ab98-5e6674becf95 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:40.041312 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ffe31-7c25-41e9-9a3d-d9dccc0a015f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:40.041853 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ffe31-7c25-41e9-9a3d-d9dccc0a015f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:40.043417 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ffe31-7c25-41e9-9a3d-d9dccc0a015f None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:40.043975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 200/389] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:40.045447 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca51f6b-edf3-48ca-ab98-5e6674becf95 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:40.063710 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 190/390] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:18:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:40.065413 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d2512-a350-4a42-830c-aa295a48a43b None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:40.065924 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d2512-a350-4a42-830c-aa295a48a43b None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:40.066415 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d2512-a350-4a42-830c-aa295a48a43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:40.085971 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-882d2512-a350-4a42-830c-aa295a48a43b None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:40.088739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-882d2512-a350-4a42-830c-aa295a48a43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:40.109111 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:40.171359 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 191/391] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:40.172593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d2512-a350-4a42-830c-aa295a48a43b None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:40.183579 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca51f6b-edf3-48ca-ab98-5e6674becf95 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:40.230154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bb7cd-4396-406e-9923-e25e89354fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:40.230625 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bb7cd-4396-406e-9923-e25e89354fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:40.230909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bb7cd-4396-406e-9923-e25e89354fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:40.231188 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bb7cd-4396-406e-9923-e25e89354fb9 None admin] PATH_INFO: `/v3/projects/76392ff9ad244418a55302f0aa823f92` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:40.233720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89bb7cd-4396-406e-9923-e25e89354fb9 None admin] RBAC: Authorizing `identity:get_project(project_id=76392ff9ad244418a55302f0aa823f92)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:40.233962 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89bb7cd-4396-406e-9923-e25e89354fb9 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:40.235709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 201/392] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:40 2022] GET /identity/v3/projects/76392ff9ad244418a55302f0aa823f92 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:40.236470 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bb7cd-4396-406e-9923-e25e89354fb9 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:40.279693 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:40.323358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d2512-a350-4a42-830c-aa295a48a43b None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:40.377051 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca4d4f-d73d-41cf-a77b-18e30eaf6562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:40.378128 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca4d4f-d73d-41cf-a77b-18e30eaf6562 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:40.378518 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca4d4f-d73d-41cf-a77b-18e30eaf6562 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:40.378805 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca4d4f-d73d-41cf-a77b-18e30eaf6562 None admin] PATH_INFO: `/v3/groups/fbfc0ee38bd44cbcb5a1c469ff975534` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:40.382908 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca4d4f-d73d-41cf-a77b-18e30eaf6562 None admin] RBAC: Authorizing `identity:get_group(group_id=fbfc0ee38bd44cbcb5a1c469ff975534)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:40.385020 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca4d4f-d73d-41cf-a77b-18e30eaf6562 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:40.391343 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 192/393] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jul 19 15:18:40 2022] GET /identity/v3/groups/fbfc0ee38bd44cbcb5a1c469ff975534 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:40.391343 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca4d4f-d73d-41cf-a77b-18e30eaf6562 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:40.397075 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bb7cd-4396-406e-9923-e25e89354fb9 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:40.425558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:40.455997 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1be8be-95c4-420d-9d72-96f68a79e94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:40.457326 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1be8be-95c4-420d-9d72-96f68a79e94f None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:40.458130 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1be8be-95c4-420d-9d72-96f68a79e94f None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:40.459175 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1be8be-95c4-420d-9d72-96f68a79e94f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:40.479172 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1be8be-95c4-420d-9d72-96f68a79e94f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:40.492189 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-5f1be8be-95c4-420d-9d72-96f68a79e94f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:40.492189 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:40.492189 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:40.492189 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:40.492189 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:40.492189 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:40.492189 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:40.492189 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:40.492189 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:40.492189 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:40.492189 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:40.492189 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:40.492189 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:40.492189 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:40.492189 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:40.492189 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:40.493098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:40.493098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:40.493098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:40.493098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:40.493098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:40.493098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:40.493098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:40.493098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:40.493098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:40.493098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:40.493098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:40.493098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:40.493098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:40.493098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:40.493098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:40.493098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:40.493909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:40.493909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:40.493909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:40.493909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:40.493909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:40.493909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:40.493909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:40.493909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:40.493909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:40.493909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:40.493909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:40.493909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:40.503300 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 202/394] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:40.505775 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1be8be-95c4-420d-9d72-96f68a79e94f None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:40.532492 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca4d4f-d73d-41cf-a77b-18e30eaf6562 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:40.569497 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1eb16-b609-40b6-acb1-edf598931195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:40.570763 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1eb16-b609-40b6-acb1-edf598931195 None admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:40.571295 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1eb16-b609-40b6-acb1-edf598931195 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:40.571778 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1eb16-b609-40b6-acb1-edf598931195 None admin] PATH_INFO: `/v3/projects/76392ff9ad244418a55302f0aa823f92/groups/fbfc0ee38bd44cbcb5a1c469ff975534/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:40.574030 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1eb16-b609-40b6-acb1-edf598931195 None admin] RBAC: Authorizing `identity:create_grant(project_id=76392ff9ad244418a55302f0aa823f92, group_id=fbfc0ee38bd44cbcb5a1c469ff975534, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:40.575796 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1eb16-b609-40b6-acb1-edf598931195 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:40.591453 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 193/395] 10.222.0.44 () {58 vars in 1442 bytes} [Tue Jul 19 15:18:40 2022] PUT /identity/v3/projects/76392ff9ad244418a55302f0aa823f92/groups/fbfc0ee38bd44cbcb5a1c469ff975534/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:18:40.592830 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1eb16-b609-40b6-acb1-edf598931195 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:40.608236 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:40.632076 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1be8be-95c4-420d-9d72-96f68a79e94f None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:40.684327 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede699ee-eb15-4fe8-b294-8f92cdce3064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:40.685861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede699ee-eb15-4fe8-b294-8f92cdce3064 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:40.686388 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede699ee-eb15-4fe8-b294-8f92cdce3064 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:40.686909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede699ee-eb15-4fe8-b294-8f92cdce3064 None admin] PATH_INFO: `/v3/projects/76392ff9ad244418a55302f0aa823f92` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:40.689248 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede699ee-eb15-4fe8-b294-8f92cdce3064 None admin] RBAC: Authorizing `identity:get_project(project_id=76392ff9ad244418a55302f0aa823f92)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:40.691443 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede699ee-eb15-4fe8-b294-8f92cdce3064 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:40.694129 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 203/396] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:40 2022] GET /identity/v3/projects/76392ff9ad244418a55302f0aa823f92 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:40.701867 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede699ee-eb15-4fe8-b294-8f92cdce3064 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:40.731406 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:40.777511 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1eb16-b609-40b6-acb1-edf598931195 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:40.834423 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f685e1-7fd2-418c-b786-c82d5ed2895c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:40.840904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f685e1-7fd2-418c-b786-c82d5ed2895c None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:40.841474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f685e1-7fd2-418c-b786-c82d5ed2895c None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:40.842069 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f685e1-7fd2-418c-b786-c82d5ed2895c None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:40.843170 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f685e1-7fd2-418c-b786-c82d5ed2895c None admin] RBAC: Adding query filter params (name=member) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:40.843740 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f685e1-7fd2-418c-b786-c82d5ed2895c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:40.845649 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f685e1-7fd2-418c-b786-c82d5ed2895c None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:40.845781 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede699ee-eb15-4fe8-b294-8f92cdce3064 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:40.862721 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 194/397] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 19 15:18:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:40.864623 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb8b18-97fa-485b-bc20-3779a768f89b None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:40.864919 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb8b18-97fa-485b-bc20-3779a768f89b None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:40.865198 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb8b18-97fa-485b-bc20-3779a768f89b None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:40.866606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 195/398] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:40.870315 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb8b18-97fa-485b-bc20-3779a768f89b None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:40.893793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e292b-e4cf-4581-8425-0ddcd2f1e1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:40.894721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e292b-e4cf-4581-8425-0ddcd2f1e1d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:40.895014 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e292b-e4cf-4581-8425-0ddcd2f1e1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:40.895352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e292b-e4cf-4581-8425-0ddcd2f1e1d6 None admin] PATH_INFO: `/v3/projects/76392ff9ad244418a55302f0aa823f92/groups/fbfc0ee38bd44cbcb5a1c469ff975534/roles/361f7a146e9b47e997cf572bae05c96e` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:40.898205 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e292b-e4cf-4581-8425-0ddcd2f1e1d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=76392ff9ad244418a55302f0aa823f92, group_id=fbfc0ee38bd44cbcb5a1c469ff975534, role_id=361f7a146e9b47e997cf572bae05c96e)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:40.899693 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e292b-e4cf-4581-8425-0ddcd2f1e1d6 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:40.929471 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 204/399] 10.222.0.44 () {58 vars in 1442 bytes} [Tue Jul 19 15:18:40 2022] PUT /identity/v3/projects/76392ff9ad244418a55302f0aa823f92/groups/fbfc0ee38bd44cbcb5a1c469ff975534/roles/361f7a146e9b47e997cf572bae05c96e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:18:40.931164 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877f2c7-428c-45d4-9de3-a1fab466043f None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:40.931712 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877f2c7-428c-45d4-9de3-a1fab466043f None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:40.932187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877f2c7-428c-45d4-9de3-a1fab466043f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:40.957823 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-d877f2c7-428c-45d4-9de3-a1fab466043f None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:40.960385 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-d877f2c7-428c-45d4-9de3-a1fab466043f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:40.981003 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:41.078215 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb8b18-97fa-485b-bc20-3779a768f89b None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:41.116235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 205/400] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:41.137277 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b1260-dea8-4a70-83db-7f647e9a1246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:41.138544 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b1260-dea8-4a70-83db-7f647e9a1246 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:41.139037 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b1260-dea8-4a70-83db-7f647e9a1246 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:41.139538 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b1260-dea8-4a70-83db-7f647e9a1246 None admin] PATH_INFO: `/v3/groups/fbfc0ee38bd44cbcb5a1c469ff975534` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:41.141079 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b1260-dea8-4a70-83db-7f647e9a1246 None admin] RBAC: Authorizing `identity:get_group(group_id=fbfc0ee38bd44cbcb5a1c469ff975534)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:41.142799 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b1260-dea8-4a70-83db-7f647e9a1246 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:41.151393 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877f2c7-428c-45d4-9de3-a1fab466043f None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:41.152068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 196/401] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jul 19 15:18:40 2022] GET /identity/v3/groups/fbfc0ee38bd44cbcb5a1c469ff975534 => generated 226 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:41.164353 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b1260-dea8-4a70-83db-7f647e9a1246 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:41.185037 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:41.311826 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b1260-dea8-4a70-83db-7f647e9a1246 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:41.318392 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877f2c7-428c-45d4-9de3-a1fab466043f None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:41.363560 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bbff7-1dcd-45a8-af22-355a6359c594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:41.364661 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bbff7-1dcd-45a8-af22-355a6359c594 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:41.365096 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bbff7-1dcd-45a8-af22-355a6359c594 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:41.365519 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bbff7-1dcd-45a8-af22-355a6359c594 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:41.373244 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049dbc24-bd4d-4624-8e43-ea961bf9a41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:41.374339 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dbc24-bd4d-4624-8e43-ea961bf9a41b None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:41.374679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dbc24-bd4d-4624-8e43-ea961bf9a41b None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:41.375083 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dbc24-bd4d-4624-8e43-ea961bf9a41b None admin] PATH_INFO: `/v3/projects/057eacfe69e5438fae88b82be96b147a` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:41.376753 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049dbc24-bd4d-4624-8e43-ea961bf9a41b None admin] RBAC: Authorizing `identity:get_project(project_id=057eacfe69e5438fae88b82be96b147a)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:41.378667 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049dbc24-bd4d-4624-8e43-ea961bf9a41b None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:41.381677 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9bbff7-1dcd-45a8-af22-355a6359c594 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:41.385502 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 206/402] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:41 2022] GET /identity/v3/projects/057eacfe69e5438fae88b82be96b147a => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:41.387807 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049dbc24-bd4d-4624-8e43-ea961bf9a41b None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:41.391326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-ce9bbff7-1dcd-45a8-af22-355a6359c594 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:18:41.391326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:41.391326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:41.391326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:41.391326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:41.391326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:41.391326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:41.391326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:41.391326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:41.391326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:41.391326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:41.391326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:41.391326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:41.391326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:41.391326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:41.391326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:41.392246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:41.392246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:41.392246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:41.392246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:41.392246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:41.392246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:41.392246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:41.392246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:41.392246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:41.392246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:41.392246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:41.392246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:41.392246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:41.392246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:41.392246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:41.392246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:41.393038 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:41.393038 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:41.393038 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:41.393038 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:41.393038 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:41.393038 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:41.393038 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:41.393038 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:41.393038 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:41.393038 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:41.393038 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:18:41.393038 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:41.395694 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 197/403] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 19 15:18:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:41.397866 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adad5b-08c8-46d2-a175-d41f8951d692 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:41.398376 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adad5b-08c8-46d2-a175-d41f8951d692 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:41.398901 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adad5b-08c8-46d2-a175-d41f8951d692 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:41.404376 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 198/404] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:41.405888 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:41.407791 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adad5b-08c8-46d2-a175-d41f8951d692 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:41.528872 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049dbc24-bd4d-4624-8e43-ea961bf9a41b None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:41.531188 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:41.572883 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adad5b-08c8-46d2-a175-d41f8951d692 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:41.599966 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b688f-4ea1-4f4d-8c73-e72ae6b08ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:41.602075 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b688f-4ea1-4f4d-8c73-e72ae6b08ed5 None admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:41.603768 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b688f-4ea1-4f4d-8c73-e72ae6b08ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:41.604612 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b688f-4ea1-4f4d-8c73-e72ae6b08ed5 None admin] PATH_INFO: `/v3/projects/057eacfe69e5438fae88b82be96b147a/groups/fbfc0ee38bd44cbcb5a1c469ff975534/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:41.608848 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b688f-4ea1-4f4d-8c73-e72ae6b08ed5 None admin] RBAC: Authorizing `identity:create_grant(project_id=057eacfe69e5438fae88b82be96b147a, group_id=fbfc0ee38bd44cbcb5a1c469ff975534, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:41.612148 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b688f-4ea1-4f4d-8c73-e72ae6b08ed5 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:41.617598 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ff1cb-4fdd-4517-be7b-de9f1baf7005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:41.618542 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ff1cb-4fdd-4517-be7b-de9f1baf7005 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:41.618938 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ff1cb-4fdd-4517-be7b-de9f1baf7005 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:41.619357 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ff1cb-4fdd-4517-be7b-de9f1baf7005 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:41.620783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ff1cb-4fdd-4517-be7b-de9f1baf7005 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:41.621321 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ff1cb-4fdd-4517-be7b-de9f1baf7005 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:41.623325 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ff1cb-4fdd-4517-be7b-de9f1baf7005 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:41.633851 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 207/405] 10.222.0.44 () {58 vars in 1442 bytes} [Tue Jul 19 15:18:41 2022] PUT /identity/v3/projects/057eacfe69e5438fae88b82be96b147a/groups/fbfc0ee38bd44cbcb5a1c469ff975534/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:18:41.635648 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fc9dc-9d22-4f93-817c-7b6195f90e9a None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:41.636097 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fc9dc-9d22-4f93-817c-7b6195f90e9a None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:41.636573 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fc9dc-9d22-4f93-817c-7b6195f90e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:41.643261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 199/406] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:18:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:41.647700 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ff1cb-4fdd-4517-be7b-de9f1baf7005 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:41.664367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-c44fc9dc-9d22-4f93-817c-7b6195f90e9a None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:41.666048 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-c44fc9dc-9d22-4f93-817c-7b6195f90e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:41.754268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 208/407] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:41.772112 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ff1cb-4fdd-4517-be7b-de9f1baf7005 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:41.791511 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fc9dc-9d22-4f93-817c-7b6195f90e9a None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:41.794041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:41.813358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ee6e7-cbdf-443d-a536-953c02bb4672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:41.814244 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ee6e7-cbdf-443d-a536-953c02bb4672 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:41.814532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ee6e7-cbdf-443d-a536-953c02bb4672 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:41.814814 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ee6e7-cbdf-443d-a536-953c02bb4672 None admin] PATH_INFO: `/v3/groups/fbfc0ee38bd44cbcb5a1c469ff975534` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:41.816092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ee6e7-cbdf-443d-a536-953c02bb4672 None admin] RBAC: Authorizing `identity:get_group(group_id=fbfc0ee38bd44cbcb5a1c469ff975534)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:41.817615 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ee6e7-cbdf-443d-a536-953c02bb4672 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:41.819710 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 200/408] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jul 19 15:18:41 2022] GET /identity/v3/groups/fbfc0ee38bd44cbcb5a1c469ff975534 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:41.825120 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ee6e7-cbdf-443d-a536-953c02bb4672 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:41.829939 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:41.986660 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fc9dc-9d22-4f93-817c-7b6195f90e9a None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:42.004105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ee6e7-cbdf-443d-a536-953c02bb4672 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:42.039094 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d60a0f-d645-4e25-9a9b-c52372e615a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:42.040764 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d60a0f-d645-4e25-9a9b-c52372e615a6 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:42.041156 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d60a0f-d645-4e25-9a9b-c52372e615a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:42.041535 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d60a0f-d645-4e25-9a9b-c52372e615a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:42.049425 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab79727-9ff3-4896-9bf1-fa000e22966e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:42.050604 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab79727-9ff3-4896-9bf1-fa000e22966e None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:42.051035 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab79727-9ff3-4896-9bf1-fa000e22966e None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:42.052804 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab79727-9ff3-4896-9bf1-fa000e22966e None admin] PATH_INFO: `/v3/projects/057eacfe69e5438fae88b82be96b147a` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:42.054279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab79727-9ff3-4896-9bf1-fa000e22966e None admin] RBAC: Authorizing `identity:get_project(project_id=057eacfe69e5438fae88b82be96b147a)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:42.055624 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d60a0f-d645-4e25-9a9b-c52372e615a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:42.056122 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab79727-9ff3-4896-9bf1-fa000e22966e None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:42.058575 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 201/409] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:41 2022] GET /identity/v3/projects/057eacfe69e5438fae88b82be96b147a => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:42.067162 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-c7d60a0f-d645-4e25-9a9b-c52372e615a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:18:42.067162 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:42.067162 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:42.067162 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:42.067162 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:42.067162 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:42.067162 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:42.067162 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:42.067162 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:42.067162 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:42.067162 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:42.067162 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:42.067162 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:42.067162 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:42.067162 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:42.067162 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:42.068329 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:42.068329 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:42.068329 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:42.068329 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:42.068329 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:42.068329 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:42.068329 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:42.068329 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:42.068329 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:42.068329 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:42.068329 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:42.068329 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:42.068329 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:42.068329 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:42.068329 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:42.068329 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:42.069192 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:42.069192 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:42.069192 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:42.069192 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:42.069192 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:42.069192 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:42.069192 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:42.069192 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:42.069192 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:42.069192 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:42.069192 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:18:42.069192 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:42.070825 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab79727-9ff3-4896-9bf1-fa000e22966e None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:42.072881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 209/410] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:18:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:18:42.080510 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d60a0f-d645-4e25-9a9b-c52372e615a6 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:42.169893 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:42.220976 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d60a0f-d645-4e25-9a9b-c52372e615a6 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:42.263074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:42.267580 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ed4eb-d77c-4b3f-b7d6-1497c5fac8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:42.270767 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ed4eb-d77c-4b3f-b7d6-1497c5fac8d0 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:42.271277 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ed4eb-d77c-4b3f-b7d6-1497c5fac8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:42.271738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ed4eb-d77c-4b3f-b7d6-1497c5fac8d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:42.272713 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ed4eb-d77c-4b3f-b7d6-1497c5fac8d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:42.276919 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ed4eb-d77c-4b3f-b7d6-1497c5fac8d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:42.278728 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ed4eb-d77c-4b3f-b7d6-1497c5fac8d0 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:42.296336 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 210/411] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:42.303749 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ed4eb-d77c-4b3f-b7d6-1497c5fac8d0 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:42.357604 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab79727-9ff3-4896-9bf1-fa000e22966e None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:42.450796 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fac24-7798-4766-83b0-ee5f990bb166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:42.452155 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fac24-7798-4766-83b0-ee5f990bb166 None admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:42.452653 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fac24-7798-4766-83b0-ee5f990bb166 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:42.453133 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fac24-7798-4766-83b0-ee5f990bb166 None admin] PATH_INFO: `/v3/projects/057eacfe69e5438fae88b82be96b147a/groups/fbfc0ee38bd44cbcb5a1c469ff975534/roles/361f7a146e9b47e997cf572bae05c96e` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:42.464212 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6fac24-7798-4766-83b0-ee5f990bb166 None admin] RBAC: Authorizing `identity:create_grant(project_id=057eacfe69e5438fae88b82be96b147a, group_id=fbfc0ee38bd44cbcb5a1c469ff975534, role_id=361f7a146e9b47e997cf572bae05c96e)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:42.466114 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6fac24-7798-4766-83b0-ee5f990bb166 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:42.493632 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 202/412] 10.222.0.44 () {58 vars in 1442 bytes} [Tue Jul 19 15:18:42 2022] PUT /identity/v3/projects/057eacfe69e5438fae88b82be96b147a/groups/fbfc0ee38bd44cbcb5a1c469ff975534/roles/361f7a146e9b47e997cf572bae05c96e => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:18:42.525464 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ed4eb-d77c-4b3f-b7d6-1497c5fac8d0 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:42.570304 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:42.591439 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435eb94f-fc56-450a-b10f-e1af8678410b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:42.593106 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435eb94f-fc56-450a-b10f-e1af8678410b None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:42.593630 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435eb94f-fc56-450a-b10f-e1af8678410b None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:42.593932 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435eb94f-fc56-450a-b10f-e1af8678410b None admin] PATH_INFO: `/v3/groups/cea160a8501b468baaa45feef104888a` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:42.595922 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435eb94f-fc56-450a-b10f-e1af8678410b None admin] RBAC: Authorizing `identity:get_group(group_id=cea160a8501b468baaa45feef104888a)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:42.598822 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435eb94f-fc56-450a-b10f-e1af8678410b None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:42.602701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 211/413] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jul 19 15:18:42 2022] GET /identity/v3/groups/cea160a8501b468baaa45feef104888a => generated 229 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:42.607928 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fac24-7798-4766-83b0-ee5f990bb166 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:42.768858 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fac24-7798-4766-83b0-ee5f990bb166 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:42.799532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:42.807492 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693983d-a745-43ba-bf4a-6846d83fc2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:42.808755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693983d-a745-43ba-bf4a-6846d83fc2cd None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:42.809259 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693983d-a745-43ba-bf4a-6846d83fc2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:42.809737 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693983d-a745-43ba-bf4a-6846d83fc2cd None admin] PATH_INFO: `/v3/projects/32cd8d80a1f1402daab4eabadc4fd0b7` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:42.811255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693983d-a745-43ba-bf4a-6846d83fc2cd None admin] RBAC: Authorizing `identity:get_project(project_id=32cd8d80a1f1402daab4eabadc4fd0b7)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:42.812773 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693983d-a745-43ba-bf4a-6846d83fc2cd None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:42.814492 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 203/414] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:42 2022] GET /identity/v3/projects/32cd8d80a1f1402daab4eabadc4fd0b7 => generated 344 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:42.821133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435eb94f-fc56-450a-b10f-e1af8678410b None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:42.969868 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435eb94f-fc56-450a-b10f-e1af8678410b None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:43.025673 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7253afd-13ae-4928-80bc-0e088d232274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:43.026860 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7253afd-13ae-4928-80bc-0e088d232274 None admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:43.027331 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7253afd-13ae-4928-80bc-0e088d232274 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:43.027767 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7253afd-13ae-4928-80bc-0e088d232274 None admin] PATH_INFO: `/v3/projects/32cd8d80a1f1402daab4eabadc4fd0b7/groups/cea160a8501b468baaa45feef104888a/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:43.032644 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7253afd-13ae-4928-80bc-0e088d232274 None admin] RBAC: Authorizing `identity:create_grant(project_id=32cd8d80a1f1402daab4eabadc4fd0b7, group_id=cea160a8501b468baaa45feef104888a, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:43.034330 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7253afd-13ae-4928-80bc-0e088d232274 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:43.059685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 212/415] 10.222.0.44 () {58 vars in 1442 bytes} [Tue Jul 19 15:18:42 2022] PUT /identity/v3/projects/32cd8d80a1f1402daab4eabadc4fd0b7/groups/cea160a8501b468baaa45feef104888a/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:18:43.445800 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47718c-f51f-47ea-adeb-e0c656fa8824 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:43.446784 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47718c-f51f-47ea-adeb-e0c656fa8824 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:43.447346 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47718c-f51f-47ea-adeb-e0c656fa8824 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:43.449149 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 204/416] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:43.455165 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc530854-4c13-4b77-bd3a-b11b37fc18f8 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:43.456067 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc530854-4c13-4b77-bd3a-b11b37fc18f8 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:43.456497 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc530854-4c13-4b77-bd3a-b11b37fc18f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:43.476483 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-cc530854-4c13-4b77-bd3a-b11b37fc18f8 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:43.478047 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-cc530854-4c13-4b77-bd3a-b11b37fc18f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:43.544362 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:43.575716 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 213/417] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:43.612831 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47718c-f51f-47ea-adeb-e0c656fa8824 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:43.727025 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47718c-f51f-47ea-adeb-e0c656fa8824 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:43.765515 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6868e-7383-4f25-895f-0d247e6a018d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:43.766769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6868e-7383-4f25-895f-0d247e6a018d None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:43.767342 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6868e-7383-4f25-895f-0d247e6a018d None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:43.767816 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6868e-7383-4f25-895f-0d247e6a018d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:43.786675 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6868e-7383-4f25-895f-0d247e6a018d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:43.804174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-78a6868e-7383-4f25-895f-0d247e6a018d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:43.804174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:43.804174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:43.804174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:43.804174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:43.804174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:43.804174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:43.804174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:43.804174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:43.804174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:43.804174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:43.804174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:43.804174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:43.804174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:43.804174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:43.804174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:43.805925 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:43.805925 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:43.805925 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:43.805925 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:43.805925 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:43.805925 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:43.805925 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:43.805925 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:43.805925 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:43.805925 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:43.805925 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:43.805925 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:43.805925 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:43.805925 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:43.805925 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:43.805925 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:43.807528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:43.807528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:43.807528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:43.807528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:43.807528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:43.807528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:43.807528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:43.807528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:43.807528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:43.807528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:43.807528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:43.807528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:43.811716 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 205/418] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:18:43.819274 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc530854-4c13-4b77-bd3a-b11b37fc18f8 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:43.885669 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe8860-c0c4-4582-b147-a03af8d7b999 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:43.885977 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe8860-c0c4-4582-b147-a03af8d7b999 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:43.886271 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe8860-c0c4-4582-b147-a03af8d7b999 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:43.887687 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 206/419] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:18:43.893342 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2118713-6853-4155-a90c-ed7101bc7449 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:43.893701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2118713-6853-4155-a90c-ed7101bc7449 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:43.893981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2118713-6853-4155-a90c-ed7101bc7449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:43.922037 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-a2118713-6853-4155-a90c-ed7101bc7449 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:43.923246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-a2118713-6853-4155-a90c-ed7101bc7449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:44.008734 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc530854-4c13-4b77-bd3a-b11b37fc18f8 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:44.021084 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:44.049444 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 207/420] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:18:44.055561 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d41c4-8ffb-4cef-85f8-4520c4d08e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:44.056324 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d41c4-8ffb-4cef-85f8-4520c4d08e5a None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:44.056615 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d41c4-8ffb-4cef-85f8-4520c4d08e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:44.056899 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d41c4-8ffb-4cef-85f8-4520c4d08e5a None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:44.057673 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d41c4-8ffb-4cef-85f8-4520c4d08e5a None admin] RBAC: Adding query filter params (name=member) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:44.057978 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d41c4-8ffb-4cef-85f8-4520c4d08e5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:44.059373 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d41c4-8ffb-4cef-85f8-4520c4d08e5a None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:44.068861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 214/421] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 19 15:18:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:44.074231 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2118713-6853-4155-a90c-ed7101bc7449 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:44.078409 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d41c4-8ffb-4cef-85f8-4520c4d08e5a None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:44.126247 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:44.187504 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d41c4-8ffb-4cef-85f8-4520c4d08e5a None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:44.202082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2118713-6853-4155-a90c-ed7101bc7449 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:44.222294 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c0c94-9745-40e2-9c54-fff8ad0b62ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:44.223258 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c0c94-9745-40e2-9c54-fff8ad0b62ab None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:44.224226 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c0c94-9745-40e2-9c54-fff8ad0b62ab None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:44.224608 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c0c94-9745-40e2-9c54-fff8ad0b62ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:44.235607 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c0c94-9745-40e2-9c54-fff8ad0b62ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:44.238921 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574281c-6316-4467-b2f2-b12520199ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:44.241439 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574281c-6316-4467-b2f2-b12520199ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:44.241439 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574281c-6316-4467-b2f2-b12520199ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:44.241439 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574281c-6316-4467-b2f2-b12520199ad0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:44.244701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-335c0c94-9745-40e2-9c54-fff8ad0b62ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:18:44.244701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:44.244701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:44.244701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:44.244701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:44.244701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:44.244701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:44.244701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:44.244701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:44.244701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:44.244701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:44.244701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:44.244701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:44.244701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:44.244701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:44.244701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:44.246751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:44.246751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:44.246751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:44.246751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:44.246751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:44.246751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:44.246751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:44.246751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:44.246751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:44.246751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:44.246751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:44.246751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:44.246751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:44.246751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:44.246751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:44.246751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:44.248743 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:44.248743 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:44.248743 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:44.248743 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:44.248743 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:44.248743 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:44.248743 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:44.248743 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:44.248743 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:44.248743 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:44.248743 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:18:44.248743 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:44.248743 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 215/422] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 19 15:18:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:44.255241 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c0c94-9745-40e2-9c54-fff8ad0b62ab None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:44.302569 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:44.318085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574281c-6316-4467-b2f2-b12520199ad0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:44.319879 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574281c-6316-4467-b2f2-b12520199ad0 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:44.355523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c0c94-9745-40e2-9c54-fff8ad0b62ab None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:44.358039 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:44.391191 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaacc34-afed-4854-9eb6-998575f31fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:44.391960 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaacc34-afed-4854-9eb6-998575f31fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:44.392250 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaacc34-afed-4854-9eb6-998575f31fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:44.392529 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaacc34-afed-4854-9eb6-998575f31fd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:44.393291 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaacc34-afed-4854-9eb6-998575f31fd9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:44.393610 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaacc34-afed-4854-9eb6-998575f31fd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:44.394980 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaacc34-afed-4854-9eb6-998575f31fd9 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:44.403602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 216/423] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:18:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:44.409384 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaacc34-afed-4854-9eb6-998575f31fd9 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:44.435527 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 208/424] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:18:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:18:44.440808 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574281c-6316-4467-b2f2-b12520199ad0 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:44.573613 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaacc34-afed-4854-9eb6-998575f31fd9 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:44.607699 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:44.613648 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354781f7-5762-4d27-b8ec-0cc76494e58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:44.614649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354781f7-5762-4d27-b8ec-0cc76494e58b None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:44.615142 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354781f7-5762-4d27-b8ec-0cc76494e58b None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:44.615683 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354781f7-5762-4d27-b8ec-0cc76494e58b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:44.622408 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574281c-6316-4467-b2f2-b12520199ad0 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:44.657755 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:44.670321 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d9ac5-1d07-4236-b965-99181f19532e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:44.671212 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d9ac5-1d07-4236-b965-99181f19532e None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:44.671559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d9ac5-1d07-4236-b965-99181f19532e None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:44.671813 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d9ac5-1d07-4236-b965-99181f19532e None admin] PATH_INFO: `/v3/projects/76392ff9ad244418a55302f0aa823f92` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:44.673508 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d9ac5-1d07-4236-b965-99181f19532e None admin] RBAC: Authorizing `identity:get_project(project_id=76392ff9ad244418a55302f0aa823f92)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:44.674961 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d9ac5-1d07-4236-b965-99181f19532e None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:44.677197 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 209/425] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:44 2022] GET /identity/v3/projects/76392ff9ad244418a55302f0aa823f92 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:44.678764 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cbbf4-e9a2-47c9-9bff-d414a5460d72 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:44.679068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cbbf4-e9a2-47c9-9bff-d414a5460d72 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:44.679408 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cbbf4-e9a2-47c9-9bff-d414a5460d72 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:44.680738 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 210/426] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:44.685945 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6cbbf4-e9a2-47c9-9bff-d414a5460d72 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:44.722191 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354781f7-5762-4d27-b8ec-0cc76494e58b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:44.725932 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354781f7-5762-4d27-b8ec-0cc76494e58b None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:44.808882 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6cbbf4-e9a2-47c9-9bff-d414a5460d72 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:44.879475 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ab638-7f03-4e9b-a49a-944796f9d8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:44.880854 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ab638-7f03-4e9b-a49a-944796f9d8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:44.881339 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ab638-7f03-4e9b-a49a-944796f9d8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:44.881915 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ab638-7f03-4e9b-a49a-944796f9d8f2 None admin] PATH_INFO: `/v3/groups/fbfc0ee38bd44cbcb5a1c469ff975534` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:44.882155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 217/427] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:18:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:18:44.883684 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ab638-7f03-4e9b-a49a-944796f9d8f2 None admin] RBAC: Authorizing `identity:get_group(group_id=fbfc0ee38bd44cbcb5a1c469ff975534)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:44.883903 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c25936-7734-4827-a3ca-8cbd93a74d20 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:44.884166 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c25936-7734-4827-a3ca-8cbd93a74d20 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:44.884455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c25936-7734-4827-a3ca-8cbd93a74d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:44.885997 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ab638-7f03-4e9b-a49a-944796f9d8f2 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:44.888242 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 211/428] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jul 19 15:18:44 2022] GET /identity/v3/groups/fbfc0ee38bd44cbcb5a1c469ff975534 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:44.889231 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ab638-7f03-4e9b-a49a-944796f9d8f2 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:44.914495 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-95c25936-7734-4827-a3ca-8cbd93a74d20 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:44.916866 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-95c25936-7734-4827-a3ca-8cbd93a74d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:44.920124 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:45.027074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ab638-7f03-4e9b-a49a-944796f9d8f2 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:45.055062 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:45.064486 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f860147-cea0-48a0-9867-7df38ce04de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:45.065722 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f860147-cea0-48a0-9867-7df38ce04de9 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:45.066301 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f860147-cea0-48a0-9867-7df38ce04de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:45.066777 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f860147-cea0-48a0-9867-7df38ce04de9 None admin] PATH_INFO: `/v3/projects/76392ff9ad244418a55302f0aa823f92` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:45.068827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f860147-cea0-48a0-9867-7df38ce04de9 None admin] RBAC: Authorizing `identity:get_project(project_id=76392ff9ad244418a55302f0aa823f92)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:45.070501 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f860147-cea0-48a0-9867-7df38ce04de9 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:45.079244 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 218/429] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:45.079244 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c25936-7734-4827-a3ca-8cbd93a74d20 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:45.080168 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 212/430] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:44 2022] GET /identity/v3/projects/76392ff9ad244418a55302f0aa823f92 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:45.085482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f860147-cea0-48a0-9867-7df38ce04de9 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:45.195275 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c25936-7734-4827-a3ca-8cbd93a74d20 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:45.198769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:45.209025 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f860147-cea0-48a0-9867-7df38ce04de9 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:45.234709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e6682-07f8-45c4-b10f-f1b665d77557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:45.235414 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e6682-07f8-45c4-b10f-f1b665d77557 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:45.235705 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e6682-07f8-45c4-b10f-f1b665d77557 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:45.235988 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e6682-07f8-45c4-b10f-f1b665d77557 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:45.236835 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e6682-07f8-45c4-b10f-f1b665d77557 None admin] RBAC: Adding query filter params (group.id=fbfc0ee38bd44cbcb5a1c469ff975534, role.id=ff311e825f2b4a3d809aa772f6cdecb0, scope.project.id=76392ff9ad244418a55302f0aa823f92) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:45.237157 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e6682-07f8-45c4-b10f-f1b665d77557 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:45.238599 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e6682-07f8-45c4-b10f-f1b665d77557 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:45.245343 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 219/431] 10.222.0.44 () {56 vars in 1376 bytes} [Tue Jul 19 15:18:45 2022] GET /identity/v3/role_assignments?group.id=fbfc0ee38bd44cbcb5a1c469ff975534&scope.project.id=76392ff9ad244418a55302f0aa823f92&role.id=ff311e825f2b4a3d809aa772f6cdecb0 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:45.247585 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60598541-e678-4e8d-9639-93593634e84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:45.247723 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e6682-07f8-45c4-b10f-f1b665d77557 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:45.247802 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60598541-e678-4e8d-9639-93593634e84e None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:45.247802 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60598541-e678-4e8d-9639-93593634e84e None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:45.247802 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60598541-e678-4e8d-9639-93593634e84e None admin] PATH_INFO: `/v3/groups/fbfc0ee38bd44cbcb5a1c469ff975534` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:45.248740 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60598541-e678-4e8d-9639-93593634e84e None admin] RBAC: Authorizing `identity:get_group(group_id=fbfc0ee38bd44cbcb5a1c469ff975534)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:45.250212 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60598541-e678-4e8d-9639-93593634e84e None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:45.252182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 213/432] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jul 19 15:18:45 2022] GET /identity/v3/groups/fbfc0ee38bd44cbcb5a1c469ff975534 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:45.254322 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ed786-5a5a-4ffe-811e-0150b1b88f17 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:45.254322 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ed786-5a5a-4ffe-811e-0150b1b88f17 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:45.254322 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ed786-5a5a-4ffe-811e-0150b1b88f17 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:45.256726 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 214/433] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:45.258659 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ed786-5a5a-4ffe-811e-0150b1b88f17 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:45.341019 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:45.402620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e6682-07f8-45c4-b10f-f1b665d77557 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:45.404009 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ed786-5a5a-4ffe-811e-0150b1b88f17 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:45.456893 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93529da-8f7f-4b74-b875-05761086651c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:45.457725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93529da-8f7f-4b74-b875-05761086651c None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:45.458551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93529da-8f7f-4b74-b875-05761086651c None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:45.458861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93529da-8f7f-4b74-b875-05761086651c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:45.464349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5aaddc-8661-45c9-859d-5909a6e24be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:45.465338 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5aaddc-8661-45c9-859d-5909a6e24be3 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:45.465627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5aaddc-8661-45c9-859d-5909a6e24be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:45.465902 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5aaddc-8661-45c9-859d-5909a6e24be3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:45.469148 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5aaddc-8661-45c9-859d-5909a6e24be3 None admin] RBAC: Adding query filter params (group.id=fbfc0ee38bd44cbcb5a1c469ff975534, role.id=361f7a146e9b47e997cf572bae05c96e, scope.project.id=76392ff9ad244418a55302f0aa823f92) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:45.469148 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5aaddc-8661-45c9-859d-5909a6e24be3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:45.469148 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5aaddc-8661-45c9-859d-5909a6e24be3 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:45.476308 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93529da-8f7f-4b74-b875-05761086651c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:45.476483 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 215/434] 10.222.0.44 () {56 vars in 1376 bytes} [Tue Jul 19 15:18:45 2022] GET /identity/v3/role_assignments?group.id=fbfc0ee38bd44cbcb5a1c469ff975534&scope.project.id=76392ff9ad244418a55302f0aa823f92&role.id=361f7a146e9b47e997cf572bae05c96e => generated 611 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:45.477546 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab353c98-9741-4deb-a984-de9b70490432 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:45.477837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab353c98-9741-4deb-a984-de9b70490432 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:45.478116 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab353c98-9741-4deb-a984-de9b70490432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:45.487706 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-d93529da-8f7f-4b74-b875-05761086651c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:45.487706 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:45.487706 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:45.487706 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:45.487706 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:45.487706 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:45.487706 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:45.487706 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:45.487706 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:45.487706 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:45.487706 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:45.487706 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:45.487706 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:45.487706 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:45.487706 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:45.487706 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:45.488686 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:45.488686 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:45.488686 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:45.488686 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:45.488686 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:45.488686 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:45.488686 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:45.488686 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:45.488686 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:45.488686 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:45.488686 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:45.488686 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:45.488686 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:45.488686 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:45.488686 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:45.488686 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:45.489531 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:45.489531 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:45.489531 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:45.489531 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:45.489531 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:45.489531 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:45.489531 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:45.489531 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:45.489531 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:45.489531 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:45.489531 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 15:18:45.489531 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:45.489531 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 220/435] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:45.496794 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93529da-8f7f-4b74-b875-05761086651c None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:45.501463 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-ab353c98-9741-4deb-a984-de9b70490432 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:45.502838 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-ab353c98-9741-4deb-a984-de9b70490432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:45.525366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:45.594426 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 216/436] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:45.622424 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab353c98-9741-4deb-a984-de9b70490432 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:45.643092 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93529da-8f7f-4b74-b875-05761086651c None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:45.670034 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:45.691085 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7a2bf-a18b-47cd-a4c7-cf3d094dcc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:45.691847 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7a2bf-a18b-47cd-a4c7-cf3d094dcc31 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:45.692136 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7a2bf-a18b-47cd-a4c7-cf3d094dcc31 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:45.692452 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7a2bf-a18b-47cd-a4c7-cf3d094dcc31 None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:45.693412 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d7a2bf-a18b-47cd-a4c7-cf3d094dcc31 None admin] RBAC: Adding query filter params (name=member) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:45.694217 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d7a2bf-a18b-47cd-a4c7-cf3d094dcc31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:45.695649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d7a2bf-a18b-47cd-a4c7-cf3d094dcc31 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:45.709250 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 221/437] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 19 15:18:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:45.715516 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7a2bf-a18b-47cd-a4c7-cf3d094dcc31 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:45.763679 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab353c98-9741-4deb-a984-de9b70490432 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:45.825069 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe23b51-97e7-4019-85b9-f99fc7d6b9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:45.826405 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe23b51-97e7-4019-85b9-f99fc7d6b9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:45.826902 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe23b51-97e7-4019-85b9-f99fc7d6b9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:45.827436 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe23b51-97e7-4019-85b9-f99fc7d6b9f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:45.842400 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe23b51-97e7-4019-85b9-f99fc7d6b9f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:45.852206 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-8fe23b51-97e7-4019-85b9-f99fc7d6b9f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:18:45.852206 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:45.852206 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:45.852206 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:45.852206 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:45.852206 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:45.852206 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:45.852206 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:45.852206 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:45.852206 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:45.852206 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:45.852206 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:45.852206 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:45.852206 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:45.852206 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:45.852206 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:45.853148 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:45.853148 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:45.853148 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:45.853148 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:45.853148 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:45.853148 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:45.853148 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:45.853148 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:45.853148 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:45.853148 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:45.853148 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:45.853148 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:45.853148 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:45.853148 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:45.853148 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:45.853148 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:45.853947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:45.853947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:45.853947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:45.853947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:45.853947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:45.853947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:45.853947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:45.853947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:45.853947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:45.853947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:45.853947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:18:45.853947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:45.853947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 217/438] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 19 15:18:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:45.853947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000f8da-bc5b-4e34-8dc0-3ca53fa631fa None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:45.854638 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000f8da-bc5b-4e34-8dc0-3ca53fa631fa None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:45.854638 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000f8da-bc5b-4e34-8dc0-3ca53fa631fa None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:45.857247 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 218/439] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:45.862225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7a2bf-a18b-47cd-a4c7-cf3d094dcc31 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:45.862751 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43777d4-5172-4e4c-a06b-255149ed67cc None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:45.864015 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43777d4-5172-4e4c-a06b-255149ed67cc None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:45.864880 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43777d4-5172-4e4c-a06b-255149ed67cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:45.881582 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-d43777d4-5172-4e4c-a06b-255149ed67cc None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:45.882785 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-d43777d4-5172-4e4c-a06b-255149ed67cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:45.896203 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:45.912792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55634381-e7f4-4a0e-9730-ccc4d5a29ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:45.913454 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55634381-e7f4-4a0e-9730-ccc4d5a29ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:45.913744 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55634381-e7f4-4a0e-9730-ccc4d5a29ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:45.914027 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55634381-e7f4-4a0e-9730-ccc4d5a29ad8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:45.968868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 219/440] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:45.969572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43777d4-5172-4e4c-a06b-255149ed67cc None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:45.983574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:45.997274 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55634381-e7f4-4a0e-9730-ccc4d5a29ad8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:45.998720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55634381-e7f4-4a0e-9730-ccc4d5a29ad8 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:46.090889 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43777d4-5172-4e4c-a06b-255149ed67cc None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:46.105290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 222/441] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:18:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:18:46.106077 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55634381-e7f4-4a0e-9730-ccc4d5a29ad8 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:46.125681 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52857889-5baa-4e70-a353-b0f6a21efb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:46.126354 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52857889-5baa-4e70-a353-b0f6a21efb9f None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:46.126637 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52857889-5baa-4e70-a353-b0f6a21efb9f None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:46.126912 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52857889-5baa-4e70-a353-b0f6a21efb9f None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:46.127700 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52857889-5baa-4e70-a353-b0f6a21efb9f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:46.128011 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52857889-5baa-4e70-a353-b0f6a21efb9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:46.129398 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52857889-5baa-4e70-a353-b0f6a21efb9f None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:46.138258 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 220/442] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:18:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:46.139079 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52857889-5baa-4e70-a353-b0f6a21efb9f None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:46.149522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:46.199243 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:46.228975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55634381-e7f4-4a0e-9730-ccc4d5a29ad8 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:46.262836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52857889-5baa-4e70-a353-b0f6a21efb9f None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:46.275351 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325b3fc-8192-4fa9-b614-1dc292b5f35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:46.276174 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325b3fc-8192-4fa9-b614-1dc292b5f35f None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:46.276462 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325b3fc-8192-4fa9-b614-1dc292b5f35f None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:46.276741 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325b3fc-8192-4fa9-b614-1dc292b5f35f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:46.288727 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325b3fc-8192-4fa9-b614-1dc292b5f35f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:46.296477 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-f325b3fc-8192-4fa9-b614-1dc292b5f35f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:18:46.296477 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:46.296477 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:46.296477 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:46.296477 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:46.296477 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:46.296477 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:46.296477 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:46.296477 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:46.296477 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:46.296477 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:46.296477 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:46.296477 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:46.296477 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:46.296477 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:46.296477 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:46.297570 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:46.297570 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:46.297570 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:46.297570 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:46.297570 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:46.297570 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:46.297570 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:46.297570 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:46.297570 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:46.297570 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:46.297570 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:46.297570 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:46.297570 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:46.297570 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:46.297570 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:46.297570 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:46.298367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:46.298367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:46.298367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:46.298367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:46.298367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:46.298367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:46.298367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:46.298367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:46.298367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:46.298367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:46.298367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:18:46.298367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:46.298367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 223/443] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:18:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:46.299039 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325b3fc-8192-4fa9-b614-1dc292b5f35f None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:46.317936 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce18887-8958-423c-b81e-876cb6242859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:46.318816 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce18887-8958-423c-b81e-876cb6242859 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:46.319098 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce18887-8958-423c-b81e-876cb6242859 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:46.319435 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce18887-8958-423c-b81e-876cb6242859 None admin] PATH_INFO: `/v3/projects/057eacfe69e5438fae88b82be96b147a` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:46.320699 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce18887-8958-423c-b81e-876cb6242859 None admin] RBAC: Authorizing `identity:get_project(project_id=057eacfe69e5438fae88b82be96b147a)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:46.322147 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce18887-8958-423c-b81e-876cb6242859 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:46.323936 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 221/444] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:46 2022] GET /identity/v3/projects/057eacfe69e5438fae88b82be96b147a => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:46.324719 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce18887-8958-423c-b81e-876cb6242859 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:46.406104 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:46.430471 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325b3fc-8192-4fa9-b614-1dc292b5f35f None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:46.438785 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce18887-8958-423c-b81e-876cb6242859 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:46.478288 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423895eb-9726-4c39-adce-d149abaed58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:46.479293 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423895eb-9726-4c39-adce-d149abaed58d None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:46.479717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423895eb-9726-4c39-adce-d149abaed58d None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:46.480175 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423895eb-9726-4c39-adce-d149abaed58d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:46.485926 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad6e86-b54d-49b8-9965-705620e6a342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:46.486683 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad6e86-b54d-49b8-9965-705620e6a342 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:46.487149 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad6e86-b54d-49b8-9965-705620e6a342 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:46.487640 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad6e86-b54d-49b8-9965-705620e6a342 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:46.488977 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad6e86-b54d-49b8-9965-705620e6a342 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:46.489897 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad6e86-b54d-49b8-9965-705620e6a342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:46.492395 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad6e86-b54d-49b8-9965-705620e6a342 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:46.501724 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:46.507606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 222/445] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:46.508666 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad6e86-b54d-49b8-9965-705620e6a342 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:46.581858 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423895eb-9726-4c39-adce-d149abaed58d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:46.583580 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423895eb-9726-4c39-adce-d149abaed58d None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:46.624497 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad6e86-b54d-49b8-9965-705620e6a342 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:46.657703 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea1611-a728-40fd-a889-444455347159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:46.658562 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea1611-a728-40fd-a889-444455347159 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:46.658842 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea1611-a728-40fd-a889-444455347159 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:46.659120 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea1611-a728-40fd-a889-444455347159 None admin] PATH_INFO: `/v3/groups/fbfc0ee38bd44cbcb5a1c469ff975534` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:46.660354 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea1611-a728-40fd-a889-444455347159 None admin] RBAC: Authorizing `identity:get_group(group_id=fbfc0ee38bd44cbcb5a1c469ff975534)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:46.662347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea1611-a728-40fd-a889-444455347159 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:46.664123 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 223/446] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jul 19 15:18:46 2022] GET /identity/v3/groups/fbfc0ee38bd44cbcb5a1c469ff975534 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:46.664902 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea1611-a728-40fd-a889-444455347159 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:46.669464 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:46.712280 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 224/447] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:18:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:18:46.713149 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423895eb-9726-4c39-adce-d149abaed58d None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:46.763293 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:46.791965 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea1611-a728-40fd-a889-444455347159 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:46.825696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423895eb-9726-4c39-adce-d149abaed58d None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:46.834690 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda6a78-387e-4fdc-90b8-df564ca0a648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:46.835380 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda6a78-387e-4fdc-90b8-df564ca0a648 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:46.835673 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda6a78-387e-4fdc-90b8-df564ca0a648 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:46.835952 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda6a78-387e-4fdc-90b8-df564ca0a648 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:46.864719 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6532d-f722-4088-92b1-6b0d76aeb3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:46.865378 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6532d-f722-4088-92b1-6b0d76aeb3b3 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:46.865664 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6532d-f722-4088-92b1-6b0d76aeb3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:46.865948 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6532d-f722-4088-92b1-6b0d76aeb3b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:46.866781 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6532d-f722-4088-92b1-6b0d76aeb3b3 None admin] RBAC: Adding query filter params (group.id=fbfc0ee38bd44cbcb5a1c469ff975534, role.id=ff311e825f2b4a3d809aa772f6cdecb0, scope.project.id=057eacfe69e5438fae88b82be96b147a) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:46.867175 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6532d-f722-4088-92b1-6b0d76aeb3b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:46.868634 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6532d-f722-4088-92b1-6b0d76aeb3b3 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:46.874671 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 225/448] 10.222.0.44 () {56 vars in 1376 bytes} [Tue Jul 19 15:18:46 2022] GET /identity/v3/role_assignments?group.id=fbfc0ee38bd44cbcb5a1c469ff975534&scope.project.id=057eacfe69e5438fae88b82be96b147a&role.id=ff311e825f2b4a3d809aa772f6cdecb0 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:46.875529 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6532d-f722-4088-92b1-6b0d76aeb3b3 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:46.921614 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda6a78-387e-4fdc-90b8-df564ca0a648 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:46.923144 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda6a78-387e-4fdc-90b8-df564ca0a648 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:46.927129 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:46.999911 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6532d-f722-4088-92b1-6b0d76aeb3b3 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:47.007887 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:47.045044 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88659a39-9801-4538-86e0-db899718ce86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:47.045972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 224/449] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:18:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:18:47.046086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88659a39-9801-4538-86e0-db899718ce86 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:47.046086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88659a39-9801-4538-86e0-db899718ce86 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:47.046381 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88659a39-9801-4538-86e0-db899718ce86 None admin] PATH_INFO: `/v3/projects/057eacfe69e5438fae88b82be96b147a` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:47.047661 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88659a39-9801-4538-86e0-db899718ce86 None admin] RBAC: Authorizing `identity:get_project(project_id=057eacfe69e5438fae88b82be96b147a)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:47.049096 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88659a39-9801-4538-86e0-db899718ce86 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:47.050785 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 226/450] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:46 2022] GET /identity/v3/projects/057eacfe69e5438fae88b82be96b147a => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:47.052225 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda6a78-387e-4fdc-90b8-df564ca0a648 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:47.056492 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88659a39-9801-4538-86e0-db899718ce86 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:47.174090 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda6a78-387e-4fdc-90b8-df564ca0a648 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:47.177435 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:47.185190 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88659a39-9801-4538-86e0-db899718ce86 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:47.220528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870010df-ecf3-4fc9-a75f-394adf02f4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:47.221411 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870010df-ecf3-4fc9-a75f-394adf02f4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:47.221700 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870010df-ecf3-4fc9-a75f-394adf02f4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:47.221976 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870010df-ecf3-4fc9-a75f-394adf02f4a2 None admin] PATH_INFO: `/v3/projects/32cd8d80a1f1402daab4eabadc4fd0b7` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:47.223501 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870010df-ecf3-4fc9-a75f-394adf02f4a2 None admin] RBAC: Authorizing `identity:get_project(project_id=32cd8d80a1f1402daab4eabadc4fd0b7)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:47.224986 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870010df-ecf3-4fc9-a75f-394adf02f4a2 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:47.226859 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 225/451] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:18:47 2022] GET /identity/v3/projects/32cd8d80a1f1402daab4eabadc4fd0b7 => generated 344 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:47.233590 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870010df-ecf3-4fc9-a75f-394adf02f4a2 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:47.236952 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e85be5-6c1e-47fc-a0f0-7a15043f16ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:47.237838 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e85be5-6c1e-47fc-a0f0-7a15043f16ae None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:47.238120 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e85be5-6c1e-47fc-a0f0-7a15043f16ae None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:47.238400 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e85be5-6c1e-47fc-a0f0-7a15043f16ae None admin] PATH_INFO: `/v3/groups/fbfc0ee38bd44cbcb5a1c469ff975534` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:47.240713 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e85be5-6c1e-47fc-a0f0-7a15043f16ae None admin] RBAC: Authorizing `identity:get_group(group_id=fbfc0ee38bd44cbcb5a1c469ff975534)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:47.242148 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e85be5-6c1e-47fc-a0f0-7a15043f16ae None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:47.244219 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 227/452] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jul 19 15:18:47 2022] GET /identity/v3/groups/fbfc0ee38bd44cbcb5a1c469ff975534 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:47.250677 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e85be5-6c1e-47fc-a0f0-7a15043f16ae None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:47.301540 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:47.352538 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870010df-ecf3-4fc9-a75f-394adf02f4a2 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:47.363950 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e85be5-6c1e-47fc-a0f0-7a15043f16ae None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:47.387433 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281c883-8403-4d35-8c9f-cc10ca98b0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:47.388298 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281c883-8403-4d35-8c9f-cc10ca98b0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:47.388579 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281c883-8403-4d35-8c9f-cc10ca98b0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:47.388851 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281c883-8403-4d35-8c9f-cc10ca98b0b8 None admin] PATH_INFO: `/v3/groups/cea160a8501b468baaa45feef104888a` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:47.390067 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281c883-8403-4d35-8c9f-cc10ca98b0b8 None admin] RBAC: Authorizing `identity:get_group(group_id=cea160a8501b468baaa45feef104888a)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:47.391534 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281c883-8403-4d35-8c9f-cc10ca98b0b8 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:47.393159 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 226/453] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jul 19 15:18:47 2022] GET /identity/v3/groups/cea160a8501b468baaa45feef104888a => generated 229 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:47.399728 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281c883-8403-4d35-8c9f-cc10ca98b0b8 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:47.401896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec324778-7873-4496-a7dd-80b359a60f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:47.402555 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec324778-7873-4496-a7dd-80b359a60f29 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:47.402844 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec324778-7873-4496-a7dd-80b359a60f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:47.403117 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec324778-7873-4496-a7dd-80b359a60f29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:47.404120 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec324778-7873-4496-a7dd-80b359a60f29 None admin] RBAC: Adding query filter params (group.id=fbfc0ee38bd44cbcb5a1c469ff975534, role.id=361f7a146e9b47e997cf572bae05c96e, scope.project.id=057eacfe69e5438fae88b82be96b147a) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:47.404440 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec324778-7873-4496-a7dd-80b359a60f29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:47.406138 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec324778-7873-4496-a7dd-80b359a60f29 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:47.413058 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 228/454] 10.222.0.44 () {56 vars in 1376 bytes} [Tue Jul 19 15:18:47 2022] GET /identity/v3/role_assignments?group.id=fbfc0ee38bd44cbcb5a1c469ff975534&scope.project.id=057eacfe69e5438fae88b82be96b147a&role.id=361f7a146e9b47e997cf572bae05c96e => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:47.446159 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:47.511248 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281c883-8403-4d35-8c9f-cc10ca98b0b8 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:47.547452 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578db2ee-841f-46d5-9d9e-45e8cf41f6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:47.548126 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578db2ee-841f-46d5-9d9e-45e8cf41f6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:47.548411 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578db2ee-841f-46d5-9d9e-45e8cf41f6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:47.548690 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578db2ee-841f-46d5-9d9e-45e8cf41f6a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:47.549545 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578db2ee-841f-46d5-9d9e-45e8cf41f6a2 None admin] RBAC: Adding query filter params (group.id=cea160a8501b468baaa45feef104888a, role.id=d884ddf33c1440d9b3a3351b85e83e76, scope.project.id=32cd8d80a1f1402daab4eabadc4fd0b7) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:47.549863 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578db2ee-841f-46d5-9d9e-45e8cf41f6a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:47.551344 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578db2ee-841f-46d5-9d9e-45e8cf41f6a2 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:47.558515 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 227/455] 10.222.0.44 () {56 vars in 1376 bytes} [Tue Jul 19 15:18:47 2022] GET /identity/v3/role_assignments?group.id=cea160a8501b468baaa45feef104888a&scope.project.id=32cd8d80a1f1402daab4eabadc4fd0b7&role.id=d884ddf33c1440d9b3a3351b85e83e76 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:50.063814 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d8369-f6b4-4eae-b124-968cd00c044f None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:50.064361 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d8369-f6b4-4eae-b124-968cd00c044f None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:50.064361 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d8369-f6b4-4eae-b124-968cd00c044f None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:50.065993 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 229/456] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:50.071473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a792ca-73d8-4657-954d-8bb85fcebc08 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:50.071888 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a792ca-73d8-4657-954d-8bb85fcebc08 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:50.072060 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a792ca-73d8-4657-954d-8bb85fcebc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:50.095390 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-81a792ca-73d8-4657-954d-8bb85fcebc08 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:50.096574 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-81a792ca-73d8-4657-954d-8bb85fcebc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:50.188456 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 228/457] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:50.236710 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d8369-f6b4-4eae-b124-968cd00c044f None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:50.371001 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42375f5d-4508-4a16-91ca-da7b9743de44 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:50.371555 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42375f5d-4508-4a16-91ca-da7b9743de44 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:50.372082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42375f5d-4508-4a16-91ca-da7b9743de44 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:50.373562 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 229/458] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:50.379712 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99df789-3664-4fb2-a4a1-e51798d4a050 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:50.380038 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99df789-3664-4fb2-a4a1-e51798d4a050 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:50.380283 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99df789-3664-4fb2-a4a1-e51798d4a050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:50.387748 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d8369-f6b4-4eae-b124-968cd00c044f None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:50.407828 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:50.419168 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-f99df789-3664-4fb2-a4a1-e51798d4a050 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:50.420407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-f99df789-3664-4fb2-a4a1-e51798d4a050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:50.425803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508e8f8-a7d8-4657-98bb-ed98fafc1dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:50.427324 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508e8f8-a7d8-4657-98bb-ed98fafc1dca None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:50.427623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508e8f8-a7d8-4657-98bb-ed98fafc1dca None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:50.427906 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508e8f8-a7d8-4657-98bb-ed98fafc1dca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:50.439018 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508e8f8-a7d8-4657-98bb-ed98fafc1dca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:50.440458 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508e8f8-a7d8-4657-98bb-ed98fafc1dca None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:50.461455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-c508e8f8-a7d8-4657-98bb-ed98fafc1dca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:18:50.461455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:50.461455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:50.461455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:50.461455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:50.461455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:50.461455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:50.461455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:50.461455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:50.461455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:50.461455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:50.461455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:50.461455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:18:50.461455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:18:50.461455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:18:50.462397 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:18:50.462397 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:50.462397 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:50.462397 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:50.462397 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:50.462397 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:50.462397 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:50.462397 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:50.462397 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:50.462397 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:50.462397 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:50.462397 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:50.462397 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:50.462397 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:50.462397 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:50.462397 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:50.462397 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:50.463302 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:18:50.463302 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:18:50.463302 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:18:50.463302 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:50.463302 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 230/459] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:18:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:50.474212 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:50.474851 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508e8f8-a7d8-4657-98bb-ed98fafc1dca None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:50.525652 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 230/460] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:18:50.573676 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99df789-3664-4fb2-a4a1-e51798d4a050 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:50.664165 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508e8f8-a7d8-4657-98bb-ed98fafc1dca None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:50.706771 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82761b6-b08a-4ae4-8a47-5bef2bd1c069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:50.707388 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82761b6-b08a-4ae4-8a47-5bef2bd1c069 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:50.707679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82761b6-b08a-4ae4-8a47-5bef2bd1c069 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:50.708464 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82761b6-b08a-4ae4-8a47-5bef2bd1c069 None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:50.709253 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82761b6-b08a-4ae4-8a47-5bef2bd1c069 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:50.709513 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82761b6-b08a-4ae4-8a47-5bef2bd1c069 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:50.710908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82761b6-b08a-4ae4-8a47-5bef2bd1c069 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:50.724390 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99df789-3664-4fb2-a4a1-e51798d4a050 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:50.724787 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 231/461] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:50.725956 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a0c19-3641-41f6-8a4e-a1621cb2c47e None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:50.726249 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a0c19-3641-41f6-8a4e-a1621cb2c47e None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:50.726532 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a0c19-3641-41f6-8a4e-a1621cb2c47e None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:50.732704 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 232/462] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:50.733546 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a0c19-3641-41f6-8a4e-a1621cb2c47e None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:50.754414 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:50.775577 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d29e42-f0bb-410b-97df-e0ac9c8e92a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:50.777826 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d29e42-f0bb-410b-97df-e0ac9c8e92a2 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:50.778301 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d29e42-f0bb-410b-97df-e0ac9c8e92a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:50.778795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d29e42-f0bb-410b-97df-e0ac9c8e92a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:50.794925 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d29e42-f0bb-410b-97df-e0ac9c8e92a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:50.797011 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d29e42-f0bb-410b-97df-e0ac9c8e92a2 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:50.822739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-95d29e42-f0bb-410b-97df-e0ac9c8e92a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:18:50.822739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:50.822739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:50.822739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:50.822739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:50.822739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:50.822739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:50.822739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:50.822739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:50.822739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:50.822739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:50.822739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:50.822739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:18:50.822739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:18:50.822739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:18:50.823701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:18:50.823701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:50.823701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:50.823701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:50.823701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:50.823701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:50.823701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:50.823701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:50.823701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:50.823701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:50.823701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:50.823701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:50.823701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:50.823701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:50.823701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:50.823701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:50.823701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:50.824538 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:18:50.824538 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:18:50.824538 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:18:50.824538 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:50.826510 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 231/463] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:18:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:18:50.831905 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17e78b-4fbb-40c5-b582-f03b695634bb None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:50.831905 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17e78b-4fbb-40c5-b582-f03b695634bb None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:50.831905 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17e78b-4fbb-40c5-b582-f03b695634bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:50.854280 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-df17e78b-4fbb-40c5-b582-f03b695634bb None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:50.855034 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-df17e78b-4fbb-40c5-b582-f03b695634bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:50.867487 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:50.870895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a0c19-3641-41f6-8a4e-a1621cb2c47e None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:50.909628 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a28c5-cb7a-4604-85e3-442dcde22e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:50.910787 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a28c5-cb7a-4604-85e3-442dcde22e7e None admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:50.911872 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a28c5-cb7a-4604-85e3-442dcde22e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:50.912539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a28c5-cb7a-4604-85e3-442dcde22e7e None admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:50.913491 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a28c5-cb7a-4604-85e3-442dcde22e7e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:50.915245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a28c5-cb7a-4604-85e3-442dcde22e7e None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:50.931986 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 232/464] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:50.932721 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17e78b-4fbb-40c5-b582-f03b695634bb None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:50.941515 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 233/465] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jul 19 15:18:50 2022] POST /identity/v3/users => generated 246 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:18:50.972580 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a28c5-cb7a-4604-85e3-442dcde22e7e None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:51.053489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17e78b-4fbb-40c5-b582-f03b695634bb None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:51.094552 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6e656-62b0-49e4-86a0-890c07a59eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:51.095373 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6e656-62b0-49e4-86a0-890c07a59eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:51.095665 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6e656-62b0-49e4-86a0-890c07a59eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:51.095947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6e656-62b0-49e4-86a0-890c07a59eb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:51.096707 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd6e656-62b0-49e4-86a0-890c07a59eb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:51.097023 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd6e656-62b0-49e4-86a0-890c07a59eb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:51.099151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd6e656-62b0-49e4-86a0-890c07a59eb9 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:51.106300 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:51.116770 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 233/466] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:51.119010 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b2dd9-ef64-48ca-8724-bba82f65806f None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:51.119333 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b2dd9-ef64-48ca-8724-bba82f65806f None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:51.119617 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b2dd9-ef64-48ca-8724-bba82f65806f None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:51.121584 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 234/467] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:51.123543 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b2dd9-ef64-48ca-8724-bba82f65806f None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:51.137572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:51.146053 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a28c5-cb7a-4604-85e3-442dcde22e7e None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:51.185829 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845de5aa-2691-4f76-8da9-07da881e1ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:51.186918 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845de5aa-2691-4f76-8da9-07da881e1ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:51.187384 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845de5aa-2691-4f76-8da9-07da881e1ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:51.187885 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845de5aa-2691-4f76-8da9-07da881e1ec9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:51.198810 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845de5aa-2691-4f76-8da9-07da881e1ec9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:51.200706 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845de5aa-2691-4f76-8da9-07da881e1ec9 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:51.222134 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-845de5aa-2691-4f76-8da9-07da881e1ec9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:18:51.222134 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:51.222134 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:51.222134 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:51.222134 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:51.222134 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:51.222134 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:51.222134 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:51.222134 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:51.222134 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:51.222134 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:51.222134 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:51.222134 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:18:51.222134 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:18:51.222134 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:18:51.223151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:18:51.223151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:51.223151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:51.223151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:51.223151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:51.223151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:51.223151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:51.223151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:51.223151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:51.223151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:51.223151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:51.223151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:51.223151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:51.223151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:51.223151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:51.223151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:51.223151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:51.224397 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:18:51.224397 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:18:51.224397 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:18:51.224397 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:51.224397 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 234/468] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:18:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:18:51.224680 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5d6f9-3249-4209-a99f-6e0cc4439cab None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:51.224747 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5d6f9-3249-4209-a99f-6e0cc4439cab None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:51.225077 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5d6f9-3249-4209-a99f-6e0cc4439cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:51.244463 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-18f5d6f9-3249-4209-a99f-6e0cc4439cab None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:51.245246 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-18f5d6f9-3249-4209-a99f-6e0cc4439cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:51.259492 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b2dd9-ef64-48ca-8724-bba82f65806f None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:51.302459 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f67be-efec-443c-9b6e-d062862dfe2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:51.303737 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f67be-efec-443c-9b6e-d062862dfe2c None admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:51.304364 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f67be-efec-443c-9b6e-d062862dfe2c None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:51.304823 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f67be-efec-443c-9b6e-d062862dfe2c None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:51.306001 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f67be-efec-443c-9b6e-d062862dfe2c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:51.307687 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f67be-efec-443c-9b6e-d062862dfe2c None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:51.324966 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 235/469] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:51.326050 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5d6f9-3249-4209-a99f-6e0cc4439cab None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:51.336552 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 235/470] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jul 19 15:18:51 2022] POST /identity/v3/users => generated 248 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:18:51.363142 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f67be-efec-443c-9b6e-d062862dfe2c None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:51.429824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:51.503136 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:51.533251 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5d6f9-3249-4209-a99f-6e0cc4439cab None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:51.549473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f67be-efec-443c-9b6e-d062862dfe2c None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:51.591572 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e32f20-a631-45e2-92d3-3fe083c7977a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:51.591779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec27d5-9a3f-48e3-80cc-0e24cf79fd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:51.592318 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e32f20-a631-45e2-92d3-3fe083c7977a None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:51.592665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e32f20-a631-45e2-92d3-3fe083c7977a None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:51.592947 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e32f20-a631-45e2-92d3-3fe083c7977a None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:51.593365 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec27d5-9a3f-48e3-80cc-0e24cf79fd90 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:51.593688 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e32f20-a631-45e2-92d3-3fe083c7977a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:51.594001 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e32f20-a631-45e2-92d3-3fe083c7977a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:51.594179 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec27d5-9a3f-48e3-80cc-0e24cf79fd90 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:51.594714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec27d5-9a3f-48e3-80cc-0e24cf79fd90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:51.595441 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e32f20-a631-45e2-92d3-3fe083c7977a None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:51.608982 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec27d5-9a3f-48e3-80cc-0e24cf79fd90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:51.610716 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec27d5-9a3f-48e3-80cc-0e24cf79fd90 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:51.614414 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 236/471] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:51.615704 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e32f20-a631-45e2-92d3-3fe083c7977a None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:51.630631 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-fcec27d5-9a3f-48e3-80cc-0e24cf79fd90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:18:51.630631 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:51.630631 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:51.630631 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:51.630631 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:51.630631 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:51.630631 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:51.630631 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:51.630631 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:51.630631 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:51.630631 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:51.630631 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:51.630631 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:18:51.630631 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:18:51.630631 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:18:51.631579 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:18:51.631579 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:51.631579 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:51.631579 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:51.631579 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:51.631579 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:51.631579 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:51.631579 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:51.631579 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:51.631579 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:51.631579 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:51.631579 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:51.631579 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:51.631579 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:51.631579 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:51.631579 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:51.631579 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:51.632432 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:18:51.632432 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:18:51.632432 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:18:51.632432 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:51.634694 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 236/472] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:18:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:18:51.640545 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec27d5-9a3f-48e3-80cc-0e24cf79fd90 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:51.722453 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e32f20-a631-45e2-92d3-3fe083c7977a None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:51.741797 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:51.750879 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec27d5-9a3f-48e3-80cc-0e24cf79fd90 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:51.766632 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:51.770304 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a641579-1f7f-47aa-ad7a-513413240c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:51.771037 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a641579-1f7f-47aa-ad7a-513413240c0c None admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:51.771360 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a641579-1f7f-47aa-ad7a-513413240c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:51.771640 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a641579-1f7f-47aa-ad7a-513413240c0c None admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:51.772615 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a641579-1f7f-47aa-ad7a-513413240c0c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:51.773785 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a641579-1f7f-47aa-ad7a-513413240c0c None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:51.791295 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e5b98-c00b-4261-80ef-9838dbaeb693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:51.791972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e5b98-c00b-4261-80ef-9838dbaeb693 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:51.792314 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e5b98-c00b-4261-80ef-9838dbaeb693 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:51.792715 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e5b98-c00b-4261-80ef-9838dbaeb693 None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:51.793453 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e5b98-c00b-4261-80ef-9838dbaeb693 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:51.793766 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e5b98-c00b-4261-80ef-9838dbaeb693 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:51.795549 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e5b98-c00b-4261-80ef-9838dbaeb693 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:51.795662 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 237/473] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jul 19 15:18:51 2022] POST /identity/v3/users => generated 248 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:18:51.797057 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4196a3c-199a-45f6-b6e0-e6fa4999fd07 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:51.797834 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4196a3c-199a-45f6-b6e0-e6fa4999fd07 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:51.797834 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4196a3c-199a-45f6-b6e0-e6fa4999fd07 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:51.798959 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 238/474] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:51.804890 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ab45a-bba8-4fd3-a1a3-38c66994b1f4 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:51.805184 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ab45a-bba8-4fd3-a1a3-38c66994b1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:51.805595 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ab45a-bba8-4fd3-a1a3-38c66994b1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:51.817726 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 237/475] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:51.823391 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e5b98-c00b-4261-80ef-9838dbaeb693 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:51.824894 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-e59ab45a-bba8-4fd3-a1a3-38c66994b1f4 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:51.826382 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-e59ab45a-bba8-4fd3-a1a3-38c66994b1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:51.910019 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 239/476] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:18:51.944540 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e5b98-c00b-4261-80ef-9838dbaeb693 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:51.947654 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ab45a-bba8-4fd3-a1a3-38c66994b1f4 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:51.982753 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c216c1-ef88-42c3-a520-1567be343a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:51.983506 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c216c1-ef88-42c3-a520-1567be343a8a None admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:51.983795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c216c1-ef88-42c3-a520-1567be343a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:51.984077 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c216c1-ef88-42c3-a520-1567be343a8a None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:51.984806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c216c1-ef88-42c3-a520-1567be343a8a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:51.986471 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c216c1-ef88-42c3-a520-1567be343a8a None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:52.010513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 238/477] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jul 19 15:18:51 2022] POST /identity/v3/users => generated 249 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:18:52.113316 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ab45a-bba8-4fd3-a1a3-38c66994b1f4 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:52.115620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:52.152920 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4d6ea-e842-42c5-bd2d-abea2efcdd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:52.153632 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4d6ea-e842-42c5-bd2d-abea2efcdd9b None admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:52.153927 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4d6ea-e842-42c5-bd2d-abea2efcdd9b None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:52.154216 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4d6ea-e842-42c5-bd2d-abea2efcdd9b None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:52.155000 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4d6ea-e842-42c5-bd2d-abea2efcdd9b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:52.156716 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4d6ea-e842-42c5-bd2d-abea2efcdd9b None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:52.167206 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.sql.core [None req-f6c4d6ea-e842-42c5-bd2d-abea2efcdd9b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 19 15:18:52.167206 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 19 15:18:52.167206 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [parameters: {'id': '7c2b65fb11934a6295d1ba026aa33df6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 19 15:18:52.167206 dv-cinder-849846-2-smb devstack@keystone.service[80304]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80304) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 19 15:18:52.184975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-f6c4d6ea-e842-42c5-bd2d-abea2efcdd9b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 19 15:18:52.184975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:52.184975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 15:18:52.184975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 15:18:52.184975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 15:18:52.184975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 15:18:52.184975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 15:18:52.184975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 15:18:52.184975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 15:18:52.184975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application conn.query(q) Jul 19 15:18:52.184975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 15:18:52.184975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 15:18:52.184975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 15:18:52.184975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application result.read() Jul 19 15:18:52.184975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 15:18:52.185906 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 15:18:52.185906 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 15:18:52.185906 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 15:18:52.185906 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 15:18:52.185906 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 15:18:52.185906 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 15:18:52.185906 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 15:18:52.185906 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 19 15:18:52.185906 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:52.185906 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 19 15:18:52.185906 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:52.185906 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:52.185906 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 19 15:18:52.185906 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 19 15:18:52.185906 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 19 15:18:52.185906 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return ref.to_dict() Jul 19 15:18:52.185906 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 15:18:52.185906 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application next(self.gen) Jul 19 15:18:52.186813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 19 15:18:52.186813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application yield resource Jul 19 15:18:52.186813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 15:18:52.186813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application next(self.gen) Jul 19 15:18:52.186813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 19 15:18:52.186813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self.session.rollback() Jul 19 15:18:52.186813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 15:18:52.186813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self.force_reraise() Jul 19 15:18:52.186813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 15:18:52.186813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise self.value Jul 19 15:18:52.186813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 19 15:18:52.186813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 19 15:18:52.186813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 19 15:18:52.186813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application session.commit() Jul 19 15:18:52.186813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 19 15:18:52.186813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 19 15:18:52.186813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 19 15:18:52.188264 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._prepare_impl() Jul 19 15:18:52.188264 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 19 15:18:52.188264 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self.session.flush() Jul 19 15:18:52.188264 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 15:18:52.188264 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._flush(objects) Jul 19 15:18:52.188264 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 15:18:52.188264 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 19 15:18:52.188264 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 15:18:52.188264 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application compat.raise_( Jul 19 15:18:52.188264 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 15:18:52.188264 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception Jul 19 15:18:52.188264 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 15:18:52.188264 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application flush_context.execute() Jul 19 15:18:52.188264 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 15:18:52.188264 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rec.execute(self) Jul 19 15:18:52.188264 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 15:18:52.188264 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 19 15:18:52.189154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 15:18:52.189154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 19 15:18:52.189154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 19 15:18:52.189154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 19 15:18:52.189154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 15:18:52.189154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 15:18:52.189154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 15:18:52.189154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 19 15:18:52.189154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 15:18:52.189154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 19 15:18:52.189154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 15:18:52.189154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 19 15:18:52.189154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 15:18:52.189154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 15:18:52.189154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 15:18:52.189154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception Jul 19 15:18:52.189948 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 15:18:52.189948 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 15:18:52.189948 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 15:18:52.189948 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 15:18:52.189948 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 15:18:52.189948 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 15:18:52.189948 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 15:18:52.189948 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application conn.query(q) Jul 19 15:18:52.189948 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 15:18:52.189948 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 15:18:52.189948 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 15:18:52.189948 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application result.read() Jul 19 15:18:52.189948 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 15:18:52.189948 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 15:18:52.189948 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 15:18:52.189948 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 15:18:52.190725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 15:18:52.190725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 15:18:52.190725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 15:18:52.190725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 15:18:52.190725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 19 15:18:52.190725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 19 15:18:52.190725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [parameters: {'id': '7c2b65fb11934a6295d1ba026aa33df6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 19 15:18:52.190725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 15:18:52.190725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:52.190725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:18:52.190725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:52.190725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:52.190725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:52.190725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:52.190725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:52.190725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:52.193364 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:52.193364 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:52.193364 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:52.193364 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:52.193364 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:52.193364 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:52.193364 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 19 15:18:52.193364 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 19 15:18:52.193364 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:52.193364 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:52.193364 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 19 15:18:52.193364 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 19 15:18:52.193364 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 19 15:18:52.193364 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 19 15:18:52.193364 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 19 15:18:52.193364 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:52.194975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 240/478] 10.222.0.44 () {60 vars in 1131 bytes} [Tue Jul 19 15:18:51 2022] POST /identity/v3/roles => generated 144 bytes in 240 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:52.201021 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c216c1-ef88-42c3-a520-1567be343a8a None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:52.247625 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:52.353733 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c216c1-ef88-42c3-a520-1567be343a8a None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:52.395416 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6edbc-65f6-4bf0-955f-8e8fbf77ac4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:52.396170 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6edbc-65f6-4bf0-955f-8e8fbf77ac4f None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:52.396457 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6edbc-65f6-4bf0-955f-8e8fbf77ac4f None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:52.396806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6edbc-65f6-4bf0-955f-8e8fbf77ac4f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:52.410175 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e6edbc-65f6-4bf0-955f-8e8fbf77ac4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:52.419261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-19e6edbc-65f6-4bf0-955f-8e8fbf77ac4f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:18:52.419261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:52.419261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:52.419261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:52.419261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:52.419261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:52.419261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:52.419261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:52.419261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:52.419261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:52.419261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:52.419261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:52.419261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:52.419261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:52.419261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:52.419261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:52.420473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:52.420473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:52.420473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:52.420473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:52.420473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:52.420473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:52.420473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:52.420473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:52.420473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:52.420473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:52.420473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:52.420473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:52.420473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:52.420473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:52.420473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:52.420473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:52.421412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:52.421412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:52.421412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:52.421412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:52.421412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:52.421412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:52.421412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:52.421412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:52.421412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:52.421412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:52.421412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 15:18:52.421412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:52.421412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 239/479] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 19 15:18:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:52.428248 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4d6ea-e842-42c5-bd2d-abea2efcdd9b None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:52.566648 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4d6ea-e842-42c5-bd2d-abea2efcdd9b None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:52.617493 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479af26-1b01-45d5-8f94-7f6bf9a55758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:52.618161 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479af26-1b01-45d5-8f94-7f6bf9a55758 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:52.618492 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479af26-1b01-45d5-8f94-7f6bf9a55758 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:52.618796 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479af26-1b01-45d5-8f94-7f6bf9a55758 None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:52.620085 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479af26-1b01-45d5-8f94-7f6bf9a55758 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:52.620401 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479af26-1b01-45d5-8f94-7f6bf9a55758 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:52.621759 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479af26-1b01-45d5-8f94-7f6bf9a55758 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:52.631446 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 241/480] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:18:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:53.601457 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb34a6-cf76-405e-ba03-fff0f5cec087 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:53.601994 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb34a6-cf76-405e-ba03-fff0f5cec087 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:53.602070 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb34a6-cf76-405e-ba03-fff0f5cec087 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:53.603658 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 240/481] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:53.609964 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5528711-9d8f-462f-b9c8-b29b7d3d2e6f None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:53.610526 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5528711-9d8f-462f-b9c8-b29b7d3d2e6f None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:53.610526 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5528711-9d8f-462f-b9c8-b29b7d3d2e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:53.636871 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-a5528711-9d8f-462f-b9c8-b29b7d3d2e6f None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:53.638104 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-a5528711-9d8f-462f-b9c8-b29b7d3d2e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:53.678473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:53.772302 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 242/482] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:53.837916 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb34a6-cf76-405e-ba03-fff0f5cec087 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:53.965353 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:53.979920 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb34a6-cf76-405e-ba03-fff0f5cec087 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:54.025101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d0585-c405-465a-8e6f-f1e0704b4593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:54.025902 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d0585-c405-465a-8e6f-f1e0704b4593 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:54.026189 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d0585-c405-465a-8e6f-f1e0704b4593 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:54.026473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d0585-c405-465a-8e6f-f1e0704b4593 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:54.037935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d0585-c405-465a-8e6f-f1e0704b4593 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:54.045722 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-6c3d0585-c405-465a-8e6f-f1e0704b4593 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:18:54.045722 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:54.045722 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:54.045722 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:54.045722 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:54.045722 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:54.045722 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:54.045722 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:54.045722 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:54.045722 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:54.045722 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:54.045722 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:54.045722 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:54.045722 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:54.045722 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:54.045722 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:54.046621 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:54.046621 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:54.046621 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:54.046621 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:54.046621 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:54.046621 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:54.046621 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:54.046621 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:54.046621 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:54.046621 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:54.046621 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:54.046621 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:54.046621 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:54.046621 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:54.046621 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:54.046621 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:54.047455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:54.047455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:54.047455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:54.047455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:54.047455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:54.047455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:54.047455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:54.047455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:54.047455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:54.047455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:54.047455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:18:54.047455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:54.047455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 241/483] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 19 15:18:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:54.056750 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5528711-9d8f-462f-b9c8-b29b7d3d2e6f None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:54.221498 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5528711-9d8f-462f-b9c8-b29b7d3d2e6f None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:54.266382 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0896d-a84a-4827-a71a-f5ec894f121f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:54.267071 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0896d-a84a-4827-a71a-f5ec894f121f None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:54.267385 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0896d-a84a-4827-a71a-f5ec894f121f None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:54.267665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0896d-a84a-4827-a71a-f5ec894f121f None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:54.270793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78022a6d-e46e-4994-91c2-77c3d6ef765c None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:54.271382 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78022a6d-e46e-4994-91c2-77c3d6ef765c None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:54.271867 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78022a6d-e46e-4994-91c2-77c3d6ef765c None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:54.271972 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0896d-a84a-4827-a71a-f5ec894f121f None admin] RBAC: Adding query filter params (name=service) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:54.272311 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0896d-a84a-4827-a71a-f5ec894f121f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:54.273827 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0896d-a84a-4827-a71a-f5ec894f121f None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:54.274243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 242/484] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:18:54.279938 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67596cc3-3fc1-4af3-9441-ab3c59fd72ad None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:54.280486 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67596cc3-3fc1-4af3-9441-ab3c59fd72ad None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:54.280777 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67596cc3-3fc1-4af3-9441-ab3c59fd72ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:54.288822 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 243/485] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 19 15:18:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:54.293983 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0896d-a84a-4827-a71a-f5ec894f121f None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:54.313063 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-67596cc3-3fc1-4af3-9441-ab3c59fd72ad None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:54.314302 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-67596cc3-3fc1-4af3-9441-ab3c59fd72ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:54.340560 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:54.437741 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 243/486] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:18:54.463459 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67596cc3-3fc1-4af3-9441-ab3c59fd72ad None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:54.532853 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0896d-a84a-4827-a71a-f5ec894f121f None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:54.592106 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:54.592995 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f6bf5-d7d3-4bea-b6fb-0c2dadaf621d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:54.593906 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f6bf5-d7d3-4bea-b6fb-0c2dadaf621d None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:54.594090 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f6bf5-d7d3-4bea-b6fb-0c2dadaf621d None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:54.594416 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f6bf5-d7d3-4bea-b6fb-0c2dadaf621d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:54.617100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f6bf5-d7d3-4bea-b6fb-0c2dadaf621d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:54.618569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f6bf5-d7d3-4bea-b6fb-0c2dadaf621d None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:54.633117 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67596cc3-3fc1-4af3-9441-ab3c59fd72ad None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:54.676444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-7b0f6bf5-d7d3-4bea-b6fb-0c2dadaf621d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:18:54.676444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:54.676444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:54.676444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:54.676444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:54.676444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:54.676444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:54.676444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:54.676444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:54.676444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:54.676444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:54.676444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:54.676444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:18:54.676444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:18:54.676444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:18:54.677385 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:18:54.677385 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:54.677385 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:54.677385 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:54.677385 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:54.677385 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:54.677385 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:54.677385 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:54.677385 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:54.677385 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:54.677385 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:54.677385 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:54.677385 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:54.677385 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:54.677385 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:54.677385 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:54.677385 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:54.678223 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:18:54.678223 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:18:54.678223 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:18:54.678223 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:54.678457 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 244/487] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:18:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:54.684725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f6bf5-d7d3-4bea-b6fb-0c2dadaf621d None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:54.704028 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff47857-b287-4519-930e-7f48333798b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:54.704842 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff47857-b287-4519-930e-7f48333798b3 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:54.705129 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff47857-b287-4519-930e-7f48333798b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:54.705410 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff47857-b287-4519-930e-7f48333798b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:54.717955 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff47857-b287-4519-930e-7f48333798b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:54.726489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-bff47857-b287-4519-930e-7f48333798b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:18:54.726489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:54.726489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:54.726489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:54.726489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:54.726489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:54.726489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:54.726489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:54.726489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:54.726489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:54.726489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:54.726489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:54.726489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:54.726489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:54.726489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:54.726489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:54.727500 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:54.727500 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:54.727500 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:54.727500 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:54.727500 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:54.727500 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:54.727500 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:54.727500 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:54.727500 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:54.727500 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:54.727500 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:54.727500 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:54.727500 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:54.727500 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:54.727500 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:54.727500 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:54.728338 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:54.728338 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:54.728338 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:54.728338 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:54.728338 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:54.728338 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:54.728338 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:54.728338 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:54.728338 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:54.728338 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:54.728338 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:18:54.728338 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:54.728338 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 244/488] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 19 15:18:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:18:54.729611 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e339f-0fc8-4453-8655-acc2ffd79cf3 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:54.729775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e339f-0fc8-4453-8655-acc2ffd79cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:54.730037 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e339f-0fc8-4453-8655-acc2ffd79cf3 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:54.731833 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 245/489] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:54.737402 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e339f-0fc8-4453-8655-acc2ffd79cf3 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:54.788245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:54.850640 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f6bf5-d7d3-4bea-b6fb-0c2dadaf621d None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:54.888479 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f1c14-82cd-4932-8a39-16b0b1859797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:54.889580 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f1c14-82cd-4932-8a39-16b0b1859797 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:54.889872 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f1c14-82cd-4932-8a39-16b0b1859797 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:54.890153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f1c14-82cd-4932-8a39-16b0b1859797 None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:54.890897 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f1c14-82cd-4932-8a39-16b0b1859797 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:54.891210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f1c14-82cd-4932-8a39-16b0b1859797 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:54.892952 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f1c14-82cd-4932-8a39-16b0b1859797 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:54.906550 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 245/490] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:54.907681 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c170916-4049-49c0-9196-4cd906d6eaf4 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:54.907969 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c170916-4049-49c0-9196-4cd906d6eaf4 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:54.908247 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c170916-4049-49c0-9196-4cd906d6eaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:54.927131 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-9c170916-4049-49c0-9196-4cd906d6eaf4 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:54.927131 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-9c170916-4049-49c0-9196-4cd906d6eaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:54.938155 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e339f-0fc8-4453-8655-acc2ffd79cf3 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:54.988272 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c063d-70a9-4b5e-92b7-6d0af7ae3105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:54.989829 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c063d-70a9-4b5e-92b7-6d0af7ae3105 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:54.990264 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c063d-70a9-4b5e-92b7-6d0af7ae3105 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:54.990669 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c063d-70a9-4b5e-92b7-6d0af7ae3105 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:54.991635 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c063d-70a9-4b5e-92b7-6d0af7ae3105 None admin] RBAC: Adding query filter params (name=service) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:54.992072 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c063d-70a9-4b5e-92b7-6d0af7ae3105 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:54.993987 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c063d-70a9-4b5e-92b7-6d0af7ae3105 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:55.010169 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 246/491] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 19 15:18:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:55.010169 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc6c37-65ab-4e7e-ad1f-28ec3472a355 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:55.010169 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc6c37-65ab-4e7e-ad1f-28ec3472a355 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:55.010169 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc6c37-65ab-4e7e-ad1f-28ec3472a355 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:55.010169 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 247/492] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:55.010169 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc6c37-65ab-4e7e-ad1f-28ec3472a355 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:55.015172 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:55.027895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 246/493] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:55.027895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c170916-4049-49c0-9196-4cd906d6eaf4 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:55.120888 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:55.153616 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc6c37-65ab-4e7e-ad1f-28ec3472a355 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:55.169987 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c170916-4049-49c0-9196-4cd906d6eaf4 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:55.192318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbecf4-be00-421a-b13a-428e49085ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:55.193205 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbecf4-be00-421a-b13a-428e49085ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:55.193496 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbecf4-be00-421a-b13a-428e49085ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:55.193772 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbecf4-be00-421a-b13a-428e49085ae7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:55.202494 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbecf4-be00-421a-b13a-428e49085ae7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:55.204036 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbecf4-be00-421a-b13a-428e49085ae7 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:55.209121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba18c54-2c33-4d55-a1a1-975159271c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:55.209924 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba18c54-2c33-4d55-a1a1-975159271c8d None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:55.210214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba18c54-2c33-4d55-a1a1-975159271c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:55.210496 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba18c54-2c33-4d55-a1a1-975159271c8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:55.221172 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba18c54-2c33-4d55-a1a1-975159271c8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:55.222632 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba18c54-2c33-4d55-a1a1-975159271c8d None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:55.222790 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-bcbbecf4-be00-421a-b13a-428e49085ae7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:18:55.222790 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:55.222790 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:55.222790 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:55.222790 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:55.222790 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:55.222790 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:55.222790 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:55.222790 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:55.222790 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:55.222790 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:55.222790 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:55.222790 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:18:55.222790 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:18:55.222790 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:18:55.222790 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:18:55.224348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:55.224348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:55.224348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:18:55.224348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:18:55.224348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:18:55.224348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:18:55.224348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:55.224348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:55.224348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:55.224348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:55.224348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:55.224348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:55.224348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:55.224348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:55.224348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:55.224348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:55.224348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:55.224348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:55.225265 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:55.225265 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:55.225265 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:18:55.225265 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:18:55.225265 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:18:55.225265 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:18:55.225265 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:18:55.225265 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:18:55.225265 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:18:55.225265 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:55.225265 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 248/494] 10.222.0.44 () {56 vars in 1093 bytes} [Tue Jul 19 15:18:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:55.226471 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea850e-4c69-4db9-a41f-0cf15d0fa90e None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:55.226471 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea850e-4c69-4db9-a41f-0cf15d0fa90e None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:55.226471 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea850e-4c69-4db9-a41f-0cf15d0fa90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:55.244122 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-22ea850e-4c69-4db9-a41f-0cf15d0fa90e None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:55.245339 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-22ea850e-4c69-4db9-a41f-0cf15d0fa90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:55.250285 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-fba18c54-2c33-4d55-a1a1-975159271c8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:18:55.250285 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:55.250285 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:55.250285 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:55.250285 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:55.250285 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:55.250285 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:55.250285 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:55.250285 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:55.250285 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:55.250285 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:55.250285 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:55.250285 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:18:55.250285 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:18:55.250285 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:18:55.256503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:18:55.256503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:55.256503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:55.256503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:55.256503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:55.256503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:55.256503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:55.256503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:55.256503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:55.256503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:55.256503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:55.256503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:55.256503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:55.256503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:55.256503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:55.256503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:55.256503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:55.257365 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:18:55.257365 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:18:55.257365 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:18:55.257365 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:55.257365 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 247/495] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:18:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:55.257365 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba18c54-2c33-4d55-a1a1-975159271c8d None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:55.315772 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:55.328225 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 249/496] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:55.328892 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea850e-4c69-4db9-a41f-0cf15d0fa90e None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:55.399482 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba18c54-2c33-4d55-a1a1-975159271c8d None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:55.422549 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:55.459809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a40b7d-1d45-4d65-ba07-b9b5630f7863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:55.460763 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a40b7d-1d45-4d65-ba07-b9b5630f7863 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:55.461115 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a40b7d-1d45-4d65-ba07-b9b5630f7863 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:55.461465 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a40b7d-1d45-4d65-ba07-b9b5630f7863 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:55.474540 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea850e-4c69-4db9-a41f-0cf15d0fa90e None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:55.474790 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a40b7d-1d45-4d65-ba07-b9b5630f7863 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:55.482536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-00a40b7d-1d45-4d65-ba07-b9b5630f7863 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:18:55.482536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:55.482536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:55.482536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:55.482536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:55.482536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:55.482536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:55.482536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:55.482536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:55.482536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:55.482536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:55.482536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:55.482536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:55.482536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:55.482536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:55.482536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:55.483533 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:55.483533 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:55.483533 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:55.483533 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:55.483533 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:55.483533 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:55.483533 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:55.483533 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:55.483533 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:55.483533 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:55.483533 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:55.483533 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:55.483533 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:55.483533 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:55.483533 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:55.483533 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:55.484342 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:55.484342 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:55.484342 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:55.484342 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:55.484342 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:55.484342 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:55.484342 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:55.484342 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:55.484342 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:55.484342 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:55.484342 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:18:55.484342 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:55.484342 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 248/497] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 19 15:18:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:55.484987 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a40b7d-1d45-4d65-ba07-b9b5630f7863 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:55.516218 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4717690-d2d4-4443-8a33-58a4f9e70eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:55.517267 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4717690-d2d4-4443-8a33-58a4f9e70eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:55.517549 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4717690-d2d4-4443-8a33-58a4f9e70eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:55.517826 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4717690-d2d4-4443-8a33-58a4f9e70eb5 None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:55.518679 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4717690-d2d4-4443-8a33-58a4f9e70eb5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:55.519509 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4717690-d2d4-4443-8a33-58a4f9e70eb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:55.521093 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4717690-d2d4-4443-8a33-58a4f9e70eb5 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:55.558585 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 250/498] 10.222.0.44 () {56 vars in 1133 bytes} [Tue Jul 19 15:18:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:55.559466 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4717690-d2d4-4443-8a33-58a4f9e70eb5 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:55.606997 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a40b7d-1d45-4d65-ba07-b9b5630f7863 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:55.611446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:55.643022 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc3a32-75d6-4c2d-af2b-e7f41c431dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:55.643726 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc3a32-75d6-4c2d-af2b-e7f41c431dfa None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:55.644018 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc3a32-75d6-4c2d-af2b-e7f41c431dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:55.644300 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc3a32-75d6-4c2d-af2b-e7f41c431dfa None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:55.645149 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc3a32-75d6-4c2d-af2b-e7f41c431dfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:55.645920 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc3a32-75d6-4c2d-af2b-e7f41c431dfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:55.647337 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc3a32-75d6-4c2d-af2b-e7f41c431dfa None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:55.660989 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 249/499] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:55.663058 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5d07e-1ff0-4403-a835-5cfd89d57452 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:55.663386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5d07e-1ff0-4403-a835-5cfd89d57452 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:55.663690 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5d07e-1ff0-4403-a835-5cfd89d57452 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:55.664989 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 250/500] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:18:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:18:55.665718 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad5d07e-1ff0-4403-a835-5cfd89d57452 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:55.679334 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4717690-d2d4-4443-8a33-58a4f9e70eb5 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:55.715977 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:55.730495 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7ceb3-45d2-43ab-b121-483b4bb3309c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:55.731445 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7ceb3-45d2-43ab-b121-483b4bb3309c None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:55.731739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7ceb3-45d2-43ab-b121-483b4bb3309c None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:55.732179 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7ceb3-45d2-43ab-b121-483b4bb3309c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:55.746689 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7ceb3-45d2-43ab-b121-483b4bb3309c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:18:55.755583 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-28c7ceb3-45d2-43ab-b121-483b4bb3309c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:18:55.755583 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:55.755583 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:55.755583 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:55.755583 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:55.755583 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:55.755583 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:55.755583 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:55.755583 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:55.755583 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:55.755583 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:55.755583 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:55.755583 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:18:55.755583 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:18:55.755583 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:18:55.755583 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:18:55.756504 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:18:55.756504 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:18:55.756504 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:18:55.756504 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:18:55.756504 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:55.756504 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:55.756504 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:55.756504 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:55.756504 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:55.756504 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:55.756504 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:55.756504 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:55.756504 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:55.756504 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:55.756504 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:55.756504 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:55.757356 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:55.757356 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:55.757356 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:55.757356 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:55.757356 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:18:55.757356 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:18:55.757356 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:18:55.757356 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:18:55.757356 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:18:55.757356 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:18:55.757356 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:18:55.757356 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:55.759528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 251/501] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 19 15:18:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:55.760391 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7ceb3-45d2-43ab-b121-483b4bb3309c None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:55.789014 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad5d07e-1ff0-4403-a835-5cfd89d57452 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:55.834777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdcc1c-2902-4d99-b33c-9afc3d203346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:55.835800 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdcc1c-2902-4d99-b33c-9afc3d203346 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:55.836115 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdcc1c-2902-4d99-b33c-9afc3d203346 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:55.836384 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdcc1c-2902-4d99-b33c-9afc3d203346 None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:55.837159 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdcc1c-2902-4d99-b33c-9afc3d203346 None admin] RBAC: Adding query filter params (name=service) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:55.837475 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdcc1c-2902-4d99-b33c-9afc3d203346 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:55.838859 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdcc1c-2902-4d99-b33c-9afc3d203346 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:55.848373 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 251/502] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 19 15:18:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:55.849032 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdcc1c-2902-4d99-b33c-9afc3d203346 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:55.869711 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7ceb3-45d2-43ab-b121-483b4bb3309c None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:55.881070 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:55.906367 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9d841-f740-4831-a562-a1bd2f3a964c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:55.907014 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9d841-f740-4831-a562-a1bd2f3a964c None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:55.907343 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9d841-f740-4831-a562-a1bd2f3a964c None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:55.907608 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9d841-f740-4831-a562-a1bd2f3a964c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:55.961881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:55.968364 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdcc1c-2902-4d99-b33c-9afc3d203346 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:55.981704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9d841-f740-4831-a562-a1bd2f3a964c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:55.983614 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9d841-f740-4831-a562-a1bd2f3a964c None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:56.003354 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ef661-2dd0-4596-8e31-d4c7a316cca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:56.004163 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ef661-2dd0-4596-8e31-d4c7a316cca7 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:56.005435 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ef661-2dd0-4596-8e31-d4c7a316cca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:56.005727 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ef661-2dd0-4596-8e31-d4c7a316cca7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:56.014373 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ef661-2dd0-4596-8e31-d4c7a316cca7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:56.015886 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ef661-2dd0-4596-8e31-d4c7a316cca7 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:56.032429 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-2b7ef661-2dd0-4596-8e31-d4c7a316cca7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 19 15:18:56.032429 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:56.032429 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:56.032429 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:56.032429 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:56.032429 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:56.032429 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:56.032429 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:56.032429 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:56.032429 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:56.032429 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:56.032429 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:56.032429 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:18:56.032429 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:18:56.032429 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:18:56.032429 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:18:56.033436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:56.033436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:56.033436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:18:56.033436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:18:56.033436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:18:56.033436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:18:56.033436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:56.033436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:56.033436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:56.033436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:56.033436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:56.033436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:56.033436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:56.033436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:56.033436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:56.033436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:56.033436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:56.033436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:56.034334 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:56.034334 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:56.034334 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:18:56.034334 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:18:56.034334 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:18:56.034334 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:18:56.034334 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:18:56.034334 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:18:56.034334 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 19 15:18:56.034334 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:56.034334 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 252/503] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:56.035311 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9c4d0-a552-4e14-819a-a907a2925f05 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:56.035620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9c4d0-a552-4e14-819a-a907a2925f05 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:56.036492 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9c4d0-a552-4e14-819a-a907a2925f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:56.058834 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-b3e9c4d0-a552-4e14-819a-a907a2925f05 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:56.060081 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-b3e9c4d0-a552-4e14-819a-a907a2925f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:56.095010 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 252/504] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:18:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:18:56.095909 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9d841-f740-4831-a562-a1bd2f3a964c None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:56.108110 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:56.133398 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 253/505] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:18:56.134240 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9c4d0-a552-4e14-819a-a907a2925f05 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:56.198664 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9d841-f740-4831-a562-a1bd2f3a964c None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:56.217225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:56.233296 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1325c4-6f30-41da-a98b-6bdf1218ccec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:56.233684 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9c4d0-a552-4e14-819a-a907a2925f05 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:56.233961 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1325c4-6f30-41da-a98b-6bdf1218ccec None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:56.234249 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1325c4-6f30-41da-a98b-6bdf1218ccec None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:56.234528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1325c4-6f30-41da-a98b-6bdf1218ccec None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:56.235307 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1325c4-6f30-41da-a98b-6bdf1218ccec None admin] RBAC: Adding query filter params (name=service) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:56.235617 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1325c4-6f30-41da-a98b-6bdf1218ccec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:56.236991 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1325c4-6f30-41da-a98b-6bdf1218ccec None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:56.245651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 253/506] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 19 15:18:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:56.246452 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1325c4-6f30-41da-a98b-6bdf1218ccec None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:56.271379 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148fcfb-bf6c-4cd1-9e40-d1a5cce38abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:56.272169 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148fcfb-bf6c-4cd1-9e40-d1a5cce38abf None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:56.272454 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148fcfb-bf6c-4cd1-9e40-d1a5cce38abf None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:56.272731 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148fcfb-bf6c-4cd1-9e40-d1a5cce38abf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:56.282814 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148fcfb-bf6c-4cd1-9e40-d1a5cce38abf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:56.284277 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148fcfb-bf6c-4cd1-9e40-d1a5cce38abf None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:56.303848 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-6148fcfb-bf6c-4cd1-9e40-d1a5cce38abf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:18:56.303848 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:56.303848 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:56.303848 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:56.303848 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:56.303848 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:56.303848 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:56.303848 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:56.303848 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:56.303848 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:56.303848 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:56.303848 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:56.303848 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:18:56.303848 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:18:56.303848 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:18:56.304899 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:18:56.304899 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:56.304899 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:56.304899 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:56.304899 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:56.304899 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:56.304899 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:56.304899 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:56.304899 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:56.304899 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:56.304899 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:56.304899 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:56.304899 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:56.304899 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:56.304899 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:56.304899 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:56.304899 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:56.305769 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:18:56.305769 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:18:56.305769 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:18:56.305769 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:56.305769 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 254/507] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:18:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:56.306288 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148fcfb-bf6c-4cd1-9e40-d1a5cce38abf None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:56.321660 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:56.352651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1325c4-6f30-41da-a98b-6bdf1218ccec None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:56.387570 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8279e7-a87e-4650-9f62-d6e6c5371166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:56.388241 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8279e7-a87e-4650-9f62-d6e6c5371166 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:56.388524 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8279e7-a87e-4650-9f62-d6e6c5371166 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:56.388796 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8279e7-a87e-4650-9f62-d6e6c5371166 None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:56.389697 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8279e7-a87e-4650-9f62-d6e6c5371166 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:56.390005 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8279e7-a87e-4650-9f62-d6e6c5371166 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:56.391465 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8279e7-a87e-4650-9f62-d6e6c5371166 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:56.410601 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 254/508] 10.222.0.44 () {56 vars in 1137 bytes} [Tue Jul 19 15:18:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:56.411595 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148fcfb-bf6c-4cd1-9e40-d1a5cce38abf None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:56.412267 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8279e7-a87e-4650-9f62-d6e6c5371166 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:56.455771 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3fb4b-126d-44a1-a988-56edc4dac2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:56.456575 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3fb4b-126d-44a1-a988-56edc4dac2a0 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:56.456860 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3fb4b-126d-44a1-a988-56edc4dac2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:56.457143 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3fb4b-126d-44a1-a988-56edc4dac2a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:56.465150 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:56.470912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3fb4b-126d-44a1-a988-56edc4dac2a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:56.472333 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3fb4b-126d-44a1-a988-56edc4dac2a0 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:56.492655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-6ee3fb4b-126d-44a1-a988-56edc4dac2a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:18:56.492655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:56.492655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:56.492655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:56.492655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:56.492655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:56.492655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:56.492655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:56.492655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:56.492655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:56.492655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:56.492655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:56.492655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:18:56.492655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:18:56.492655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:18:56.493652 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:18:56.493652 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:56.493652 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:56.493652 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:56.493652 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:56.493652 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:56.493652 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:56.493652 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:56.493652 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:56.493652 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:56.493652 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:56.493652 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:56.493652 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:56.493652 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:56.493652 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:56.493652 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:56.493652 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:56.494492 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:18:56.494492 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:18:56.494492 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:18:56.494492 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:56.494492 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 255/509] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:18:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:56.494762 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3fb4b-126d-44a1-a988-56edc4dac2a0 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:56.523820 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8279e7-a87e-4650-9f62-d6e6c5371166 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:56.557763 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:56.566538 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7a4fe-f250-402d-b082-4ee884101608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:56.567613 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7a4fe-f250-402d-b082-4ee884101608 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:56.567931 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7a4fe-f250-402d-b082-4ee884101608 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:56.568208 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7a4fe-f250-402d-b082-4ee884101608 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:56.581169 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7a4fe-f250-402d-b082-4ee884101608 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:56.583520 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7a4fe-f250-402d-b082-4ee884101608 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:56.602899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-13e7a4fe-f250-402d-b082-4ee884101608 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:18:56.602899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:56.602899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:56.602899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:56.602899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:56.602899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:56.602899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:56.602899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:56.602899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:56.602899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:56.602899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:56.602899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:56.602899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:18:56.602899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:18:56.602899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:18:56.604020 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:18:56.604020 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:56.604020 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:56.604020 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:56.604020 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:56.604020 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:56.604020 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:56.604020 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:56.604020 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:56.604020 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:56.604020 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:56.604020 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:56.604020 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:56.604020 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:56.604020 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:56.604020 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:56.604020 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:56.604869 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:18:56.604869 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:18:56.604869 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:18:56.604869 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:56.604869 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 255/510] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:18:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:56.605136 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7a4fe-f250-402d-b082-4ee884101608 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:56.626991 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3fb4b-126d-44a1-a988-56edc4dac2a0 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:56.666014 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bfe48-593f-4afc-8223-ef167a5f846f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:56.666811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bfe48-593f-4afc-8223-ef167a5f846f None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:56.667093 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bfe48-593f-4afc-8223-ef167a5f846f None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:56.667399 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bfe48-593f-4afc-8223-ef167a5f846f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:56.678475 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489bfe48-593f-4afc-8223-ef167a5f846f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:56.679956 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489bfe48-593f-4afc-8223-ef167a5f846f None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:56.697202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-489bfe48-593f-4afc-8223-ef167a5f846f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:18:56.697202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:56.697202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:56.697202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:56.697202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:56.697202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:56.697202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:56.697202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:56.697202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:56.697202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:56.697202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:56.697202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:56.697202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:18:56.697202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:18:56.697202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:18:56.698214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:18:56.698214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:56.698214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:56.698214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:56.698214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:56.698214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:56.698214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:56.698214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:56.698214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:56.698214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:56.698214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:56.698214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:56.698214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:56.698214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:56.698214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:56.698214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:56.698214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:56.699049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:18:56.699049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:18:56.699049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:18:56.699049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:56.703034 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 256/511] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:18:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:56.703915 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bfe48-593f-4afc-8223-ef167a5f846f None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:56.716276 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7a4fe-f250-402d-b082-4ee884101608 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:56.749656 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:56.749958 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f5c67-d38f-450e-b287-c2e601c3b304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:56.750620 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f5c67-d38f-450e-b287-c2e601c3b304 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:56.750900 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f5c67-d38f-450e-b287-c2e601c3b304 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:56.751175 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f5c67-d38f-450e-b287-c2e601c3b304 None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:56.751938 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f5c67-d38f-450e-b287-c2e601c3b304 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:56.752244 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f5c67-d38f-450e-b287-c2e601c3b304 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:56.753666 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f5c67-d38f-450e-b287-c2e601c3b304 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:56.768203 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 256/512] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:56.769291 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f5c67-d38f-450e-b287-c2e601c3b304 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:56.819672 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bfe48-593f-4afc-8223-ef167a5f846f None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:56.824091 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:56.859464 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa9b07-23d2-4e0e-8570-f3edd2926e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:56.860133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa9b07-23d2-4e0e-8570-f3edd2926e03 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:56.860423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa9b07-23d2-4e0e-8570-f3edd2926e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:56.860712 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa9b07-23d2-4e0e-8570-f3edd2926e03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:56.887277 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f5c67-d38f-450e-b287-c2e601c3b304 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:56.923159 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde12bf-4a6f-485a-a117-b62387862220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:56.923873 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde12bf-4a6f-485a-a117-b62387862220 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:56.924162 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde12bf-4a6f-485a-a117-b62387862220 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:56.924446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde12bf-4a6f-485a-a117-b62387862220 None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:56.925187 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde12bf-4a6f-485a-a117-b62387862220 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:56.925501 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde12bf-4a6f-485a-a117-b62387862220 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:56.926930 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde12bf-4a6f-485a-a117-b62387862220 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:56.930955 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa9b07-23d2-4e0e-8570-f3edd2926e03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:56.932443 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa9b07-23d2-4e0e-8570-f3edd2926e03 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:56.950929 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 257/513] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:56.950929 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde12bf-4a6f-485a-a117-b62387862220 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:56.980825 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:57.044198 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 257/514] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:18:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:18:57.044960 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa9b07-23d2-4e0e-8570-f3edd2926e03 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:57.052625 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde12bf-4a6f-485a-a117-b62387862220 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:57.054214 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:57.089260 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef309804-99ab-4c73-afb6-4a8a1cd3692d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:57.089947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef309804-99ab-4c73-afb6-4a8a1cd3692d None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:57.090257 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef309804-99ab-4c73-afb6-4a8a1cd3692d None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:57.090530 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef309804-99ab-4c73-afb6-4a8a1cd3692d None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:57.091278 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef309804-99ab-4c73-afb6-4a8a1cd3692d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:57.091586 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef309804-99ab-4c73-afb6-4a8a1cd3692d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:57.092976 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef309804-99ab-4c73-afb6-4a8a1cd3692d None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:57.110332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 258/515] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:57.111178 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef309804-99ab-4c73-afb6-4a8a1cd3692d None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:57.152485 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa9b07-23d2-4e0e-8570-f3edd2926e03 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:57.188685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3531fbb-a268-4783-bccb-41756641434e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:57.189446 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3531fbb-a268-4783-bccb-41756641434e None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:57.189854 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3531fbb-a268-4783-bccb-41756641434e None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:57.190195 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3531fbb-a268-4783-bccb-41756641434e None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:57.191526 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3531fbb-a268-4783-bccb-41756641434e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:57.191817 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3531fbb-a268-4783-bccb-41756641434e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:57.194083 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3531fbb-a268-4783-bccb-41756641434e None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:57.221273 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 258/516] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:57.221273 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3531fbb-a268-4783-bccb-41756641434e None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:57.221568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef309804-99ab-4c73-afb6-4a8a1cd3692d None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:57.222030 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:57.266438 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8a3ab-6b91-4724-941c-116a7d428009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:57.267341 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8a3ab-6b91-4724-941c-116a7d428009 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:57.267723 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8a3ab-6b91-4724-941c-116a7d428009 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:57.268059 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8a3ab-6b91-4724-941c-116a7d428009 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:57.277471 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8a3ab-6b91-4724-941c-116a7d428009 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:57.279268 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8a3ab-6b91-4724-941c-116a7d428009 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:57.297087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-80c8a3ab-6b91-4724-941c-116a7d428009 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 15:18:57.297087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:57.297087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:57.297087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:57.297087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:57.297087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:57.297087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:57.297087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:57.297087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:57.297087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:57.297087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:57.297087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:57.297087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:18:57.297087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:18:57.297087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:18:57.297087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:18:57.298998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:57.298998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:57.298998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:18:57.298998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:18:57.298998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:18:57.298998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:18:57.298998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:57.298998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:57.298998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:57.298998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:57.298998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:57.298998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:57.298998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:57.298998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:57.298998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:57.298998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:57.298998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:57.298998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:57.300327 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:57.300327 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:57.300327 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:18:57.300327 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:18:57.300327 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:18:57.300327 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:18:57.300327 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:18:57.300327 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:18:57.300327 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 15:18:57.300327 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:57.303404 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 259/517] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:18:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:57.304355 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8a3ab-6b91-4724-941c-116a7d428009 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:57.331042 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:57.341795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3531fbb-a268-4783-bccb-41756641434e None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:57.380271 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8082a-2d77-4a36-9bf7-1e071288c384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:57.381074 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8082a-2d77-4a36-9bf7-1e071288c384 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:57.381360 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8082a-2d77-4a36-9bf7-1e071288c384 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:57.381639 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8082a-2d77-4a36-9bf7-1e071288c384 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:57.389002 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8082a-2d77-4a36-9bf7-1e071288c384 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:57.390524 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8082a-2d77-4a36-9bf7-1e071288c384 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:57.406891 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-5ea8082a-2d77-4a36-9bf7-1e071288c384 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:18:57.406891 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:57.406891 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:57.406891 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:57.406891 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:57.406891 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:57.406891 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:57.406891 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:57.406891 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:57.406891 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:57.406891 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:57.406891 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:57.406891 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:18:57.406891 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:18:57.406891 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:18:57.407839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:18:57.407839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:57.407839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:57.407839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:57.407839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:57.407839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:57.407839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:57.407839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:57.407839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:57.407839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:57.407839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:57.407839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:57.407839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:57.407839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:57.407839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:57.407839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:57.407839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:57.408668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:18:57.408668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:18:57.408668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:18:57.408668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:18:57.408668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:18:57.408668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:18:57.408668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:18:57.408668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:57.408668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 259/518] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:18:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:57.409147 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8082a-2d77-4a36-9bf7-1e071288c384 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:57.424956 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8a3ab-6b91-4724-941c-116a7d428009 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:57.463405 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb57abb-b807-4892-913d-d5421035ca57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:57.464190 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb57abb-b807-4892-913d-d5421035ca57 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:57.464470 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb57abb-b807-4892-913d-d5421035ca57 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:57.464755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb57abb-b807-4892-913d-d5421035ca57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:57.476012 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb57abb-b807-4892-913d-d5421035ca57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:57.477496 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb57abb-b807-4892-913d-d5421035ca57 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:57.478128 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:57.496805 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-cbb57abb-b807-4892-913d-d5421035ca57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:18:57.496805 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:57.496805 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:57.496805 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:57.496805 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:57.496805 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:57.496805 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:57.496805 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:57.496805 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:57.496805 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:57.496805 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:57.496805 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:57.496805 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:18:57.496805 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:18:57.496805 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:18:57.497864 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:18:57.497864 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:57.497864 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:57.497864 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:57.497864 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:57.497864 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:57.497864 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:57.497864 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:57.497864 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:57.497864 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:57.497864 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:57.497864 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:57.497864 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:57.497864 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:57.497864 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:57.497864 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:57.497864 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:57.498725 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:18:57.498725 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:18:57.498725 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:18:57.498725 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:57.498725 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 260/519] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:18:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:57.498998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb57abb-b807-4892-913d-d5421035ca57 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:57.526113 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8082a-2d77-4a36-9bf7-1e071288c384 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:57.563094 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2be7c-2851-4e66-9a81-4179496aa1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:57.563717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2be7c-2851-4e66-9a81-4179496aa1d7 None admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:57.564007 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2be7c-2851-4e66-9a81-4179496aa1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:57.564289 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2be7c-2851-4e66-9a81-4179496aa1d7 None admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:57.565010 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2be7c-2851-4e66-9a81-4179496aa1d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:57.566461 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2be7c-2851-4e66-9a81-4179496aa1d7 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:57.578528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:57.587646 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 260/520] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jul 19 15:18:57 2022] POST /identity/v3/users => generated 247 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:18:57.588574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2be7c-2851-4e66-9a81-4179496aa1d7 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:57.610445 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb57abb-b807-4892-913d-d5421035ca57 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:57.672415 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd522468-d5a7-4ba1-901d-b363c80ebd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:57.673511 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd522468-d5a7-4ba1-901d-b363c80ebd0a None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:57.673898 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd522468-d5a7-4ba1-901d-b363c80ebd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:57.674530 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd522468-d5a7-4ba1-901d-b363c80ebd0a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:57.686996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd522468-d5a7-4ba1-901d-b363c80ebd0a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:57.689380 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd522468-d5a7-4ba1-901d-b363c80ebd0a None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:57.710179 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-fd522468-d5a7-4ba1-901d-b363c80ebd0a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 15:18:57.710179 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:57.710179 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:57.710179 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:57.710179 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:57.710179 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:57.710179 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:57.710179 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:57.710179 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:57.710179 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:57.710179 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:57.710179 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:57.710179 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:18:57.710179 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:18:57.710179 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:18:57.710179 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:18:57.711566 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:57.711566 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:57.711566 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:18:57.711566 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:18:57.711566 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:18:57.711566 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:18:57.711566 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:57.711566 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:57.711566 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:57.711566 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:57.711566 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:57.711566 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:57.711566 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:57.711566 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:57.711566 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:57.711566 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:57.711566 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:57.711566 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:57.713770 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:57.713770 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:57.713770 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:18:57.713770 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:18:57.713770 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:18:57.713770 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:18:57.713770 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:18:57.713770 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:18:57.713770 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 15:18:57.713770 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:57.713770 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 261/521] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 19 15:18:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:57.713770 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd522468-d5a7-4ba1-901d-b363c80ebd0a None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:57.725107 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2be7c-2851-4e66-9a81-4179496aa1d7 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:57.749612 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:57.781868 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7794c19-e578-43da-9f04-6d759656b631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:57.782985 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7794c19-e578-43da-9f04-6d759656b631 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:57.783440 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7794c19-e578-43da-9f04-6d759656b631 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:57.784857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7794c19-e578-43da-9f04-6d759656b631 None admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:57.786835 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7794c19-e578-43da-9f04-6d759656b631 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:57.787414 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7794c19-e578-43da-9f04-6d759656b631 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:57.790035 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7794c19-e578-43da-9f04-6d759656b631 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:57.850473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 261/522] 10.222.0.44 () {56 vars in 1137 bytes} [Tue Jul 19 15:18:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:57.852716 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7794c19-e578-43da-9f04-6d759656b631 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:57.878193 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd522468-d5a7-4ba1-901d-b363c80ebd0a None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:57.925379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf46ea2-f8f7-44aa-a486-f804744e92de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:57.926946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf46ea2-f8f7-44aa-a486-f804744e92de None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:57.927586 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf46ea2-f8f7-44aa-a486-f804744e92de None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:57.928142 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf46ea2-f8f7-44aa-a486-f804744e92de None admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:57.929529 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf46ea2-f8f7-44aa-a486-f804744e92de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:57.930041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf46ea2-f8f7-44aa-a486-f804744e92de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:57.933008 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf46ea2-f8f7-44aa-a486-f804744e92de None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:57.936562 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:57.968798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 262/523] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:18:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:57.968798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf46ea2-f8f7-44aa-a486-f804744e92de None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:57.983333 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7794c19-e578-43da-9f04-6d759656b631 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:58.026304 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6f433-933d-47d8-9057-afb50406535a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:58.026996 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6f433-933d-47d8-9057-afb50406535a None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:58.027306 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6f433-933d-47d8-9057-afb50406535a None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:58.027584 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6f433-933d-47d8-9057-afb50406535a None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:58.028351 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d6f433-933d-47d8-9057-afb50406535a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:58.028664 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d6f433-933d-47d8-9057-afb50406535a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:58.030361 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d6f433-933d-47d8-9057-afb50406535a None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:58.048607 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 262/524] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:58.048607 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6f433-933d-47d8-9057-afb50406535a None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:58.095726 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:58.123361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf46ea2-f8f7-44aa-a486-f804744e92de None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:58.163744 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac933a-cdfe-4a5b-96d6-ff0fd4e01d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:58.164425 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac933a-cdfe-4a5b-96d6-ff0fd4e01d3f None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:58.164724 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac933a-cdfe-4a5b-96d6-ff0fd4e01d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:58.164993 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac933a-cdfe-4a5b-96d6-ff0fd4e01d3f None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:58.165853 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac933a-cdfe-4a5b-96d6-ff0fd4e01d3f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:58.166159 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac933a-cdfe-4a5b-96d6-ff0fd4e01d3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:58.167638 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac933a-cdfe-4a5b-96d6-ff0fd4e01d3f None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:58.176084 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6f433-933d-47d8-9057-afb50406535a None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:58.196992 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 263/525] 10.222.0.44 () {56 vars in 1139 bytes} [Tue Jul 19 15:18:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:58.202129 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac933a-cdfe-4a5b-96d6-ff0fd4e01d3f None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:58.225360 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23b578-9289-47d8-92c3-13f10056a30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:58.226648 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23b578-9289-47d8-92c3-13f10056a30f None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:58.227000 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23b578-9289-47d8-92c3-13f10056a30f None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:58.227406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23b578-9289-47d8-92c3-13f10056a30f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:58.263325 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:58.310460 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23b578-9289-47d8-92c3-13f10056a30f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:58.312087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23b578-9289-47d8-92c3-13f10056a30f None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:58.321011 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac933a-cdfe-4a5b-96d6-ff0fd4e01d3f None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:58.351674 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:58.373833 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ca8f8-7cb2-4858-a51b-1e87cc3b9f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:58.374509 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ca8f8-7cb2-4858-a51b-1e87cc3b9f90 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:58.374801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ca8f8-7cb2-4858-a51b-1e87cc3b9f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:58.375081 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ca8f8-7cb2-4858-a51b-1e87cc3b9f90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:58.375954 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ca8f8-7cb2-4858-a51b-1e87cc3b9f90 None admin] RBAC: Adding query filter params (role.id=1ff62289fb434d09a13001c3ffbab080, scope.project.id=c54934775a86487295bdbc02ed3a0103, user.id=fef0511f56144ca9945b2dddfa2601a2) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:58.376270 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ca8f8-7cb2-4858-a51b-1e87cc3b9f90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:58.377758 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ca8f8-7cb2-4858-a51b-1e87cc3b9f90 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:58.385361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 264/526] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:18:58 2022] GET /identity/v3/role_assignments?user.id=fef0511f56144ca9945b2dddfa2601a2&scope.project.id=c54934775a86487295bdbc02ed3a0103&role.id=1ff62289fb434d09a13001c3ffbab080 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:58.386366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ca8f8-7cb2-4858-a51b-1e87cc3b9f90 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:58.507885 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 263/527] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:18:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:18:58.507885 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23b578-9289-47d8-92c3-13f10056a30f None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:58.594905 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ca8f8-7cb2-4858-a51b-1e87cc3b9f90 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:58.619525 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:58.645537 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52687617-04b3-4e40-a040-a7bc9613c167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:58.646816 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52687617-04b3-4e40-a040-a7bc9613c167 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:58.647400 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52687617-04b3-4e40-a040-a7bc9613c167 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:58.647682 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52687617-04b3-4e40-a040-a7bc9613c167 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:58.654547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23b578-9289-47d8-92c3-13f10056a30f None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:58.654999 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52687617-04b3-4e40-a040-a7bc9613c167 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:58.656835 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52687617-04b3-4e40-a040-a7bc9613c167 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:58.678856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-52687617-04b3-4e40-a040-a7bc9613c167 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:18:58.678856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:58.678856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:58.678856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:58.678856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:58.678856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:58.678856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:58.678856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:58.678856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:58.678856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:58.678856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:58.678856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:58.678856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:18:58.678856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:18:58.678856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:18:58.679792 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:18:58.679792 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:58.679792 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:58.679792 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:58.679792 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:58.679792 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:58.679792 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:58.679792 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:58.679792 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:58.679792 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:58.679792 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:58.679792 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:58.679792 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:58.679792 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:58.679792 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:58.679792 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:58.679792 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:58.680714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:18:58.680714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:18:58.680714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:18:58.680714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:18:58.680714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:18:58.680714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:18:58.680714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:18:58.680714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:58.680714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 265/528] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:18:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:58.680714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52687617-04b3-4e40-a040-a7bc9613c167 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:58.693604 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b10e24-97d5-484b-841b-f1d32d8212c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:58.694271 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b10e24-97d5-484b-841b-f1d32d8212c5 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:58.694560 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b10e24-97d5-484b-841b-f1d32d8212c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:58.694845 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b10e24-97d5-484b-841b-f1d32d8212c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:58.698513 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:58.764822 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b10e24-97d5-484b-841b-f1d32d8212c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:58.766297 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b10e24-97d5-484b-841b-f1d32d8212c5 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:58.786507 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52687617-04b3-4e40-a040-a7bc9613c167 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:58.822717 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351633d2-3470-41da-96ed-deca113219d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:58.823545 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351633d2-3470-41da-96ed-deca113219d5 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:58.823831 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351633d2-3470-41da-96ed-deca113219d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:58.824215 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351633d2-3470-41da-96ed-deca113219d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:58.836064 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351633d2-3470-41da-96ed-deca113219d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:58.837514 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351633d2-3470-41da-96ed-deca113219d5 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:58.858375 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-351633d2-3470-41da-96ed-deca113219d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:18:58.858375 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:58.858375 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:58.858375 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:58.858375 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:58.858375 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:58.858375 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:58.858375 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:58.858375 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:58.858375 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:58.858375 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:58.858375 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:58.858375 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:18:58.858375 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:18:58.858375 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:18:58.859332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:18:58.859332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:58.859332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:58.859332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:58.859332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:58.859332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:58.859332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:58.859332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:58.859332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:58.859332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:58.859332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:58.859332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:58.859332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:58.859332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:58.859332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:58.859332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:58.859332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:58.860182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:18:58.860182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:18:58.860182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:18:58.860182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:58.862068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 266/529] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:18:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:58.865384 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351633d2-3470-41da-96ed-deca113219d5 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:58.877109 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 264/530] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:18:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:18:58.877768 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b10e24-97d5-484b-841b-f1d32d8212c5 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:58.900345 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:58.923539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:58.980971 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351633d2-3470-41da-96ed-deca113219d5 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:58.999903 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b10e24-97d5-484b-841b-f1d32d8212c5 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:59.024039 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c3948-31d6-4dda-8537-4b790f393ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:59.024713 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c3948-31d6-4dda-8537-4b790f393ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:59.025004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c3948-31d6-4dda-8537-4b790f393ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:59.025289 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c3948-31d6-4dda-8537-4b790f393ff7 None admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:59.026095 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c3948-31d6-4dda-8537-4b790f393ff7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:59.026410 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c3948-31d6-4dda-8537-4b790f393ff7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:59.027933 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c3948-31d6-4dda-8537-4b790f393ff7 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:59.042498 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d134c5d-8747-4413-882b-c8f75c237379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:59.043171 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d134c5d-8747-4413-882b-c8f75c237379 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:59.043498 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d134c5d-8747-4413-882b-c8f75c237379 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:59.043777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d134c5d-8747-4413-882b-c8f75c237379 None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:59.044506 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d134c5d-8747-4413-882b-c8f75c237379 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:59.044822 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d134c5d-8747-4413-882b-c8f75c237379 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:59.046195 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d134c5d-8747-4413-882b-c8f75c237379 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:59.046535 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 267/531] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:18:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:59.047453 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c3948-31d6-4dda-8537-4b790f393ff7 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:59.059816 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 265/532] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:59.060736 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d134c5d-8747-4413-882b-c8f75c237379 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:59.142641 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:59.157513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c3948-31d6-4dda-8537-4b790f393ff7 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:59.164508 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:59.172351 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d134c5d-8747-4413-882b-c8f75c237379 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:59.194707 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3198f-8eb1-41cc-b69f-43e5640d6779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:59.195780 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3198f-8eb1-41cc-b69f-43e5640d6779 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:59.196214 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3198f-8eb1-41cc-b69f-43e5640d6779 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:59.196640 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3198f-8eb1-41cc-b69f-43e5640d6779 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:59.208475 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3198f-8eb1-41cc-b69f-43e5640d6779 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:59.210119 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3198f-8eb1-41cc-b69f-43e5640d6779 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:59.210273 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53451a14-ecb8-49e3-853f-ccf2d75a314e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:59.211116 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53451a14-ecb8-49e3-853f-ccf2d75a314e None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:59.211469 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53451a14-ecb8-49e3-853f-ccf2d75a314e None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:59.211752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53451a14-ecb8-49e3-853f-ccf2d75a314e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:59.212691 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53451a14-ecb8-49e3-853f-ccf2d75a314e None admin] RBAC: Adding query filter params (role.id=1ff62289fb434d09a13001c3ffbab080, scope.project.id=c54934775a86487295bdbc02ed3a0103, user.id=3e66abbda1744a71b4d26677dcef76be) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:59.212904 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53451a14-ecb8-49e3-853f-ccf2d75a314e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:59.214320 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53451a14-ecb8-49e3-853f-ccf2d75a314e None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:59.227557 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 266/533] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:18:59 2022] GET /identity/v3/role_assignments?user.id=3e66abbda1744a71b4d26677dcef76be&scope.project.id=c54934775a86487295bdbc02ed3a0103&role.id=1ff62289fb434d09a13001c3ffbab080 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:59.228590 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53451a14-ecb8-49e3-853f-ccf2d75a314e None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:59.230163 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-feb3198f-8eb1-41cc-b69f-43e5640d6779 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:18:59.230163 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:59.230163 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:59.230163 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:59.230163 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:59.230163 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:59.230163 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:59.230163 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:59.230163 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:59.230163 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:59.230163 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:59.230163 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:59.230163 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:18:59.230163 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:18:59.230163 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:18:59.231184 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:18:59.231184 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:59.231184 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:59.231184 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:59.231184 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:59.231184 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:59.231184 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:59.231184 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:59.231184 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:59.231184 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:59.231184 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:59.231184 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:59.231184 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:59.231184 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:59.231184 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:59.231184 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:59.231184 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:59.232140 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:18:59.232140 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:18:59.232140 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:18:59.232140 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:59.233835 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 268/534] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:18:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:59.244595 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3198f-8eb1-41cc-b69f-43e5640d6779 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:59.414594 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53451a14-ecb8-49e3-853f-ccf2d75a314e None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:59.450577 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787b081-17d9-4273-892a-94d137b101e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:59.451420 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787b081-17d9-4273-892a-94d137b101e0 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:59.451712 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787b081-17d9-4273-892a-94d137b101e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:59.451997 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787b081-17d9-4273-892a-94d137b101e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:59.460095 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787b081-17d9-4273-892a-94d137b101e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:59.461560 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787b081-17d9-4273-892a-94d137b101e0 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:59.477751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-f787b081-17d9-4273-892a-94d137b101e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:18:59.477751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:59.477751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:59.477751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:59.477751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:59.477751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:59.477751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:59.477751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:59.477751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:59.477751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:59.477751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:59.477751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:59.477751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:18:59.477751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:18:59.477751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:18:59.478642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:18:59.478642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:59.478642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:59.478642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:59.478642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:59.478642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:59.478642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:59.478642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:59.478642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:59.478642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:59.478642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:59.478642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:59.478642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:59.478642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:59.478642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:59.478642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:59.478642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:59.479947 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:18:59.479947 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:18:59.479947 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:18:59.479947 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:18:59.479947 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:18:59.479947 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:18:59.479947 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:18:59.479947 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:18:59.479947 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 267/535] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:18:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:18:59.482740 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3198f-8eb1-41cc-b69f-43e5640d6779 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:59.488141 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787b081-17d9-4273-892a-94d137b101e0 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:59.523686 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:59.535976 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f8b34-adde-479c-b195-a0ca56eadef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:59.536653 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f8b34-adde-479c-b195-a0ca56eadef2 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:59.536940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f8b34-adde-479c-b195-a0ca56eadef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:59.537223 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f8b34-adde-479c-b195-a0ca56eadef2 None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:59.537974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f8b34-adde-479c-b195-a0ca56eadef2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:59.538290 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f8b34-adde-479c-b195-a0ca56eadef2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:59.539698 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f8b34-adde-479c-b195-a0ca56eadef2 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:59.557509 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:59.563963 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 269/536] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:59.570441 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f8b34-adde-479c-b195-a0ca56eadef2 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:59.656347 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787b081-17d9-4273-892a-94d137b101e0 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:59.692536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f8b4c-fc72-4319-a074-7e3d77cfc6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:59.693121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f8b4c-fc72-4319-a074-7e3d77cfc6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:59.693419 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f8b4c-fc72-4319-a074-7e3d77cfc6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:59.693703 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f8b4c-fc72-4319-a074-7e3d77cfc6c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:59.694600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f8b4c-fc72-4319-a074-7e3d77cfc6c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:59.694924 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f8b4c-fc72-4319-a074-7e3d77cfc6c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:59.696501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f8b4c-fc72-4319-a074-7e3d77cfc6c7 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:59.716274 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 268/537] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:18:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:59.721800 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f8b4c-fc72-4319-a074-7e3d77cfc6c7 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:59.760151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f8b34-adde-479c-b195-a0ca56eadef2 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:59.835603 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:59.860283 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f8b4c-fc72-4319-a074-7e3d77cfc6c7 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:59.895608 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb975c-2fa6-47e1-bd8d-e94329cf02bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:59.896381 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb975c-2fa6-47e1-bd8d-e94329cf02bd None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:59.896682 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb975c-2fa6-47e1-bd8d-e94329cf02bd None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:59.896974 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb975c-2fa6-47e1-bd8d-e94329cf02bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:59.897823 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb975c-2fa6-47e1-bd8d-e94329cf02bd None admin] RBAC: Adding query filter params (role.id=1ff62289fb434d09a13001c3ffbab080, scope.project.id=c54934775a86487295bdbc02ed3a0103, user.id=fcf1f5f0ccf8449191a8660e5b1906d3) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:59.898147 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb975c-2fa6-47e1-bd8d-e94329cf02bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:59.899621 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb975c-2fa6-47e1-bd8d-e94329cf02bd None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:59.899922 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210343d-8fe6-493a-8e09-c33682ecc7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:59.900732 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210343d-8fe6-493a-8e09-c33682ecc7f5 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:59.901276 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210343d-8fe6-493a-8e09-c33682ecc7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:59.901276 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210343d-8fe6-493a-8e09-c33682ecc7f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:59.905903 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 269/538] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:18:59 2022] GET /identity/v3/role_assignments?user.id=fcf1f5f0ccf8449191a8660e5b1906d3&scope.project.id=c54934775a86487295bdbc02ed3a0103&role.id=1ff62289fb434d09a13001c3ffbab080 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:59.936712 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210343d-8fe6-493a-8e09-c33682ecc7f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:59.938191 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210343d-8fe6-493a-8e09-c33682ecc7f5 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:59.964539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-1210343d-8fe6-493a-8e09-c33682ecc7f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:18:59.964539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:18:59.964539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:18:59.964539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:18:59.964539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:18:59.964539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:18:59.964539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:18:59.964539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:18:59.964539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:18:59.964539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:18:59.964539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:18:59.964539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:18:59.964539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:18:59.964539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:18:59.964539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:18:59.965429 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:18:59.965429 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:18:59.965429 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:18:59.965429 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:18:59.965429 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:18:59.965429 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:18:59.965429 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:18:59.965429 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:18:59.965429 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:18:59.965429 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:18:59.965429 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:18:59.965429 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:18:59.965429 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:18:59.965429 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:18:59.965429 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:18:59.965429 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:18:59.965429 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:18:59.966275 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:18:59.966275 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:18:59.966275 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:18:59.966275 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:18:59.966275 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:18:59.966275 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:18:59.966275 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:18:59.966275 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:18:59.966275 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 270/539] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:18:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:18:59.971748 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb975c-2fa6-47e1-bd8d-e94329cf02bd None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:00.018361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32989e-327d-468f-ba8e-1c1f5df3beb5 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:00.018675 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32989e-327d-468f-ba8e-1c1f5df3beb5 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:00.018923 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32989e-327d-468f-ba8e-1c1f5df3beb5 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:00.021106 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 271/540] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:00.026649 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98c17f-d9e7-4807-a3d8-01167339290b None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:00.026954 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98c17f-d9e7-4807-a3d8-01167339290b None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:00.027203 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98c17f-d9e7-4807-a3d8-01167339290b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:00.044556 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-6d98c17f-d9e7-4807-a3d8-01167339290b None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:00.045771 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-6d98c17f-d9e7-4807-a3d8-01167339290b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:00.115351 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb975c-2fa6-47e1-bd8d-e94329cf02bd None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:00.155302 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8d762-5af7-4910-b18a-5ee5e7a58a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:00.156455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8d762-5af7-4910-b18a-5ee5e7a58a88 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:00.156961 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8d762-5af7-4910-b18a-5ee5e7a58a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:00.157452 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8d762-5af7-4910-b18a-5ee5e7a58a88 None admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:00.158974 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8d762-5af7-4910-b18a-5ee5e7a58a88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:00.159560 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8d762-5af7-4910-b18a-5ee5e7a58a88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:00.162485 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8d762-5af7-4910-b18a-5ee5e7a58a88 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:00.181933 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 270/541] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:18:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:00.189879 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:00.190104 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8d762-5af7-4910-b18a-5ee5e7a58a88 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:00.208440 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 272/542] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:19:00.223687 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:00.243851 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98c17f-d9e7-4807-a3d8-01167339290b None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:00.372966 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8d762-5af7-4910-b18a-5ee5e7a58a88 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:00.438764 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98c17f-d9e7-4807-a3d8-01167339290b None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:00.441404 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d98e0-1a73-40a2-b626-7725c580d02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:00.442126 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d98e0-1a73-40a2-b626-7725c580d02b None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:00.442410 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d98e0-1a73-40a2-b626-7725c580d02b None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:00.442685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d98e0-1a73-40a2-b626-7725c580d02b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:00.443558 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d98e0-1a73-40a2-b626-7725c580d02b None admin] RBAC: Adding query filter params (role.id=1ff62289fb434d09a13001c3ffbab080, scope.project.id=c54934775a86487295bdbc02ed3a0103, user.id=c89e7fbcc22c478c98d74b802f4bf8f0) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:00.443873 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d98e0-1a73-40a2-b626-7725c580d02b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:00.446494 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d98e0-1a73-40a2-b626-7725c580d02b None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:00.461390 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 271/543] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:19:00 2022] GET /identity/v3/role_assignments?user.id=c89e7fbcc22c478c98d74b802f4bf8f0&scope.project.id=c54934775a86487295bdbc02ed3a0103&role.id=1ff62289fb434d09a13001c3ffbab080 => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:00.513617 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f86225-c0f1-49ac-890b-a10aa6a4d81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:00.515336 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f86225-c0f1-49ac-890b-a10aa6a4d81c None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:00.515868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f86225-c0f1-49ac-890b-a10aa6a4d81c None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:00.516867 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f86225-c0f1-49ac-890b-a10aa6a4d81c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:00.530669 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f86225-c0f1-49ac-890b-a10aa6a4d81c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:19:00.539428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-55f86225-c0f1-49ac-890b-a10aa6a4d81c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:19:00.539428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:00.539428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:00.539428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:00.539428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:00.539428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:00.539428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:00.539428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:00.539428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:00.539428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:00.539428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:00.539428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:00.539428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:19:00.539428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:19:00.539428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:19:00.539428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:19:00.540690 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:19:00.540690 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:19:00.540690 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:19:00.540690 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:19:00.540690 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:00.540690 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:00.540690 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:00.540690 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:00.540690 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:00.540690 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:00.540690 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:00.540690 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:00.540690 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:00.540690 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:00.540690 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:00.540690 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:00.541482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:00.541482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:00.541482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:00.541482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:00.541482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:19:00.541482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:19:00.541482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:19:00.541482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:19:00.541482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:19:00.541482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:19:00.541482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:19:00.541482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:00.541482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 273/544] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 19 15:19:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:19:00.548366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d98e0-1a73-40a2-b626-7725c580d02b None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:00.654920 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:00.692915 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d98e0-1a73-40a2-b626-7725c580d02b None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:00.735587 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cf0dc-9706-42ed-ab36-f3cccc15b104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:00.736278 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cf0dc-9706-42ed-ab36-f3cccc15b104 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:00.736563 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cf0dc-9706-42ed-ab36-f3cccc15b104 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:00.736838 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cf0dc-9706-42ed-ab36-f3cccc15b104 None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:00.737600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cf0dc-9706-42ed-ab36-f3cccc15b104 None admin] RBAC: Adding query filter params (name=service) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:00.737904 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cf0dc-9706-42ed-ab36-f3cccc15b104 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:00.739854 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cf0dc-9706-42ed-ab36-f3cccc15b104 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:00.750470 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 272/545] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 19 15:19:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:00.756776 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f86225-c0f1-49ac-890b-a10aa6a4d81c None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:00.849680 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7766df-c656-4ee9-a9ff-a7bb3a4fd97d None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:00.851048 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7766df-c656-4ee9-a9ff-a7bb3a4fd97d None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:00.851372 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7766df-c656-4ee9-a9ff-a7bb3a4fd97d None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:00.853582 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 273/546] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:00.859209 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea277b27-76b1-429a-aa5f-1d4fb1b99f94 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:00.859811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea277b27-76b1-429a-aa5f-1d4fb1b99f94 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:00.860105 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea277b27-76b1-429a-aa5f-1d4fb1b99f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:00.868952 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:00.886254 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-ea277b27-76b1-429a-aa5f-1d4fb1b99f94 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:00.887500 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-ea277b27-76b1-429a-aa5f-1d4fb1b99f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:00.976860 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f86225-c0f1-49ac-890b-a10aa6a4d81c None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:01.019293 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 274/547] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:19:01.044998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd44c9a-0be8-433e-a144-28c238539502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:01.045809 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd44c9a-0be8-433e-a144-28c238539502 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:01.046102 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd44c9a-0be8-433e-a144-28c238539502 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:01.046385 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd44c9a-0be8-433e-a144-28c238539502 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:01.059465 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd44c9a-0be8-433e-a144-28c238539502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:01.060934 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd44c9a-0be8-433e-a144-28c238539502 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:01.062508 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea277b27-76b1-429a-aa5f-1d4fb1b99f94 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:01.080100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-0cd44c9a-0be8-433e-a144-28c238539502 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:01.080100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:01.080100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:01.080100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:01.080100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:01.080100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:01.080100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:01.080100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:01.080100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:01.080100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:01.080100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:01.080100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:01.080100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:01.080100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:01.080100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:01.081015 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:01.081015 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:01.081015 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:01.081015 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:01.081015 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:01.081015 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:01.081015 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:01.081015 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:01.081015 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:01.081015 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:01.081015 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:01.081015 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:01.081015 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:01.081015 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:01.081015 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:01.081015 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:01.081015 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:01.081856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:01.081856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:01.081856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:01.081856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:01.081856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 274/548] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:01.089778 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd44c9a-0be8-433e-a144-28c238539502 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:01.187695 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:01.271933 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea277b27-76b1-429a-aa5f-1d4fb1b99f94 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:01.272164 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd44c9a-0be8-433e-a144-28c238539502 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:01.275533 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:01.342681 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ed81b-3991-4a07-b9b6-aca92baf8c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:01.343397 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ed81b-3991-4a07-b9b6-aca92baf8c72 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:01.344841 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ed81b-3991-4a07-b9b6-aca92baf8c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:01.345130 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ed81b-3991-4a07-b9b6-aca92baf8c72 None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:01.345885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ed81b-3991-4a07-b9b6-aca92baf8c72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:01.346198 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ed81b-3991-4a07-b9b6-aca92baf8c72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:01.347625 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ed81b-3991-4a07-b9b6-aca92baf8c72 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:01.349972 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7e837-026a-4462-9ac4-dd6a2a432cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:01.352791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7e837-026a-4462-9ac4-dd6a2a432cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:01.353085 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7e837-026a-4462-9ac4-dd6a2a432cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:01.353372 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7e837-026a-4462-9ac4-dd6a2a432cf6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:01.377233 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7e837-026a-4462-9ac4-dd6a2a432cf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:19:01.390430 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 275/549] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:01.391027 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-6dd7e837-026a-4462-9ac4-dd6a2a432cf6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:19:01.391027 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:01.391027 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:01.391027 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:01.391027 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:01.391027 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:01.391027 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:01.391027 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:01.391027 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:01.391027 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:01.391027 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:01.391027 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:01.391027 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:19:01.391027 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:19:01.391027 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:19:01.391027 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:19:01.392453 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:19:01.392453 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:19:01.392453 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:19:01.392453 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:19:01.392453 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:01.392453 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:01.392453 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:01.392453 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:01.392453 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:01.392453 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:01.392453 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:01.392453 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:01.392453 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:01.392453 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:01.392453 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:01.392453 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:01.393434 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:01.393434 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:01.393434 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:01.393434 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:01.393434 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:19:01.393434 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:19:01.393434 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:19:01.393434 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:19:01.393434 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:19:01.393434 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:19:01.393434 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:19:01.393434 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:01.397227 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 275/550] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 19 15:19:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:01.399011 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ed81b-3991-4a07-b9b6-aca92baf8c72 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:01.403989 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7e837-026a-4462-9ac4-dd6a2a432cf6 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:01.528526 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7e837-026a-4462-9ac4-dd6a2a432cf6 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:01.550874 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:01.577946 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78c321-85ea-4cc3-a3e4-d03c4ee5305b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:01.578620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78c321-85ea-4cc3-a3e4-d03c4ee5305b None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:01.578910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78c321-85ea-4cc3-a3e4-d03c4ee5305b None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:01.579206 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78c321-85ea-4cc3-a3e4-d03c4ee5305b None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:01.579979 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f78c321-85ea-4cc3-a3e4-d03c4ee5305b None admin] RBAC: Adding query filter params (name=service) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:01.580292 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f78c321-85ea-4cc3-a3e4-d03c4ee5305b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:01.581654 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f78c321-85ea-4cc3-a3e4-d03c4ee5305b None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:01.592146 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 276/551] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 19 15:19:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:01.593896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300dbcf-6462-4fe2-98c9-4e4a019ec369 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:01.594445 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300dbcf-6462-4fe2-98c9-4e4a019ec369 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:01.594933 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300dbcf-6462-4fe2-98c9-4e4a019ec369 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:01.600655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 277/552] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:01.601772 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300dbcf-6462-4fe2-98c9-4e4a019ec369 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:01.619869 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ed81b-3991-4a07-b9b6-aca92baf8c72 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:01.656907 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9aa37-5a86-4f40-84fd-10525d626f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:01.657709 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9aa37-5a86-4f40-84fd-10525d626f56 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:01.657996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9aa37-5a86-4f40-84fd-10525d626f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:01.658272 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9aa37-5a86-4f40-84fd-10525d626f56 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:01.666468 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9aa37-5a86-4f40-84fd-10525d626f56 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:01.667965 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9aa37-5a86-4f40-84fd-10525d626f56 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:01.683967 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-36d9aa37-5a86-4f40-84fd-10525d626f56 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 15:19:01.683967 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:01.683967 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:01.683967 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:01.683967 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:01.683967 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:01.683967 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:01.683967 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:01.683967 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:01.683967 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:01.683967 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:01.683967 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:01.683967 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:19:01.683967 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:19:01.683967 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:19:01.683967 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:19:01.685004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:01.685004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:01.685004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:19:01.685004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:01.685004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:19:01.685004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:01.685004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:01.685004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:01.685004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:01.685004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:01.685004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:01.685004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:01.685004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:01.685004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:01.685004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:01.685004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:01.685004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:01.685004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:01.686004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:01.686004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:01.686004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:19:01.686004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:19:01.686004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:19:01.686004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:19:01.686004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:19:01.686004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:19:01.686004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 15:19:01.686004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:01.686004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 276/553] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:19:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:01.687072 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830b4ae-4f52-4db5-b1a5-7946112542cb None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:01.687072 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830b4ae-4f52-4db5-b1a5-7946112542cb None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:01.687353 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830b4ae-4f52-4db5-b1a5-7946112542cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:01.708794 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-9830b4ae-4f52-4db5-b1a5-7946112542cb None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:01.709977 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-9830b4ae-4f52-4db5-b1a5-7946112542cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:01.727447 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:01.731483 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300dbcf-6462-4fe2-98c9-4e4a019ec369 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:01.784632 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a481c-88fc-400e-a98e-c2995467f203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:01.786584 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a481c-88fc-400e-a98e-c2995467f203 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:01.787020 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a481c-88fc-400e-a98e-c2995467f203 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:01.787474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a481c-88fc-400e-a98e-c2995467f203 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:01.794493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 277/554] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:19:01.794493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830b4ae-4f52-4db5-b1a5-7946112542cb None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:01.803751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a481c-88fc-400e-a98e-c2995467f203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:01.805333 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a481c-88fc-400e-a98e-c2995467f203 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:01.824072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-2a4a481c-88fc-400e-a98e-c2995467f203 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:01.824072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:01.824072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:01.824072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:01.824072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:01.824072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:01.824072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:01.824072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:01.824072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:01.824072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:01.824072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:01.824072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:01.824072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:01.824072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:01.824072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:01.825039 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:01.825039 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:01.825039 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:01.825039 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:01.825039 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:01.825039 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:01.825039 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:01.825039 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:01.825039 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:01.825039 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:01.825039 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:01.825039 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:01.825039 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:01.825039 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:01.825039 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:01.825039 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:01.825039 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:01.825977 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:01.825977 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:01.825977 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:01.825977 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:01.825977 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 278/555] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:01.826244 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a481c-88fc-400e-a98e-c2995467f203 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:01.875809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:01.944104 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830b4ae-4f52-4db5-b1a5-7946112542cb None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:01.960049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a481c-88fc-400e-a98e-c2995467f203 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:01.980201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7ca71-288c-48bc-9e9f-305c87231345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:01.980879 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7ca71-288c-48bc-9e9f-305c87231345 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:01.981169 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7ca71-288c-48bc-9e9f-305c87231345 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:01.981453 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7ca71-288c-48bc-9e9f-305c87231345 None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:01.982300 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7ca71-288c-48bc-9e9f-305c87231345 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:01.982938 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7ca71-288c-48bc-9e9f-305c87231345 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:01.984082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7ca71-288c-48bc-9e9f-305c87231345 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:01.998263 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fb013-85fd-47d6-b20c-9c4dd627b873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:01.999497 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fb013-85fd-47d6-b20c-9c4dd627b873 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:02.000034 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fb013-85fd-47d6-b20c-9c4dd627b873 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:02.000512 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fb013-85fd-47d6-b20c-9c4dd627b873 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:02.007377 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 278/556] 10.222.0.44 () {56 vars in 1135 bytes} [Tue Jul 19 15:19:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:02.008514 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7ca71-288c-48bc-9e9f-305c87231345 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:02.014607 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754fb013-85fd-47d6-b20c-9c4dd627b873 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:19:02.023584 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-754fb013-85fd-47d6-b20c-9c4dd627b873 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:19:02.023584 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:02.023584 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:02.023584 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:02.023584 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:02.023584 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:02.023584 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:02.023584 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:02.023584 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:02.023584 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:02.023584 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:02.023584 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:02.023584 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:19:02.023584 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:19:02.023584 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:19:02.023584 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:19:02.024486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:19:02.024486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:19:02.024486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:19:02.024486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:19:02.024486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:02.024486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:02.024486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:02.024486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:02.024486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:02.024486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:02.024486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:02.024486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:02.024486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:02.024486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:02.024486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:02.024486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:02.025797 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:02.025797 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:02.025797 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:02.025797 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:02.025797 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:19:02.025797 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:19:02.025797 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:19:02.025797 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:19:02.025797 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:19:02.025797 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:19:02.025797 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:19:02.025797 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:02.026430 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:02.028737 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 279/557] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 19 15:19:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:02.029835 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fb013-85fd-47d6-b20c-9c4dd627b873 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:02.117307 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7ca71-288c-48bc-9e9f-305c87231345 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:02.128852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:02.137581 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fb013-85fd-47d6-b20c-9c4dd627b873 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:02.167313 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7d52c-9181-4eac-aeb2-e99990f1d0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:02.168266 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7d52c-9181-4eac-aeb2-e99990f1d0ff None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:02.168557 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7d52c-9181-4eac-aeb2-e99990f1d0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:02.168836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7d52c-9181-4eac-aeb2-e99990f1d0ff None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:02.169986 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7d52c-9181-4eac-aeb2-e99990f1d0ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:02.170302 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7d52c-9181-4eac-aeb2-e99990f1d0ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:02.172097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7d52c-9181-4eac-aeb2-e99990f1d0ff None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:02.174890 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdceeef-733c-488e-b58f-88ad58704f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:02.175799 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdceeef-733c-488e-b58f-88ad58704f28 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:02.176341 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdceeef-733c-488e-b58f-88ad58704f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:02.176841 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdceeef-733c-488e-b58f-88ad58704f28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:02.187381 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 279/558] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:02.188504 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7d52c-9181-4eac-aeb2-e99990f1d0ff None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:02.260770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdceeef-733c-488e-b58f-88ad58704f28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:02.262801 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdceeef-733c-488e-b58f-88ad58704f28 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:02.311606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:02.336818 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7d52c-9181-4eac-aeb2-e99990f1d0ff None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:02.381115 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be645a-38f0-4dc7-a55e-e0b23146465b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:02.381589 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:02.382609 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be645a-38f0-4dc7-a55e-e0b23146465b None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:02.383276 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be645a-38f0-4dc7-a55e-e0b23146465b None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:02.383572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be645a-38f0-4dc7-a55e-e0b23146465b None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:02.384638 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be645a-38f0-4dc7-a55e-e0b23146465b None admin] RBAC: Adding query filter params (name=service) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:02.385010 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be645a-38f0-4dc7-a55e-e0b23146465b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:02.387232 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be645a-38f0-4dc7-a55e-e0b23146465b None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:02.389847 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 280/559] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:19:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:19:02.391112 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdceeef-733c-488e-b58f-88ad58704f28 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:02.397858 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 280/560] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 19 15:19:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:02.399067 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450b2b7-0053-4863-86ec-1a6cec84910f None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:02.399435 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450b2b7-0053-4863-86ec-1a6cec84910f None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:02.400274 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450b2b7-0053-4863-86ec-1a6cec84910f None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:02.402295 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 281/561] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:02.403071 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450b2b7-0053-4863-86ec-1a6cec84910f None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:02.524253 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdceeef-733c-488e-b58f-88ad58704f28 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:02.536503 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450b2b7-0053-4863-86ec-1a6cec84910f None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:02.569221 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93778e3-e4de-4515-834c-253ba8509657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:02.570024 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93778e3-e4de-4515-834c-253ba8509657 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:02.570312 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93778e3-e4de-4515-834c-253ba8509657 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:02.570592 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93778e3-e4de-4515-834c-253ba8509657 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:02.572244 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:02.578443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15de7d-f568-42c0-a267-93c7548c06f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:02.578791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93778e3-e4de-4515-834c-253ba8509657 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:02.579401 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15de7d-f568-42c0-a267-93c7548c06f1 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:02.579697 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15de7d-f568-42c0-a267-93c7548c06f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:02.579979 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15de7d-f568-42c0-a267-93c7548c06f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:02.580283 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93778e3-e4de-4515-834c-253ba8509657 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:02.592251 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15de7d-f568-42c0-a267-93c7548c06f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:02.593961 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15de7d-f568-42c0-a267-93c7548c06f1 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:02.595792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-d93778e3-e4de-4515-834c-253ba8509657 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:19:02.595792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:02.595792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:02.595792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:02.595792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:02.595792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:02.595792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:02.595792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:02.595792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:02.595792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:02.595792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:02.595792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:02.595792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:19:02.595792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:19:02.595792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:19:02.595792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:19:02.596735 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:02.596735 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:02.596735 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:19:02.596735 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:02.596735 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:19:02.596735 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:02.596735 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:02.596735 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:02.596735 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:02.596735 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:02.596735 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:02.596735 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:02.596735 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:02.596735 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:02.596735 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:02.596735 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:02.596735 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:02.596735 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:02.597665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:02.597665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:02.597665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:19:02.597665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:19:02.597665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:19:02.597665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:19:02.597665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:19:02.597665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:19:02.597665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:19:02.597665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:02.597665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 281/562] 10.222.0.44 () {56 vars in 1093 bytes} [Tue Jul 19 15:19:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:02.598377 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93778e3-e4de-4515-834c-253ba8509657 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:02.620462 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-ba15de7d-f568-42c0-a267-93c7548c06f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:02.620462 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:02.620462 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:02.620462 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:02.620462 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:02.620462 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:02.620462 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:02.620462 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:02.620462 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:02.620462 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:02.620462 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:02.620462 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:02.620462 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:02.620462 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:02.620462 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:02.621662 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:02.621662 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:02.621662 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:02.621662 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:02.621662 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:02.621662 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:02.621662 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:02.621662 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:02.621662 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:02.621662 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:02.621662 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:02.621662 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:02.621662 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:02.621662 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:02.621662 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:02.621662 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:02.621662 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:02.622801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:02.622801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:02.622801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:02.622801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:02.622801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 282/563] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:02.623080 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e313776-6d2b-4909-9bb7-2b2ca4d7b77d None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:02.624167 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e313776-6d2b-4909-9bb7-2b2ca4d7b77d None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:02.624167 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e313776-6d2b-4909-9bb7-2b2ca4d7b77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:02.661936 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-5e313776-6d2b-4909-9bb7-2b2ca4d7b77d None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:02.663964 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-5e313776-6d2b-4909-9bb7-2b2ca4d7b77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:02.668210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:02.716360 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93778e3-e4de-4515-834c-253ba8509657 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:02.741267 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 283/564] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:19:02.742330 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e313776-6d2b-4909-9bb7-2b2ca4d7b77d None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:02.762804 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520bd932-fc81-449f-a79a-c3bba3a56219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:02.764578 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bd932-fc81-449f-a79a-c3bba3a56219 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:02.765071 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bd932-fc81-449f-a79a-c3bba3a56219 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:02.765357 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bd932-fc81-449f-a79a-c3bba3a56219 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:02.777091 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520bd932-fc81-449f-a79a-c3bba3a56219 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:02.778561 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520bd932-fc81-449f-a79a-c3bba3a56219 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:02.798089 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-520bd932-fc81-449f-a79a-c3bba3a56219 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:02.798089 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:02.798089 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:02.798089 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:02.798089 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:02.798089 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:02.798089 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:02.798089 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:02.798089 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:02.798089 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:02.798089 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:02.798089 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:02.798089 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:02.798089 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:02.798089 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:02.799181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:02.799181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:02.799181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:02.799181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:02.799181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:02.799181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:02.799181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:02.799181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:02.799181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:02.799181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:02.799181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:02.799181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:02.799181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:02.799181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:02.799181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:02.799181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:02.799181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:02.800168 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:02.800168 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:02.800168 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:02.800168 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:02.800168 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 282/565] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:02.800444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520bd932-fc81-449f-a79a-c3bba3a56219 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:02.865363 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e313776-6d2b-4909-9bb7-2b2ca4d7b77d None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:02.879876 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:02.902320 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a5f50-33d6-4fd2-88a6-8027db80c555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:02.902991 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a5f50-33d6-4fd2-88a6-8027db80c555 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:02.903302 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a5f50-33d6-4fd2-88a6-8027db80c555 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:02.903586 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a5f50-33d6-4fd2-88a6-8027db80c555 None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:02.904425 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a5f50-33d6-4fd2-88a6-8027db80c555 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:02.904741 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a5f50-33d6-4fd2-88a6-8027db80c555 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:02.906453 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a5f50-33d6-4fd2-88a6-8027db80c555 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:02.914492 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520bd932-fc81-449f-a79a-c3bba3a56219 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:02.921785 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:02.925764 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 284/566] 10.222.0.44 () {56 vars in 1133 bytes} [Tue Jul 19 15:19:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:02.926639 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a5f50-33d6-4fd2-88a6-8027db80c555 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:02.951643 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8103ee-05da-4252-a89f-a2cef5640981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:02.952216 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8103ee-05da-4252-a89f-a2cef5640981 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:02.952509 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8103ee-05da-4252-a89f-a2cef5640981 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:02.952798 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8103ee-05da-4252-a89f-a2cef5640981 None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:02.953533 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8103ee-05da-4252-a89f-a2cef5640981 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:02.953843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8103ee-05da-4252-a89f-a2cef5640981 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:02.955535 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8103ee-05da-4252-a89f-a2cef5640981 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:02.967973 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 283/567] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:02.968789 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8103ee-05da-4252-a89f-a2cef5640981 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:03.029289 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a5f50-33d6-4fd2-88a6-8027db80c555 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:03.063204 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b3369-1294-48ef-b276-d4a54e9794bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:03.064016 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b3369-1294-48ef-b276-d4a54e9794bf None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:03.064301 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b3369-1294-48ef-b276-d4a54e9794bf None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:03.064576 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b3369-1294-48ef-b276-d4a54e9794bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:03.065492 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8103ee-05da-4252-a89f-a2cef5640981 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:03.075157 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b3369-1294-48ef-b276-d4a54e9794bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:19:03.083412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-157b3369-1294-48ef-b276-d4a54e9794bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:19:03.083412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:03.083412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:03.083412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:03.083412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:03.083412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:03.083412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:03.083412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:03.083412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:03.083412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:03.083412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:03.083412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:03.083412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:19:03.083412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:19:03.083412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:19:03.083412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:19:03.084528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:19:03.084528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:19:03.084528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:19:03.084528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:19:03.084528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:03.084528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:03.084528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:03.084528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:03.084528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:03.084528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:03.084528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:03.084528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:03.084528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:03.084528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:03.084528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:03.084528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:03.085359 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:03.085359 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:03.085359 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:03.085359 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:03.085359 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:19:03.085359 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:19:03.085359 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:19:03.085359 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:19:03.085359 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:19:03.085359 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:19:03.085359 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:19:03.085359 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:03.085359 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 285/568] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 19 15:19:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:03.086046 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c868d-5625-42eb-9807-f10be527b43d None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:03.086113 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c868d-5625-42eb-9807-f10be527b43d None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:03.086355 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c868d-5625-42eb-9807-f10be527b43d None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:03.087640 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 286/569] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:03.088327 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c868d-5625-42eb-9807-f10be527b43d None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:03.103750 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03685ec4-32de-4c63-93ef-773cd61438b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:03.104420 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03685ec4-32de-4c63-93ef-773cd61438b0 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:03.104711 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03685ec4-32de-4c63-93ef-773cd61438b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:03.104990 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03685ec4-32de-4c63-93ef-773cd61438b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:03.105720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03685ec4-32de-4c63-93ef-773cd61438b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:03.106033 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03685ec4-32de-4c63-93ef-773cd61438b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:03.107440 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03685ec4-32de-4c63-93ef-773cd61438b0 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:03.119086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 284/570] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:03.119543 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:03.119919 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03685ec4-32de-4c63-93ef-773cd61438b0 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:03.149846 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:03.198633 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c868d-5625-42eb-9807-f10be527b43d None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:03.224516 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03685ec4-32de-4c63-93ef-773cd61438b0 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:03.233607 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dff8dc-c64a-4ca1-8983-ee44c054b46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:03.234390 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dff8dc-c64a-4ca1-8983-ee44c054b46a None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:03.234687 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dff8dc-c64a-4ca1-8983-ee44c054b46a None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:03.234961 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dff8dc-c64a-4ca1-8983-ee44c054b46a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:03.245588 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dff8dc-c64a-4ca1-8983-ee44c054b46a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:03.247079 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dff8dc-c64a-4ca1-8983-ee44c054b46a None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:03.256798 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9c8e9-eb0d-484e-9c8e-5c58aa81c08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:03.257581 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9c8e9-eb0d-484e-9c8e-5c58aa81c08d None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:03.257865 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9c8e9-eb0d-484e-9c8e-5c58aa81c08d None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:03.258142 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9c8e9-eb0d-484e-9c8e-5c58aa81c08d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:03.263931 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-77dff8dc-c64a-4ca1-8983-ee44c054b46a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:03.263931 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:03.263931 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:03.263931 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:03.263931 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:03.263931 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:03.263931 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:03.263931 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:03.263931 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:03.263931 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:03.263931 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:03.263931 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:03.263931 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:03.263931 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:03.263931 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:03.264962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:03.264962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:03.264962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:03.264962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:03.264962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:03.264962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:03.264962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:03.264962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:03.264962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:03.264962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:03.264962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:03.264962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:03.264962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:03.264962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:03.264962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:03.264962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:03.264962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:03.266030 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:03.266030 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:03.266030 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:03.266030 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:03.267051 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9c8e9-eb0d-484e-9c8e-5c58aa81c08d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:03.268537 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9c8e9-eb0d-484e-9c8e-5c58aa81c08d None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:03.278236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 287/571] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:03.278236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dff8dc-c64a-4ca1-8983-ee44c054b46a None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:03.292665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-f3b9c8e9-eb0d-484e-9c8e-5c58aa81c08d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:03.292665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:03.292665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:03.292665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:03.292665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:03.292665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:03.292665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:03.292665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:03.292665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:03.292665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:03.292665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:03.292665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:03.292665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:19:03.292665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:19:03.292665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:19:03.293726 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:19:03.293726 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:03.293726 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:03.293726 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:03.293726 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:03.293726 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:03.293726 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:03.293726 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:03.293726 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:03.293726 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:03.293726 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:03.293726 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:03.293726 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:03.293726 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:03.293726 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:03.293726 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:03.293726 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:03.294791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:19:03.294791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:19:03.294791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:19:03.294791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:19:03.294791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:19:03.294791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:19:03.294791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:03.294791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:03.294791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 285/572] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:19:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:03.295388 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855da8a8-2c4c-4c66-9c26-80263b5409fb None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:03.295466 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855da8a8-2c4c-4c66-9c26-80263b5409fb None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:03.295715 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855da8a8-2c4c-4c66-9c26-80263b5409fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:03.312148 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-855da8a8-2c4c-4c66-9c26-80263b5409fb None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:03.313359 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-855da8a8-2c4c-4c66-9c26-80263b5409fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:03.357857 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:03.374279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dff8dc-c64a-4ca1-8983-ee44c054b46a None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:03.379136 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 286/573] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:19:03.380025 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855da8a8-2c4c-4c66-9c26-80263b5409fb None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:03.406464 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:03.414357 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83780cd0-e03a-480f-bd74-9a5f700942f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:03.415028 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83780cd0-e03a-480f-bd74-9a5f700942f5 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:03.415348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83780cd0-e03a-480f-bd74-9a5f700942f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:03.415628 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83780cd0-e03a-480f-bd74-9a5f700942f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:03.416374 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83780cd0-e03a-480f-bd74-9a5f700942f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:03.416679 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83780cd0-e03a-480f-bd74-9a5f700942f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:03.418036 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83780cd0-e03a-480f-bd74-9a5f700942f5 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:03.425847 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 288/574] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 19 15:19:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:03.427149 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83780cd0-e03a-480f-bd74-9a5f700942f5 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:03.491696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855da8a8-2c4c-4c66-9c26-80263b5409fb None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:03.525416 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37040f97-2680-4783-bc60-4e3da6c1f6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:03.526029 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83780cd0-e03a-480f-bd74-9a5f700942f5 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:03.526216 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37040f97-2680-4783-bc60-4e3da6c1f6e9 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:03.526506 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37040f97-2680-4783-bc60-4e3da6c1f6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:03.526788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37040f97-2680-4783-bc60-4e3da6c1f6e9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:03.534817 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37040f97-2680-4783-bc60-4e3da6c1f6e9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:03.536889 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37040f97-2680-4783-bc60-4e3da6c1f6e9 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:03.552430 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-37040f97-2680-4783-bc60-4e3da6c1f6e9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 19 15:19:03.552430 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:03.552430 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:03.552430 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:03.552430 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:03.552430 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:03.552430 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:03.552430 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:03.552430 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:03.552430 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:03.552430 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:03.552430 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:03.552430 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:19:03.552430 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:19:03.552430 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:19:03.552430 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:19:03.553551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:03.553551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:03.553551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:19:03.553551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:03.553551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:19:03.553551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:03.553551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:03.553551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:03.553551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:03.553551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:03.553551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:03.553551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:03.553551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:03.553551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:03.553551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:03.553551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:03.553551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:03.553551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:03.559366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:03.559366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:03.559366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:19:03.559366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:19:03.559366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:19:03.559366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:19:03.559366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:19:03.559366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:19:03.559366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 19 15:19:03.559366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:03.559366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 287/575] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:19:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:03.559366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37040f97-2680-4783-bc60-4e3da6c1f6e9 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:03.563599 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ff4bd-2991-45db-b1d0-3e8f89a007c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:03.564266 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ff4bd-2991-45db-b1d0-3e8f89a007c7 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:03.564554 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ff4bd-2991-45db-b1d0-3e8f89a007c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:03.564838 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ff4bd-2991-45db-b1d0-3e8f89a007c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:03.565568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ff4bd-2991-45db-b1d0-3e8f89a007c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:03.565880 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ff4bd-2991-45db-b1d0-3e8f89a007c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:03.567360 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ff4bd-2991-45db-b1d0-3e8f89a007c7 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:03.579127 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 289/576] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:03.579969 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ff4bd-2991-45db-b1d0-3e8f89a007c7 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:03.588132 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:03.636728 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:03.658866 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37040f97-2680-4783-bc60-4e3da6c1f6e9 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:03.681495 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ff4bd-2991-45db-b1d0-3e8f89a007c7 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:03.694702 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c266da-33bc-4ab6-9fae-ce5dc2cfcf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:03.695413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c266da-33bc-4ab6-9fae-ce5dc2cfcf2a None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:03.695703 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c266da-33bc-4ab6-9fae-ce5dc2cfcf2a None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:03.695993 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c266da-33bc-4ab6-9fae-ce5dc2cfcf2a None admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:03.696796 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c266da-33bc-4ab6-9fae-ce5dc2cfcf2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:03.697118 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c266da-33bc-4ab6-9fae-ce5dc2cfcf2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:03.698548 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c266da-33bc-4ab6-9fae-ce5dc2cfcf2a None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:03.710519 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 288/577] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:19:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:03.711614 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c266da-33bc-4ab6-9fae-ce5dc2cfcf2a None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:03.721235 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86343142-ca56-4297-a392-c451ad347a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:03.722035 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86343142-ca56-4297-a392-c451ad347a13 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:03.722329 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86343142-ca56-4297-a392-c451ad347a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:03.722594 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86343142-ca56-4297-a392-c451ad347a13 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:03.734555 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86343142-ca56-4297-a392-c451ad347a13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:19:03.743940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-86343142-ca56-4297-a392-c451ad347a13 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:19:03.743940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:03.743940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:03.743940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:03.743940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:03.743940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:03.743940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:03.743940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:03.743940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:03.743940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:03.743940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:03.743940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:03.743940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:19:03.743940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:19:03.743940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:19:03.743940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:19:03.745101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:19:03.745101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:19:03.745101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:19:03.745101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:19:03.745101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:03.745101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:03.745101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:03.745101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:03.745101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:03.745101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:03.745101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:03.745101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:03.745101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:03.745101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:03.745101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:03.745101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:03.746068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:03.746068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:03.746068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:03.746068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:03.746068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:19:03.746068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:19:03.746068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:19:03.746068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:19:03.746068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:19:03.746068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:19:03.746068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:19:03.746068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:03.746068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 290/578] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 19 15:19:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:03.746068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86343142-ca56-4297-a392-c451ad347a13 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:03.817486 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:03.823344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c266da-33bc-4ab6-9fae-ce5dc2cfcf2a None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:03.857578 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86343142-ca56-4297-a392-c451ad347a13 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:03.859571 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38dff3-52d6-4c14-a577-16eed9d78258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:03.860381 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38dff3-52d6-4c14-a577-16eed9d78258 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:03.860672 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38dff3-52d6-4c14-a577-16eed9d78258 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:03.860955 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38dff3-52d6-4c14-a577-16eed9d78258 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:03.864613 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:03.873292 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38dff3-52d6-4c14-a577-16eed9d78258 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:03.874722 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38dff3-52d6-4c14-a577-16eed9d78258 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:03.891244 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e17571-b3d9-4ecc-97d7-7dbc6f4d8731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:03.891503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-8b38dff3-52d6-4c14-a577-16eed9d78258 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:03.891503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:03.891503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:03.891503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:03.891503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:03.891503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:03.891503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:03.891503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:03.891503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:03.891503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:03.891503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:03.891503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:03.891503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:03.891503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:03.891503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:03.892490 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:03.892490 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:03.892490 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:03.892490 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:03.892490 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:03.892490 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:03.892490 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:03.892490 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:03.892490 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:03.892490 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:03.892490 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:03.892490 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:03.892490 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:03.892490 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:03.892490 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:03.892490 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:03.892490 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:03.893370 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:03.893370 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:03.893370 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:03.893370 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:03.893609 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e17571-b3d9-4ecc-97d7-7dbc6f4d8731 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:03.893609 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e17571-b3d9-4ecc-97d7-7dbc6f4d8731 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:03.893609 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e17571-b3d9-4ecc-97d7-7dbc6f4d8731 None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:03.893785 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 289/579] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:03.893862 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e17571-b3d9-4ecc-97d7-7dbc6f4d8731 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:03.893940 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38dff3-52d6-4c14-a577-16eed9d78258 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:03.894009 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e17571-b3d9-4ecc-97d7-7dbc6f4d8731 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:03.895104 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e17571-b3d9-4ecc-97d7-7dbc6f4d8731 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:03.912847 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 291/580] 10.222.0.44 () {56 vars in 1137 bytes} [Tue Jul 19 15:19:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:03.913657 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e17571-b3d9-4ecc-97d7-7dbc6f4d8731 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:04.000658 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38dff3-52d6-4c14-a577-16eed9d78258 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:04.015685 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e17571-b3d9-4ecc-97d7-7dbc6f4d8731 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:04.034257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0440b57-146d-4585-9d93-21fb41b0f58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:04.035044 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0440b57-146d-4585-9d93-21fb41b0f58a None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:04.035395 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0440b57-146d-4585-9d93-21fb41b0f58a None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:04.036285 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0440b57-146d-4585-9d93-21fb41b0f58a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:04.040541 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:04.043007 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0440b57-146d-4585-9d93-21fb41b0f58a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:04.044496 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0440b57-146d-4585-9d93-21fb41b0f58a None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:04.051514 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833df83-0b14-4aed-80bf-83edfc478201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:04.052157 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833df83-0b14-4aed-80bf-83edfc478201 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:04.052441 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833df83-0b14-4aed-80bf-83edfc478201 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:04.052716 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833df83-0b14-4aed-80bf-83edfc478201 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:04.053533 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833df83-0b14-4aed-80bf-83edfc478201 None admin] RBAC: Adding query filter params (role.id=1ff62289fb434d09a13001c3ffbab080, scope.project.id=c54934775a86487295bdbc02ed3a0103, user.id=bd1dceaddb6e414faef0e0448cdf1be8) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:04.053841 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833df83-0b14-4aed-80bf-83edfc478201 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:04.055242 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833df83-0b14-4aed-80bf-83edfc478201 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:04.059179 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-d0440b57-146d-4585-9d93-21fb41b0f58a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:04.059179 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:04.059179 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:04.059179 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:04.059179 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:04.059179 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:04.059179 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:04.059179 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:04.059179 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:04.059179 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:04.059179 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:04.059179 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:04.059179 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:19:04.059179 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:19:04.059179 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:19:04.060210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:19:04.060210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:04.060210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:04.060210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:04.060210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:04.060210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:04.060210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:04.060210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:04.060210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:04.060210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:04.060210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:04.060210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:04.060210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:04.060210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:04.060210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:04.060210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:04.060210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:04.061222 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:19:04.061222 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:19:04.061222 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:19:04.061222 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:19:04.061222 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:19:04.061222 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:19:04.061222 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:04.061222 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:04.061222 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 290/581] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:19:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:04.061810 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0440b57-146d-4585-9d93-21fb41b0f58a None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:04.067600 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 292/582] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:19:03 2022] GET /identity/v3/role_assignments?user.id=bd1dceaddb6e414faef0e0448cdf1be8&scope.project.id=c54934775a86487295bdbc02ed3a0103&role.id=1ff62289fb434d09a13001c3ffbab080 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:04.068420 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833df83-0b14-4aed-80bf-83edfc478201 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:04.121166 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:04.179980 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0440b57-146d-4585-9d93-21fb41b0f58a None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:04.189771 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833df83-0b14-4aed-80bf-83edfc478201 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:04.220190 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc0320-8ae3-421c-93d7-348086b9d6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:04.220874 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc0320-8ae3-421c-93d7-348086b9d6fa None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:04.221166 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc0320-8ae3-421c-93d7-348086b9d6fa None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:04.221449 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc0320-8ae3-421c-93d7-348086b9d6fa None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:04.222276 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc0320-8ae3-421c-93d7-348086b9d6fa None admin] RBAC: Adding query filter params (name=service) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:04.222533 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc0320-8ae3-421c-93d7-348086b9d6fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:04.224518 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc0320-8ae3-421c-93d7-348086b9d6fa None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:04.233632 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 291/583] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 19 15:19:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:04.234750 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc0320-8ae3-421c-93d7-348086b9d6fa None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:04.239437 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a725c-e7f7-4ed3-b2ce-e1a85b8e6a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:04.240627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a725c-e7f7-4ed3-b2ce-e1a85b8e6a73 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:04.241189 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a725c-e7f7-4ed3-b2ce-e1a85b8e6a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:04.241711 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a725c-e7f7-4ed3-b2ce-e1a85b8e6a73 None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:04.243136 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a725c-e7f7-4ed3-b2ce-e1a85b8e6a73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:04.243781 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a725c-e7f7-4ed3-b2ce-e1a85b8e6a73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:04.246449 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a725c-e7f7-4ed3-b2ce-e1a85b8e6a73 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:04.268728 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 293/584] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:04.270620 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a725c-e7f7-4ed3-b2ce-e1a85b8e6a73 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:04.346741 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:04.373849 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc0320-8ae3-421c-93d7-348086b9d6fa None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:04.386702 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:04.406875 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a725c-e7f7-4ed3-b2ce-e1a85b8e6a73 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:04.413557 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fddcc46-d7ce-4942-a57f-38686c7e0422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:04.414361 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fddcc46-d7ce-4942-a57f-38686c7e0422 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:04.414676 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fddcc46-d7ce-4942-a57f-38686c7e0422 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:04.414975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fddcc46-d7ce-4942-a57f-38686c7e0422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:04.426808 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fddcc46-d7ce-4942-a57f-38686c7e0422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:04.428454 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fddcc46-d7ce-4942-a57f-38686c7e0422 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:04.448331 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-1fddcc46-d7ce-4942-a57f-38686c7e0422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:04.448331 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:04.448331 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:04.448331 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:04.448331 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:04.448331 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:04.448331 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:04.448331 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:04.448331 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:04.448331 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:04.448331 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:04.448331 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:04.448331 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:04.448331 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:04.448331 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:04.449433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:04.449433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:04.449433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:04.449433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:04.449433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:04.449433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:04.449433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:04.449433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:04.449433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:04.449433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:04.449433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:04.449433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:04.449433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:04.449433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:04.449433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:04.449433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:04.449433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:04.450503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:04.450503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:04.450503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:04.450503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:04.450503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 292/585] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:04.450503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fddcc46-d7ce-4942-a57f-38686c7e0422 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:04.460117 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76be7a6-883e-47ff-81f9-a61e1ae57d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:04.460809 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76be7a6-883e-47ff-81f9-a61e1ae57d77 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:04.461099 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76be7a6-883e-47ff-81f9-a61e1ae57d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:04.461379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76be7a6-883e-47ff-81f9-a61e1ae57d77 None admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:04.462755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76be7a6-883e-47ff-81f9-a61e1ae57d77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:04.463080 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76be7a6-883e-47ff-81f9-a61e1ae57d77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:04.464990 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76be7a6-883e-47ff-81f9-a61e1ae57d77 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:04.479385 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 294/586] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:19:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:04.484361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76be7a6-883e-47ff-81f9-a61e1ae57d77 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:04.567781 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fddcc46-d7ce-4942-a57f-38686c7e0422 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:04.604824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3e2d2-0189-43aa-9be6-ee35d12b58bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:04.606007 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3e2d2-0189-43aa-9be6-ee35d12b58bc None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:04.606437 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3e2d2-0189-43aa-9be6-ee35d12b58bc None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:04.606918 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3e2d2-0189-43aa-9be6-ee35d12b58bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:04.619511 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3e2d2-0189-43aa-9be6-ee35d12b58bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:04.620977 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76be7a6-883e-47ff-81f9-a61e1ae57d77 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:04.621384 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3e2d2-0189-43aa-9be6-ee35d12b58bc None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:04.633248 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:04.642320 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-ddb3e2d2-0189-43aa-9be6-ee35d12b58bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:04.642320 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:04.642320 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:04.642320 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:04.642320 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:04.642320 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:04.642320 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:04.642320 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:04.642320 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:04.642320 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:04.642320 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:04.642320 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:04.642320 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:04.642320 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:04.642320 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:04.643366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:04.643366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:04.643366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:04.643366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:04.643366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:04.643366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:04.643366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:04.643366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:04.643366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:04.643366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:04.643366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:04.643366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:04.643366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:04.643366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:04.643366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:04.643366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:04.643366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:04.644482 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:04.644482 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:04.644482 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:04.644482 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:04.644482 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 293/587] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:04.650193 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3e2d2-0189-43aa-9be6-ee35d12b58bc None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:04.674262 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee73635-97d1-4e62-a518-c7c23b6be6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:04.675459 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee73635-97d1-4e62-a518-c7c23b6be6da None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:04.675885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee73635-97d1-4e62-a518-c7c23b6be6da None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:04.675984 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:04.676861 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee73635-97d1-4e62-a518-c7c23b6be6da None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:04.686634 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee73635-97d1-4e62-a518-c7c23b6be6da None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:04.688111 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee73635-97d1-4e62-a518-c7c23b6be6da None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:04.704085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-dee73635-97d1-4e62-a518-c7c23b6be6da None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 15:19:04.704085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:04.704085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:04.704085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:04.704085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:04.704085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:04.704085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:04.704085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:04.704085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:04.704085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:04.704085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:04.704085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:04.704085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:19:04.704085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:19:04.704085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:19:04.704085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:19:04.705100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:04.705100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:04.705100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:19:04.705100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:04.705100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:19:04.705100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:04.705100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:04.705100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:04.705100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:04.705100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:04.705100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:04.705100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:04.705100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:04.705100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:04.705100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:04.705100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:04.705100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:04.705100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:04.706029 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:04.706029 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:04.706029 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:19:04.706029 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:19:04.706029 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:19:04.706029 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:19:04.706029 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:19:04.706029 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:19:04.706029 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 15:19:04.706029 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:04.706029 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 295/588] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:19:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:04.706615 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee73635-97d1-4e62-a518-c7c23b6be6da None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:04.787916 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3e2d2-0189-43aa-9be6-ee35d12b58bc None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:04.814558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee73635-97d1-4e62-a518-c7c23b6be6da None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:04.825217 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281580af-5506-4095-9bb9-a784c2e22bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:04.826171 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281580af-5506-4095-9bb9-a784c2e22bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:04.826639 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281580af-5506-4095-9bb9-a784c2e22bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:04.827110 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281580af-5506-4095-9bb9-a784c2e22bf5 None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:04.828159 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281580af-5506-4095-9bb9-a784c2e22bf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:04.828775 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281580af-5506-4095-9bb9-a784c2e22bf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:04.830150 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281580af-5506-4095-9bb9-a784c2e22bf5 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:04.844282 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 294/589] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:04.844970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281580af-5506-4095-9bb9-a784c2e22bf5 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:04.863262 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39bab5-a2e4-4958-838e-028775090afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:04.864683 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39bab5-a2e4-4958-838e-028775090afa None admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:04.864963 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39bab5-a2e4-4958-838e-028775090afa None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:04.865237 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39bab5-a2e4-4958-838e-028775090afa None admin] PATH_INFO: `/v3/projects/c54934775a86487295bdbc02ed3a0103/users/fef0511f56144ca9945b2dddfa2601a2/roles/1ff62289fb434d09a13001c3ffbab080` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:04.881852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39bab5-a2e4-4958-838e-028775090afa None admin] RBAC: Authorizing `identity:create_grant(project_id=c54934775a86487295bdbc02ed3a0103, user_id=fef0511f56144ca9945b2dddfa2601a2, role_id=1ff62289fb434d09a13001c3ffbab080)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:04.883329 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39bab5-a2e4-4958-838e-028775090afa None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:04.898844 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 296/590] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 19 15:19:04 2022] PUT /identity/v3/projects/c54934775a86487295bdbc02ed3a0103/users/fef0511f56144ca9945b2dddfa2601a2/roles/1ff62289fb434d09a13001c3ffbab080 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:19:04.899946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39bab5-a2e4-4958-838e-028775090afa None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:04.940998 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:04.947903 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:04.977153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281580af-5506-4095-9bb9-a784c2e22bf5 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:05.034999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb8473-e57e-41d5-a795-4c922c1bcfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:05.036443 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb8473-e57e-41d5-a795-4c922c1bcfb4 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:05.036894 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb8473-e57e-41d5-a795-4c922c1bcfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:05.037403 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb8473-e57e-41d5-a795-4c922c1bcfb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:05.038300 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb8473-e57e-41d5-a795-4c922c1bcfb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:05.038753 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb8473-e57e-41d5-a795-4c922c1bcfb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:05.041114 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb8473-e57e-41d5-a795-4c922c1bcfb4 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:05.062280 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 295/591] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:05.064827 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb8473-e57e-41d5-a795-4c922c1bcfb4 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:05.079715 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39bab5-a2e4-4958-838e-028775090afa None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:05.121763 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dcf3aa-d193-4446-8a43-47dd65a11300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:05.122881 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dcf3aa-d193-4446-8a43-47dd65a11300 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:05.123426 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dcf3aa-d193-4446-8a43-47dd65a11300 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:05.123778 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dcf3aa-d193-4446-8a43-47dd65a11300 None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:05.124634 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dcf3aa-d193-4446-8a43-47dd65a11300 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:05.125065 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dcf3aa-d193-4446-8a43-47dd65a11300 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:05.126598 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dcf3aa-d193-4446-8a43-47dd65a11300 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:05.150580 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 297/592] 10.222.0.44 () {56 vars in 1137 bytes} [Tue Jul 19 15:19:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:05.150580 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dcf3aa-d193-4446-8a43-47dd65a11300 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:05.190767 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb8473-e57e-41d5-a795-4c922c1bcfb4 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:05.228414 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a71025-93c4-449b-8a1d-5351723c01e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:05.229509 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a71025-93c4-449b-8a1d-5351723c01e9 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:05.229799 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a71025-93c4-449b-8a1d-5351723c01e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:05.230085 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a71025-93c4-449b-8a1d-5351723c01e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:05.233247 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:05.240483 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a71025-93c4-449b-8a1d-5351723c01e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:05.242418 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a71025-93c4-449b-8a1d-5351723c01e9 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:05.261914 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-35a71025-93c4-449b-8a1d-5351723c01e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:05.261914 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:05.261914 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:05.261914 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:05.261914 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:05.261914 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:05.261914 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:05.261914 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:05.261914 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:05.261914 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:05.261914 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:05.261914 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:05.261914 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:19:05.261914 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:19:05.261914 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:19:05.262828 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:19:05.262828 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:05.262828 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:05.262828 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:05.262828 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:05.262828 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:05.262828 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:05.262828 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:05.262828 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:05.262828 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:05.262828 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:05.262828 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:05.262828 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:05.262828 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:05.262828 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:05.262828 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:05.262828 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:05.264139 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:19:05.264139 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:19:05.264139 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:19:05.264139 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:19:05.264139 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:19:05.264139 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:19:05.264139 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:05.264139 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:05.264139 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 296/593] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:19:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:05.264615 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dcf3aa-d193-4446-8a43-47dd65a11300 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:05.264688 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a71025-93c4-449b-8a1d-5351723c01e9 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:05.275580 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:05.305015 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf397d81-b236-4c9c-b936-c62c5c022e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:05.305914 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf397d81-b236-4c9c-b936-c62c5c022e69 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:05.306269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf397d81-b236-4c9c-b936-c62c5c022e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:05.306619 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf397d81-b236-4c9c-b936-c62c5c022e69 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:05.314535 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf397d81-b236-4c9c-b936-c62c5c022e69 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:05.316186 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf397d81-b236-4c9c-b936-c62c5c022e69 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:05.332981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-cf397d81-b236-4c9c-b936-c62c5c022e69 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 15:19:05.332981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:05.332981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:05.332981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:05.332981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:05.332981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:05.332981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:05.332981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:05.332981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:05.332981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:05.332981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:05.332981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:05.332981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:19:05.332981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:19:05.332981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:19:05.332981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:19:05.334885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:05.334885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:05.334885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:19:05.334885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:05.334885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:19:05.334885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:05.334885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:05.334885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:05.334885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:05.334885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:05.334885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:05.334885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:05.334885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:05.334885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:05.334885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:05.334885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:05.334885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:05.334885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:05.337199 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:05.337199 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:05.337199 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:19:05.337199 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:19:05.337199 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:19:05.337199 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:19:05.337199 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:19:05.337199 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:19:05.337199 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 15:19:05.337199 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:05.337199 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 298/594] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 19 15:19:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:05.337199 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf397d81-b236-4c9c-b936-c62c5c022e69 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:05.394395 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a71025-93c4-449b-8a1d-5351723c01e9 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:05.430269 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6465fc0-a4b1-4f94-b2d2-de4e7cc1189e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:05.431167 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6465fc0-a4b1-4f94-b2d2-de4e7cc1189e None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:05.431485 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6465fc0-a4b1-4f94-b2d2-de4e7cc1189e None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:05.431765 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6465fc0-a4b1-4f94-b2d2-de4e7cc1189e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:05.443321 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6465fc0-a4b1-4f94-b2d2-de4e7cc1189e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:05.444763 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6465fc0-a4b1-4f94-b2d2-de4e7cc1189e None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:05.460894 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf397d81-b236-4c9c-b936-c62c5c022e69 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:05.464187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-e6465fc0-a4b1-4f94-b2d2-de4e7cc1189e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:05.464187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:05.464187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:05.464187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:05.464187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:05.464187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:05.464187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:05.464187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:05.464187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:05.464187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:05.464187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:05.464187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:05.464187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:05.464187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:05.464187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:05.465049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:05.465049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:05.465049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:05.465049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:05.465049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:05.465049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:05.465049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:05.465049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:05.465049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:05.465049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:05.465049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:05.465049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:05.465049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:05.465049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:05.465049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:05.465049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:05.465049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:05.465953 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:05.465953 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:05.465953 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:05.465953 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:05.465953 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 297/595] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:05.465953 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6465fc0-a4b1-4f94-b2d2-de4e7cc1189e None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:05.505854 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe8d3e-5a56-4b1f-bf34-9a3abd658c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:05.507147 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe8d3e-5a56-4b1f-bf34-9a3abd658c10 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:05.507639 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe8d3e-5a56-4b1f-bf34-9a3abd658c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:05.508186 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe8d3e-5a56-4b1f-bf34-9a3abd658c10 None admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:05.509713 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe8d3e-5a56-4b1f-bf34-9a3abd658c10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:05.510180 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe8d3e-5a56-4b1f-bf34-9a3abd658c10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:05.511979 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe8d3e-5a56-4b1f-bf34-9a3abd658c10 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:05.515663 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:05.530937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:05.534362 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 299/596] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:19:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:05.535261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe8d3e-5a56-4b1f-bf34-9a3abd658c10 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:05.592409 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6465fc0-a4b1-4f94-b2d2-de4e7cc1189e None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:05.630395 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ec7f1-1f61-43b7-8836-845347284ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:05.631559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ec7f1-1f61-43b7-8836-845347284ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:05.632052 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ec7f1-1f61-43b7-8836-845347284ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:05.632559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ec7f1-1f61-43b7-8836-845347284ba1 None admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:05.633686 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ec7f1-1f61-43b7-8836-845347284ba1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:05.634224 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ec7f1-1f61-43b7-8836-845347284ba1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:05.635982 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ec7f1-1f61-43b7-8836-845347284ba1 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:05.656363 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 298/597] 10.222.0.44 () {56 vars in 1139 bytes} [Tue Jul 19 15:19:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:05.657640 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ec7f1-1f61-43b7-8836-845347284ba1 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:05.663722 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe8d3e-5a56-4b1f-bf34-9a3abd658c10 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:05.703868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df0b37-db43-4fa6-83b9-a1f9307138da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:05.704895 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df0b37-db43-4fa6-83b9-a1f9307138da None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:05.705503 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df0b37-db43-4fa6-83b9-a1f9307138da None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:05.705982 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df0b37-db43-4fa6-83b9-a1f9307138da None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:05.707080 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df0b37-db43-4fa6-83b9-a1f9307138da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:05.708191 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df0b37-db43-4fa6-83b9-a1f9307138da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:05.709928 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df0b37-db43-4fa6-83b9-a1f9307138da None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:05.729500 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 300/598] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:05.730889 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df0b37-db43-4fa6-83b9-a1f9307138da None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:05.787863 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ec7f1-1f61-43b7-8836-845347284ba1 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:05.790883 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:05.797674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:05.833155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982debb-51c6-4e7d-8039-159acf8a14ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:05.834761 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982debb-51c6-4e7d-8039-159acf8a14ff None admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:05.835297 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982debb-51c6-4e7d-8039-159acf8a14ff None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:05.835781 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982debb-51c6-4e7d-8039-159acf8a14ff None admin] PATH_INFO: `/v3/projects/c54934775a86487295bdbc02ed3a0103/users/3e66abbda1744a71b4d26677dcef76be/roles/1ff62289fb434d09a13001c3ffbab080` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:05.863520 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df0b37-db43-4fa6-83b9-a1f9307138da None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:05.872229 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982debb-51c6-4e7d-8039-159acf8a14ff None admin] RBAC: Authorizing `identity:create_grant(project_id=c54934775a86487295bdbc02ed3a0103, user_id=3e66abbda1744a71b4d26677dcef76be, role_id=1ff62289fb434d09a13001c3ffbab080)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:05.874812 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982debb-51c6-4e7d-8039-159acf8a14ff None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:05.894862 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 299/599] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 19 15:19:05 2022] PUT /identity/v3/projects/c54934775a86487295bdbc02ed3a0103/users/3e66abbda1744a71b4d26677dcef76be/roles/1ff62289fb434d09a13001c3ffbab080 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:19:05.896305 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982debb-51c6-4e7d-8039-159acf8a14ff None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:05.921737 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f0432-7254-4e75-8ce3-3dda53f55356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:05.922908 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f0432-7254-4e75-8ce3-3dda53f55356 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:05.923186 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f0432-7254-4e75-8ce3-3dda53f55356 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:05.923486 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f0432-7254-4e75-8ce3-3dda53f55356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:05.949197 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f0432-7254-4e75-8ce3-3dda53f55356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:05.954911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f0432-7254-4e75-8ce3-3dda53f55356 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:05.986736 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-8e5f0432-7254-4e75-8ce3-3dda53f55356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:05.986736 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:05.986736 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:05.986736 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:05.986736 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:05.986736 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:05.986736 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:05.986736 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:05.986736 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:05.986736 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:05.986736 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:05.986736 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:05.986736 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:05.986736 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:05.986736 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:05.987712 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:05.987712 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:05.987712 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:05.987712 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:05.987712 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:05.987712 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:05.987712 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:05.987712 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:05.987712 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:05.987712 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:05.987712 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:05.987712 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:05.987712 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:05.987712 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:05.987712 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:05.987712 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:05.987712 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:05.989226 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:05.989226 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:05.989226 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:05.989226 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:05.991735 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 301/600] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:05.997050 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f0432-7254-4e75-8ce3-3dda53f55356 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:06.149022 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f0432-7254-4e75-8ce3-3dda53f55356 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:06.151517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982debb-51c6-4e7d-8039-159acf8a14ff None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:06.165037 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:06.199150 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e665ae-7a11-48f7-becd-3b8ab052007d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:06.199868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e665ae-7a11-48f7-becd-3b8ab052007d None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:06.200147 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e665ae-7a11-48f7-becd-3b8ab052007d None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:06.200419 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e665ae-7a11-48f7-becd-3b8ab052007d None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:06.201160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e665ae-7a11-48f7-becd-3b8ab052007d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:06.201466 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e665ae-7a11-48f7-becd-3b8ab052007d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:06.202887 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e665ae-7a11-48f7-becd-3b8ab052007d None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:06.210012 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dcee4-9aff-480c-b634-5a416eeaa649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:06.210948 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dcee4-9aff-480c-b634-5a416eeaa649 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:06.211367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dcee4-9aff-480c-b634-5a416eeaa649 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:06.211725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dcee4-9aff-480c-b634-5a416eeaa649 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:06.216243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 302/601] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:06.217830 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc941b63-0e09-4704-8dab-80fced11ad46 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:06.218313 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc941b63-0e09-4704-8dab-80fced11ad46 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:06.218765 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc941b63-0e09-4704-8dab-80fced11ad46 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:06.220520 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 303/602] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:06.223827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc941b63-0e09-4704-8dab-80fced11ad46 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:06.230913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6dcee4-9aff-480c-b634-5a416eeaa649 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:06.232451 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6dcee4-9aff-480c-b634-5a416eeaa649 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:06.249885 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-7f6dcee4-9aff-480c-b634-5a416eeaa649 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:06.249885 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:06.249885 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:06.249885 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:06.249885 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:06.249885 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:06.249885 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:06.249885 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:06.249885 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:06.249885 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:06.249885 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:06.249885 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:06.249885 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:19:06.249885 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:19:06.249885 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:19:06.250855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:19:06.250855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:06.250855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:06.250855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:06.250855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:06.250855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:06.250855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:06.250855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:06.250855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:06.250855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:06.250855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:06.250855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:06.250855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:06.250855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:06.250855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:06.250855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:06.250855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:06.251795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:19:06.251795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:19:06.251795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:19:06.251795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:19:06.251795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:19:06.251795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:19:06.251795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:06.251795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:06.251795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 300/603] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:19:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:06.252427 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7b6e7-946e-48d0-9e49-e51517c774a7 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:06.253368 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7b6e7-946e-48d0-9e49-e51517c774a7 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:06.253368 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7b6e7-946e-48d0-9e49-e51517c774a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:06.272995 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-b0b7b6e7-946e-48d0-9e49-e51517c774a7 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:06.274717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-b0b7b6e7-946e-48d0-9e49-e51517c774a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:06.287905 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:06.355533 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc941b63-0e09-4704-8dab-80fced11ad46 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:06.372271 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 301/604] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:19:06.373511 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7b6e7-946e-48d0-9e49-e51517c774a7 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:06.417124 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecaad62-be7e-4daf-bf50-ade7691c06cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:06.417856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecaad62-be7e-4daf-bf50-ade7691c06cb None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:06.418139 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecaad62-be7e-4daf-bf50-ade7691c06cb None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:06.418419 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecaad62-be7e-4daf-bf50-ade7691c06cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:06.426528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecaad62-be7e-4daf-bf50-ade7691c06cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:06.428039 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecaad62-be7e-4daf-bf50-ade7691c06cb None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:06.443361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-5ecaad62-be7e-4daf-bf50-ade7691c06cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:06.443361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:06.443361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:06.443361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:06.443361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:06.443361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:06.443361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:06.443361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:06.443361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:06.443361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:06.443361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:06.443361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:06.443361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:19:06.443361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:19:06.443361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:19:06.444318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:19:06.444318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:06.444318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:06.444318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:06.444318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:06.444318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:06.444318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:06.444318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:06.444318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:06.444318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:06.444318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:06.444318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:06.444318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:06.444318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:06.444318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:06.444318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:06.444318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:06.445195 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:19:06.445195 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:19:06.445195 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:19:06.445195 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:19:06.445195 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:19:06.445195 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:19:06.445195 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:06.445195 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:06.450164 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 304/605] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:19:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:06.450749 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecaad62-be7e-4daf-bf50-ade7691c06cb None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:06.506326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:06.564281 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7b6e7-946e-48d0-9e49-e51517c774a7 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:06.610547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e0c52-64c2-438f-90b6-9d14879b5432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:06.612048 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e0c52-64c2-438f-90b6-9d14879b5432 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:06.612565 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e0c52-64c2-438f-90b6-9d14879b5432 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:06.613294 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e0c52-64c2-438f-90b6-9d14879b5432 None admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:06.614859 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e0c52-64c2-438f-90b6-9d14879b5432 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:06.615446 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e0c52-64c2-438f-90b6-9d14879b5432 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:06.617585 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e0c52-64c2-438f-90b6-9d14879b5432 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:06.637625 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 302/606] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:19:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:06.637625 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e0c52-64c2-438f-90b6-9d14879b5432 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:06.643267 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:06.651807 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecaad62-be7e-4daf-bf50-ade7691c06cb None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:06.713255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803cbd03-a88a-48b2-a137-4312ee6ced66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:06.714717 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cbd03-a88a-48b2-a137-4312ee6ced66 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:06.715211 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cbd03-a88a-48b2-a137-4312ee6ced66 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:06.715714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cbd03-a88a-48b2-a137-4312ee6ced66 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:06.730180 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803cbd03-a88a-48b2-a137-4312ee6ced66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:19:06.740564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-803cbd03-a88a-48b2-a137-4312ee6ced66 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:19:06.740564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:06.740564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:06.740564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:06.740564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:06.740564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:06.740564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:06.740564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:06.740564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:06.740564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:06.740564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:06.740564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:06.740564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:19:06.740564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:19:06.740564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:19:06.740564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:19:06.741539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:19:06.741539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:19:06.741539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:19:06.741539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:19:06.741539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:06.741539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:06.741539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:06.741539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:06.741539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:06.741539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:06.741539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:06.741539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:06.741539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:06.741539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:06.741539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:06.741539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:06.742424 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:06.742424 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:06.742424 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:06.742424 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:06.742424 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:19:06.742424 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:19:06.742424 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:19:06.742424 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:19:06.742424 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:19:06.742424 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:19:06.742424 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:19:06.742424 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:06.745406 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 305/607] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 19 15:19:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:06.746397 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803cbd03-a88a-48b2-a137-4312ee6ced66 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:06.791554 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e0c52-64c2-438f-90b6-9d14879b5432 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:06.834662 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bffe0-cd60-4b15-a2cc-331928e5adda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:06.835358 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bffe0-cd60-4b15-a2cc-331928e5adda None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:06.835644 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bffe0-cd60-4b15-a2cc-331928e5adda None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:06.835921 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bffe0-cd60-4b15-a2cc-331928e5adda None admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:06.836813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4bffe0-cd60-4b15-a2cc-331928e5adda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:06.837019 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4bffe0-cd60-4b15-a2cc-331928e5adda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:06.838446 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4bffe0-cd60-4b15-a2cc-331928e5adda None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:06.858672 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 303/608] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:19:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:06.860379 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bffe0-cd60-4b15-a2cc-331928e5adda None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:06.885677 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:06.904522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803cbd03-a88a-48b2-a137-4312ee6ced66 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:06.932251 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:06.951364 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f36293-8483-4d9e-8675-ed54a0362160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:06.952691 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f36293-8483-4d9e-8675-ed54a0362160 None admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:06.953212 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f36293-8483-4d9e-8675-ed54a0362160 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:06.953689 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f36293-8483-4d9e-8675-ed54a0362160 None admin] PATH_INFO: `/v3/projects/c54934775a86487295bdbc02ed3a0103/users/fcf1f5f0ccf8449191a8660e5b1906d3/roles/1ff62289fb434d09a13001c3ffbab080` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:06.971049 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f36293-8483-4d9e-8675-ed54a0362160 None admin] RBAC: Authorizing `identity:create_grant(project_id=c54934775a86487295bdbc02ed3a0103, user_id=fcf1f5f0ccf8449191a8660e5b1906d3, role_id=1ff62289fb434d09a13001c3ffbab080)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:06.972984 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f36293-8483-4d9e-8675-ed54a0362160 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:06.981845 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bffe0-cd60-4b15-a2cc-331928e5adda None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:06.999471 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 306/609] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 19 15:19:06 2022] PUT /identity/v3/projects/c54934775a86487295bdbc02ed3a0103/users/fcf1f5f0ccf8449191a8660e5b1906d3/roles/1ff62289fb434d09a13001c3ffbab080 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:19:07.001228 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f36293-8483-4d9e-8675-ed54a0362160 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:07.023431 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a50586-22ce-4910-b975-e39a3db1263b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:07.024662 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a50586-22ce-4910-b975-e39a3db1263b None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:07.024776 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a50586-22ce-4910-b975-e39a3db1263b None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:07.024963 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a50586-22ce-4910-b975-e39a3db1263b None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:07.025935 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a50586-22ce-4910-b975-e39a3db1263b None admin] RBAC: Adding query filter params (name=service) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:07.026130 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a50586-22ce-4910-b975-e39a3db1263b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:07.027594 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a50586-22ce-4910-b975-e39a3db1263b None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:07.038532 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 304/610] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 19 15:19:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:07.043865 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a50586-22ce-4910-b975-e39a3db1263b None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:07.156621 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a50586-22ce-4910-b975-e39a3db1263b None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:07.182435 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f36293-8483-4d9e-8675-ed54a0362160 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:07.191270 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:07.204039 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bcdd1c-05f7-4997-ab69-7d8d58d7e290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:07.205198 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcdd1c-05f7-4997-ab69-7d8d58d7e290 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:07.205551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcdd1c-05f7-4997-ab69-7d8d58d7e290 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:07.205832 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcdd1c-05f7-4997-ab69-7d8d58d7e290 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:07.232910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bcdd1c-05f7-4997-ab69-7d8d58d7e290 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:07.234696 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a19e8-47bd-4921-a12f-2e66594b1615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:07.235406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bcdd1c-05f7-4997-ab69-7d8d58d7e290 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:07.236020 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a19e8-47bd-4921-a12f-2e66594b1615 None admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:07.236613 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a19e8-47bd-4921-a12f-2e66594b1615 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:07.237041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a19e8-47bd-4921-a12f-2e66594b1615 None admin] PATH_INFO: `/v3/projects/c54934775a86487295bdbc02ed3a0103/users/c89e7fbcc22c478c98d74b802f4bf8f0/roles/1ff62289fb434d09a13001c3ffbab080` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:07.249686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:07.263257 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a19e8-47bd-4921-a12f-2e66594b1615 None admin] RBAC: Authorizing `identity:create_grant(project_id=c54934775a86487295bdbc02ed3a0103, user_id=c89e7fbcc22c478c98d74b802f4bf8f0, role_id=1ff62289fb434d09a13001c3ffbab080)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:07.264977 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a19e8-47bd-4921-a12f-2e66594b1615 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:07.276512 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-37bcdd1c-05f7-4997-ab69-7d8d58d7e290 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:07.276512 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:07.276512 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:07.276512 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:07.276512 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:07.276512 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:07.276512 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:07.276512 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:07.276512 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:07.276512 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:07.276512 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:07.276512 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:07.276512 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:07.276512 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:07.276512 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:07.277642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:07.277642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:07.277642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:07.277642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:07.277642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:07.277642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:07.277642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:07.277642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:07.277642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:07.277642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:07.277642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:07.277642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:07.277642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:07.277642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:07.277642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:07.277642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:07.277642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:07.278736 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:07.278736 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:07.278736 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:07.278736 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:07.279135 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 305/611] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:19:07.281325 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ea4dd-b519-478a-8b1c-c3e1d1d79c77 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:07.281855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ea4dd-b519-478a-8b1c-c3e1d1d79c77 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:07.282365 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ea4dd-b519-478a-8b1c-c3e1d1d79c77 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:07.283635 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 307/612] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 19 15:19:06 2022] PUT /identity/v3/projects/c54934775a86487295bdbc02ed3a0103/users/c89e7fbcc22c478c98d74b802f4bf8f0/roles/1ff62289fb434d09a13001c3ffbab080 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:19:07.292535 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a19e8-47bd-4921-a12f-2e66594b1615 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:07.293254 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 306/613] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:07 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:07.300271 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb4686-c998-4720-8dde-d74d7a448484 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:07.300772 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb4686-c998-4720-8dde-d74d7a448484 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:07.301713 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb4686-c998-4720-8dde-d74d7a448484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:07.341705 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-7adb4686-c998-4720-8dde-d74d7a448484 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:07.345954 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-7adb4686-c998-4720-8dde-d74d7a448484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:07.494645 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 307/614] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:19:07.507632 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a19e8-47bd-4921-a12f-2e66594b1615 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:07.525276 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb4686-c998-4720-8dde-d74d7a448484 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:07.546768 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8b90d-767d-496a-a925-415c564fec14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:07.547758 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8b90d-767d-496a-a925-415c564fec14 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:07.548192 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8b90d-767d-496a-a925-415c564fec14 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:07.548605 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8b90d-767d-496a-a925-415c564fec14 None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:07.549499 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8b90d-767d-496a-a925-415c564fec14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:07.549982 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8b90d-767d-496a-a925-415c564fec14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:07.552222 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8b90d-767d-496a-a925-415c564fec14 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:07.565126 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 308/615] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:07.571187 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8b90d-767d-496a-a925-415c564fec14 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:07.630306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:07.643454 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb4686-c998-4720-8dde-d74d7a448484 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:07.654295 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:07.703558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8b90d-767d-496a-a925-415c564fec14 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:07.717518 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2788ce-ddc9-445e-a9ec-883dd8562aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:07.718363 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2788ce-ddc9-445e-a9ec-883dd8562aae None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:07.718729 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2788ce-ddc9-445e-a9ec-883dd8562aae None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:07.718901 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2788ce-ddc9-445e-a9ec-883dd8562aae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:07.746568 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2788ce-ddc9-445e-a9ec-883dd8562aae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:19:07.751581 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b19af0-e7e7-48b7-902f-70eb932ad454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:07.752627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b19af0-e7e7-48b7-902f-70eb932ad454 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:07.753087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b19af0-e7e7-48b7-902f-70eb932ad454 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:07.753561 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b19af0-e7e7-48b7-902f-70eb932ad454 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:07.763293 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b19af0-e7e7-48b7-902f-70eb932ad454 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:07.765069 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b19af0-e7e7-48b7-902f-70eb932ad454 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:07.766738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-bc2788ce-ddc9-445e-a9ec-883dd8562aae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:19:07.766738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:07.766738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:07.766738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:07.766738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:07.766738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:07.766738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:07.766738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:07.766738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:07.766738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:07.766738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:07.766738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:07.766738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:19:07.766738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:19:07.766738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:19:07.766738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:19:07.767721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:19:07.767721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:19:07.767721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:19:07.767721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:19:07.767721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:07.767721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:07.767721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:07.767721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:07.767721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:07.767721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:07.767721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:07.767721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:07.767721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:07.767721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:07.767721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:07.767721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:07.768535 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:07.768535 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:07.768535 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:07.768535 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:07.768535 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:19:07.768535 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:19:07.768535 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:19:07.768535 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:19:07.768535 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:19:07.768535 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:19:07.768535 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:19:07.768535 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:07.768535 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 308/616] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 19 15:19:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:07.774818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2788ce-ddc9-445e-a9ec-883dd8562aae None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:07.798512 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-99b19af0-e7e7-48b7-902f-70eb932ad454 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 15:19:07.798512 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:07.798512 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:07.798512 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:07.798512 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:07.798512 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:07.798512 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:07.798512 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:07.798512 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:07.798512 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:07.798512 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:07.798512 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:07.798512 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:19:07.798512 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:19:07.798512 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:19:07.798512 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:19:07.799904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:07.799904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:07.799904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:19:07.799904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:07.799904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:19:07.799904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:07.799904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:07.799904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:07.799904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:07.799904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:07.799904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:07.799904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:07.799904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:07.799904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:07.799904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:07.799904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:07.799904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:07.799904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:07.801571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:07.801571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:07.801571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:19:07.801571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:19:07.801571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:19:07.801571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:19:07.801571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:19:07.801571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:19:07.801571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 15:19:07.801571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:07.804564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 309/617] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:19:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:19:07.811888 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b19af0-e7e7-48b7-902f-70eb932ad454 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:07.965688 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b19af0-e7e7-48b7-902f-70eb932ad454 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:07.976537 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:07.993754 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2788ce-ddc9-445e-a9ec-883dd8562aae None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:08.005553 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186a20d-510e-466b-a836-66bb11e0c4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:08.006155 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186a20d-510e-466b-a836-66bb11e0c4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:08.006439 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186a20d-510e-466b-a836-66bb11e0c4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:08.006760 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186a20d-510e-466b-a836-66bb11e0c4b4 None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:08.007648 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186a20d-510e-466b-a836-66bb11e0c4b4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:08.007970 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186a20d-510e-466b-a836-66bb11e0c4b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:08.009423 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186a20d-510e-466b-a836-66bb11e0c4b4 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:08.030361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 310/618] 10.222.0.44 () {56 vars in 1135 bytes} [Tue Jul 19 15:19:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:08.035952 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186a20d-510e-466b-a836-66bb11e0c4b4 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:08.077211 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c1712-5c69-4b66-b33b-9b822479edb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:08.077909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c1712-5c69-4b66-b33b-9b822479edb1 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:08.078193 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c1712-5c69-4b66-b33b-9b822479edb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:08.078473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c1712-5c69-4b66-b33b-9b822479edb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:08.079252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c1712-5c69-4b66-b33b-9b822479edb1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:08.079571 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c1712-5c69-4b66-b33b-9b822479edb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:08.081058 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c1712-5c69-4b66-b33b-9b822479edb1 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:08.102054 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 309/619] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 19 15:19:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:08.107688 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c1712-5c69-4b66-b33b-9b822479edb1 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:08.157543 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:08.159341 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186a20d-510e-466b-a836-66bb11e0c4b4 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:08.208173 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e1d36-b78f-4e70-b213-5d9abfd89698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:08.209832 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e1d36-b78f-4e70-b213-5d9abfd89698 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:08.210502 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e1d36-b78f-4e70-b213-5d9abfd89698 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:08.211000 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e1d36-b78f-4e70-b213-5d9abfd89698 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:08.232216 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e1d36-b78f-4e70-b213-5d9abfd89698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:08.233791 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e1d36-b78f-4e70-b213-5d9abfd89698 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:08.264598 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-af7e1d36-b78f-4e70-b213-5d9abfd89698 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:08.264598 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:08.264598 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:08.264598 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:08.264598 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:08.264598 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:08.264598 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:08.264598 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:08.264598 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:08.264598 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:08.264598 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:08.264598 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:08.264598 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:08.264598 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:08.264598 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:08.265597 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:08.265597 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:08.265597 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:08.265597 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:08.265597 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:08.265597 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:08.265597 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:08.265597 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:08.265597 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:08.265597 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:08.265597 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:08.265597 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:08.265597 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:08.265597 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:08.265597 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:08.265597 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:08.265597 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:08.266608 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:08.266608 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:08.266608 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:08.266608 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:08.266608 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 311/620] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:19:08.276298 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e1d36-b78f-4e70-b213-5d9abfd89698 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:08.302907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c1712-5c69-4b66-b33b-9b822479edb1 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:08.324794 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:08.352101 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a791aaa-8a83-4e96-8d1d-8999981759dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:08.353257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a791aaa-8a83-4e96-8d1d-8999981759dc None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:08.353711 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a791aaa-8a83-4e96-8d1d-8999981759dc None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:08.354202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a791aaa-8a83-4e96-8d1d-8999981759dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:08.372193 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a791aaa-8a83-4e96-8d1d-8999981759dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:08.374020 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a791aaa-8a83-4e96-8d1d-8999981759dc None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:08.399623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-3a791aaa-8a83-4e96-8d1d-8999981759dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:08.399623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:08.399623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:08.399623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:08.399623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:08.399623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:08.399623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:08.399623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:08.399623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:08.399623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:08.399623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:08.399623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:08.399623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:08.399623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:08.399623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:08.400717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:08.400717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:08.400717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:08.400717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:08.400717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:08.400717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:08.400717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:08.400717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:08.400717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:08.400717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:08.400717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:08.400717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:08.400717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:08.400717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:08.400717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:08.400717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:08.400717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:08.401693 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:08.401693 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:08.401693 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:08.401693 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:08.404179 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 310/621] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:19:08.406823 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e561c92-3331-450c-8b95-691c239579f2 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:08.407337 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e561c92-3331-450c-8b95-691c239579f2 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:08.407784 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e561c92-3331-450c-8b95-691c239579f2 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:08.409661 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 311/622] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:08.411204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e561c92-3331-450c-8b95-691c239579f2 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:08.459762 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e1d36-b78f-4e70-b213-5d9abfd89698 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:08.507786 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa93d4-f509-4924-bf5b-2be5a9496c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:08.509707 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa93d4-f509-4924-bf5b-2be5a9496c47 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:08.510304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa93d4-f509-4924-bf5b-2be5a9496c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:08.511342 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa93d4-f509-4924-bf5b-2be5a9496c47 None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:08.512955 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa93d4-f509-4924-bf5b-2be5a9496c47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:08.514041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa93d4-f509-4924-bf5b-2be5a9496c47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:08.516821 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa93d4-f509-4924-bf5b-2be5a9496c47 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:08.540774 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 312/623] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:08.544732 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d4858-85d8-4c17-9fce-a276b7bf05fb None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:08.545966 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d4858-85d8-4c17-9fce-a276b7bf05fb None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:08.546663 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d4858-85d8-4c17-9fce-a276b7bf05fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:08.569878 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-5c5d4858-85d8-4c17-9fce-a276b7bf05fb None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:08.571651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-5c5d4858-85d8-4c17-9fce-a276b7bf05fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:08.578022 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:08.617185 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e561c92-3331-450c-8b95-691c239579f2 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:08.673534 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 313/624] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:19:08.675291 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d4858-85d8-4c17-9fce-a276b7bf05fb None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:08.687537 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27729df-6b6a-45db-b8f9-51bb5f4581e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:08.688350 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27729df-6b6a-45db-b8f9-51bb5f4581e7 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:08.688705 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27729df-6b6a-45db-b8f9-51bb5f4581e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:08.689049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27729df-6b6a-45db-b8f9-51bb5f4581e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:08.689989 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27729df-6b6a-45db-b8f9-51bb5f4581e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:08.690365 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27729df-6b6a-45db-b8f9-51bb5f4581e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:08.692018 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27729df-6b6a-45db-b8f9-51bb5f4581e7 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:08.700778 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:08.721063 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 312/625] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:08.722752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27729df-6b6a-45db-b8f9-51bb5f4581e7 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:08.918367 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d4858-85d8-4c17-9fce-a276b7bf05fb None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:08.932829 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27729df-6b6a-45db-b8f9-51bb5f4581e7 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:08.977988 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d7b5e-0cbb-4b45-961d-3229c04852ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:08.978905 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d7b5e-0cbb-4b45-961d-3229c04852ea None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:08.979280 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d7b5e-0cbb-4b45-961d-3229c04852ea None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:08.980681 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d7b5e-0cbb-4b45-961d-3229c04852ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:08.995358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d7b5e-0cbb-4b45-961d-3229c04852ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:08.997278 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d7b5e-0cbb-4b45-961d-3229c04852ea None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:09.019609 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-d16d7b5e-0cbb-4b45-961d-3229c04852ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:09.019609 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:09.019609 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:09.019609 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:09.019609 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:09.019609 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:09.019609 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:09.019609 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:09.019609 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:09.019609 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:09.019609 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:09.019609 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:09.019609 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:19:09.019609 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:19:09.019609 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:19:09.021255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:19:09.021255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:09.021255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:09.021255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:09.021255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:09.021255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:09.021255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:09.021255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:09.021255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:09.021255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:09.021255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:09.021255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:09.021255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:09.021255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:09.021255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:09.021255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:09.021255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:09.022329 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:19:09.022329 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:19:09.022329 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:19:09.022329 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:19:09.022329 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:19:09.022329 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:19:09.022329 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:09.022329 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:09.025905 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 314/626] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:19:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:09.026901 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d7b5e-0cbb-4b45-961d-3229c04852ea None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:09.041569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9761586-32e6-41ca-a0b7-1297ef71c114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:09.044348 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9761586-32e6-41ca-a0b7-1297ef71c114 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:09.047082 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9761586-32e6-41ca-a0b7-1297ef71c114 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:09.048615 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9761586-32e6-41ca-a0b7-1297ef71c114 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:09.101554 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9761586-32e6-41ca-a0b7-1297ef71c114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:19:09.137158 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:09.139802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-b9761586-32e6-41ca-a0b7-1297ef71c114 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:19:09.139802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:09.139802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:09.139802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:09.139802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:09.139802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:09.139802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:09.139802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:09.139802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:09.139802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:09.139802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:09.139802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:09.139802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:19:09.139802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:19:09.139802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:19:09.139802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:19:09.141930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:19:09.141930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:19:09.141930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:19:09.141930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:19:09.141930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:09.141930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:09.141930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:09.141930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:09.141930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:09.141930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:09.141930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:09.141930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:09.141930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:09.141930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:09.141930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:09.141930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:09.143277 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:09.143277 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:09.143277 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:09.143277 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:09.143277 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:19:09.143277 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:19:09.143277 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:19:09.143277 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:19:09.143277 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:19:09.143277 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:19:09.143277 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:19:09.143277 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:09.150135 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 313/627] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 19 15:19:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:09.152026 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9761586-32e6-41ca-a0b7-1297ef71c114 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:09.158306 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:09.178688 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d7b5e-0cbb-4b45-961d-3229c04852ea None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:09.289353 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9761586-32e6-41ca-a0b7-1297ef71c114 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:09.293028 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9727d68-6a23-4703-b093-a85648b7fa61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:09.294396 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9727d68-6a23-4703-b093-a85648b7fa61 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:09.294900 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9727d68-6a23-4703-b093-a85648b7fa61 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:09.295427 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9727d68-6a23-4703-b093-a85648b7fa61 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:09.308231 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9727d68-6a23-4703-b093-a85648b7fa61 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:09.310121 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9727d68-6a23-4703-b093-a85648b7fa61 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:09.327389 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41580b54-a07d-4a3f-b9cf-d2e657c1e753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:09.328057 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41580b54-a07d-4a3f-b9cf-d2e657c1e753 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:09.328342 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41580b54-a07d-4a3f-b9cf-d2e657c1e753 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:09.328620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41580b54-a07d-4a3f-b9cf-d2e657c1e753 None admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:09.329410 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41580b54-a07d-4a3f-b9cf-d2e657c1e753 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:09.329722 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41580b54-a07d-4a3f-b9cf-d2e657c1e753 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:09.331134 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41580b54-a07d-4a3f-b9cf-d2e657c1e753 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:09.334559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-c9727d68-6a23-4703-b093-a85648b7fa61 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:19:09.334559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:09.334559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:09.334559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:09.334559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:09.334559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:09.334559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:09.334559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:09.334559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:09.334559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:09.334559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:09.334559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:09.334559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:19:09.334559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:19:09.334559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:19:09.334559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:19:09.335568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:09.335568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:09.335568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:19:09.335568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:09.335568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:19:09.335568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:09.335568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:09.335568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:09.335568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:09.335568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:09.335568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:09.335568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:09.335568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:09.335568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:09.335568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:09.335568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:09.335568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:09.335568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:09.336563 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:09.336563 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:09.336563 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:19:09.336563 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:19:09.336563 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:19:09.336563 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:19:09.336563 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:19:09.336563 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:19:09.336563 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:19:09.336563 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:09.340151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 315/628] 10.222.0.44 () {56 vars in 1093 bytes} [Tue Jul 19 15:19:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:09.341277 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9727d68-6a23-4703-b093-a85648b7fa61 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:09.351436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 314/629] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:19:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:09.352525 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41580b54-a07d-4a3f-b9cf-d2e657c1e753 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:09.430075 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:09.477109 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9727d68-6a23-4703-b093-a85648b7fa61 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:09.483294 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41580b54-a07d-4a3f-b9cf-d2e657c1e753 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:09.511076 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:09.527024 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6dfd25-0267-4531-b74b-35d807c2d0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:09.527840 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dfd25-0267-4531-b74b-35d807c2d0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:09.528123 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dfd25-0267-4531-b74b-35d807c2d0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:09.528398 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dfd25-0267-4531-b74b-35d807c2d0a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:09.529150 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6dfd25-0267-4531-b74b-35d807c2d0a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:09.529463 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6dfd25-0267-4531-b74b-35d807c2d0a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:09.531089 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6dfd25-0267-4531-b74b-35d807c2d0a1 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:09.547251 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71aa5a9-a71c-4eab-9e61-073b2d8a4de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:09.547455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 316/630] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 19 15:19:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:09.547539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71aa5a9-a71c-4eab-9e61-073b2d8a4de5 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:09.547539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71aa5a9-a71c-4eab-9e61-073b2d8a4de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:09.547539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71aa5a9-a71c-4eab-9e61-073b2d8a4de5 None admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:09.547772 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6dfd25-0267-4531-b74b-35d807c2d0a1 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:09.547851 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71aa5a9-a71c-4eab-9e61-073b2d8a4de5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:09.547851 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71aa5a9-a71c-4eab-9e61-073b2d8a4de5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:09.547851 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71aa5a9-a71c-4eab-9e61-073b2d8a4de5 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:09.571339 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 315/631] 10.222.0.44 () {56 vars in 1133 bytes} [Tue Jul 19 15:19:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:09.572516 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71aa5a9-a71c-4eab-9e61-073b2d8a4de5 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:09.652145 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6dfd25-0267-4531-b74b-35d807c2d0a1 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:09.687931 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71aa5a9-a71c-4eab-9e61-073b2d8a4de5 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:09.692314 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b16e6-5e41-4333-a4a0-e81015efc494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:09.693208 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b16e6-5e41-4333-a4a0-e81015efc494 None admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:09.693493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b16e6-5e41-4333-a4a0-e81015efc494 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:09.693773 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b16e6-5e41-4333-a4a0-e81015efc494 None admin] PATH_INFO: `/v3/projects/c54934775a86487295bdbc02ed3a0103/users/bd1dceaddb6e414faef0e0448cdf1be8/roles/1ff62289fb434d09a13001c3ffbab080` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:09.709162 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b16e6-5e41-4333-a4a0-e81015efc494 None admin] RBAC: Authorizing `identity:create_grant(project_id=c54934775a86487295bdbc02ed3a0103, user_id=bd1dceaddb6e414faef0e0448cdf1be8, role_id=1ff62289fb434d09a13001c3ffbab080)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:09.710608 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b16e6-5e41-4333-a4a0-e81015efc494 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:09.711096 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:09.725594 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 317/632] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 19 15:19:09 2022] PUT /identity/v3/projects/c54934775a86487295bdbc02ed3a0103/users/bd1dceaddb6e414faef0e0448cdf1be8/roles/1ff62289fb434d09a13001c3ffbab080 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:19:09.726730 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b16e6-5e41-4333-a4a0-e81015efc494 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:09.737697 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2cdd55-4c65-4dfe-af62-72df6a775979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:09.738983 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2cdd55-4c65-4dfe-af62-72df6a775979 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:09.739593 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2cdd55-4c65-4dfe-af62-72df6a775979 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:09.740197 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2cdd55-4c65-4dfe-af62-72df6a775979 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:09.758974 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2cdd55-4c65-4dfe-af62-72df6a775979 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:09.762646 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2cdd55-4c65-4dfe-af62-72df6a775979 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:09.798423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-2f2cdd55-4c65-4dfe-af62-72df6a775979 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:09.798423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:09.798423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:09.798423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:09.798423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:09.798423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:09.798423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:09.798423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:09.798423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:09.798423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:09.798423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:09.798423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:09.798423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:09.798423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:09.798423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:09.800548 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:09.800548 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:09.800548 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:09.800548 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:09.800548 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:09.800548 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:09.800548 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:09.800548 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:09.800548 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:09.800548 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:09.800548 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:09.800548 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:09.800548 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:09.800548 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:09.800548 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:09.800548 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:09.800548 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:09.802890 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:09.802890 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:09.802890 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:09.802890 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:09.810678 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 316/633] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:09.813881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6491ff6-3e05-4a49-bc44-1fb45f94062c None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:09.814776 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6491ff6-3e05-4a49-bc44-1fb45f94062c None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:09.815988 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6491ff6-3e05-4a49-bc44-1fb45f94062c None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:09.819608 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 317/634] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:09.821406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6491ff6-3e05-4a49-bc44-1fb45f94062c None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:09.851278 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:09.912869 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b16e6-5e41-4333-a4a0-e81015efc494 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:09.955353 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bf708-010a-43aa-bdb5-6373aa05435a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:09.956142 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bf708-010a-43aa-bdb5-6373aa05435a None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:09.956499 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bf708-010a-43aa-bdb5-6373aa05435a None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:09.956792 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bf708-010a-43aa-bdb5-6373aa05435a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:09.982869 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6491ff6-3e05-4a49-bc44-1fb45f94062c None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:10.019795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ec1d7-5c3d-450c-a689-80efe333931f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:10.020460 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ec1d7-5c3d-450c-a689-80efe333931f None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:10.020745 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ec1d7-5c3d-450c-a689-80efe333931f None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:10.021018 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ec1d7-5c3d-450c-a689-80efe333931f None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:10.021740 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ec1d7-5c3d-450c-a689-80efe333931f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:10.022049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ec1d7-5c3d-450c-a689-80efe333931f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:10.023434 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ec1d7-5c3d-450c-a689-80efe333931f None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:10.039474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 318/635] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:10.039474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd47829-7a04-4099-86c8-217a5aa22808 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:10.039474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd47829-7a04-4099-86c8-217a5aa22808 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:10.039474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd47829-7a04-4099-86c8-217a5aa22808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:10.040705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989bf708-010a-43aa-bdb5-6373aa05435a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:10.042169 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989bf708-010a-43aa-bdb5-6373aa05435a None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:10.057046 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-dbd47829-7a04-4099-86c8-217a5aa22808 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:10.058200 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-dbd47829-7a04-4099-86c8-217a5aa22808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:10.086225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:10.093151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:10.133210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 319/636] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:19:10.134943 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b35892-686b-4f5e-b05d-7d7dd8bda68a None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:10.135257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b35892-686b-4f5e-b05d-7d7dd8bda68a None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:10.135542 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b35892-686b-4f5e-b05d-7d7dd8bda68a None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:10.136941 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 320/637] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:10.137494 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b35892-686b-4f5e-b05d-7d7dd8bda68a None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:10.165993 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 318/638] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:19:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:19:10.167390 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c9c42-b962-4467-a36b-a98de026f4e0 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:10.167679 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c9c42-b962-4467-a36b-a98de026f4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:10.167958 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c9c42-b962-4467-a36b-a98de026f4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:10.187430 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-c64c9c42-b962-4467-a36b-a98de026f4e0 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:10.188759 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-c64c9c42-b962-4467-a36b-a98de026f4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:10.251713 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b35892-686b-4f5e-b05d-7d7dd8bda68a None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:10.274126 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 319/639] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:19:10.274126 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c9c42-b962-4467-a36b-a98de026f4e0 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:10.292855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c7b2a-1e88-49e6-a72e-21ece0da41a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:10.293648 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c7b2a-1e88-49e6-a72e-21ece0da41a4 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:10.293936 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c7b2a-1e88-49e6-a72e-21ece0da41a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:10.294221 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c7b2a-1e88-49e6-a72e-21ece0da41a4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:10.302013 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c7b2a-1e88-49e6-a72e-21ece0da41a4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:10.303478 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c7b2a-1e88-49e6-a72e-21ece0da41a4 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:10.319087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-e46c7b2a-1e88-49e6-a72e-21ece0da41a4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 19 15:19:10.319087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:10.319087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:10.319087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:10.319087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:10.319087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:10.319087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:10.319087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:10.319087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:10.319087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:10.319087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:10.319087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:10.319087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:19:10.319087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:19:10.319087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:19:10.319087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:19:10.320488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:10.320488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:10.320488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:19:10.320488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:10.320488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:19:10.320488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:10.320488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:10.320488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:10.320488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:10.320488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:10.320488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:10.320488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:10.320488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:10.320488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:10.320488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:10.320488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:10.320488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:10.320488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:10.321724 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:10.321724 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:10.321724 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:19:10.321724 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:19:10.321724 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:19:10.321724 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:19:10.321724 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:19:10.321724 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:19:10.321724 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 19 15:19:10.321724 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:10.321724 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 321/640] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:19:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:10.321724 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c7b2a-1e88-49e6-a72e-21ece0da41a4 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:10.347554 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:10.364394 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:10.397424 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c9c42-b962-4467-a36b-a98de026f4e0 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:10.431103 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c7b2a-1e88-49e6-a72e-21ece0da41a4 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:10.435307 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642c9e2-8bce-49c7-9f01-e69b81360791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:10.436108 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642c9e2-8bce-49c7-9f01-e69b81360791 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:10.436390 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642c9e2-8bce-49c7-9f01-e69b81360791 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:10.436669 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642c9e2-8bce-49c7-9f01-e69b81360791 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:10.448842 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642c9e2-8bce-49c7-9f01-e69b81360791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:19:10.456946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-2642c9e2-8bce-49c7-9f01-e69b81360791 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:19:10.456946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:10.456946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:10.456946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:10.456946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:10.456946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:10.456946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:10.456946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:10.456946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:10.456946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:10.456946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:10.456946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:10.456946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:19:10.456946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:19:10.456946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:19:10.456946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:19:10.457988 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:19:10.457988 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:19:10.457988 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:19:10.457988 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:19:10.457988 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:10.457988 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:10.457988 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:10.457988 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:10.457988 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:10.457988 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:10.457988 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:10.457988 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:10.457988 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:10.457988 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:10.457988 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:10.457988 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:10.458822 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:10.458822 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:10.458822 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:10.458822 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:10.458822 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:19:10.458822 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:19:10.458822 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:19:10.458822 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:19:10.458822 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:19:10.458822 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:19:10.458822 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:19:10.458822 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:10.458822 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 320/641] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 19 15:19:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:10.459555 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642c9e2-8bce-49c7-9f01-e69b81360791 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:10.470782 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b640a-bad1-4acb-a5d6-ec697f6bed6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:10.471696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b640a-bad1-4acb-a5d6-ec697f6bed6f None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:10.472050 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b640a-bad1-4acb-a5d6-ec697f6bed6f None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:10.472396 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b640a-bad1-4acb-a5d6-ec697f6bed6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:10.483547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b640a-bad1-4acb-a5d6-ec697f6bed6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:10.485096 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b640a-bad1-4acb-a5d6-ec697f6bed6f None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:10.504895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-0b2b640a-bad1-4acb-a5d6-ec697f6bed6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:10.504895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:10.504895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:10.504895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:10.504895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:10.504895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:10.504895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:10.504895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:10.504895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:10.504895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:10.504895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:10.504895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:10.504895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:10.504895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:10.504895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:10.506290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:10.506290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:10.506290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:10.506290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:10.506290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:10.506290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:10.506290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:10.506290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:10.506290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:10.506290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:10.506290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:10.506290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:10.506290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:10.506290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:10.506290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:10.506290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:10.506290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:10.507614 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:10.507614 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:10.507614 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:10.507614 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:10.511416 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 322/642] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:10.512285 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b640a-bad1-4acb-a5d6-ec697f6bed6f None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:10.593983 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642c9e2-8bce-49c7-9f01-e69b81360791 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:10.596425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:10.623711 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b640a-bad1-4acb-a5d6-ec697f6bed6f None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:10.627455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:10.635369 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adff95-4d37-4249-84b6-e7d7d4cb1296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:10.636282 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adff95-4d37-4249-84b6-e7d7d4cb1296 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:10.636666 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adff95-4d37-4249-84b6-e7d7d4cb1296 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:10.637091 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adff95-4d37-4249-84b6-e7d7d4cb1296 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:10.649109 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21adff95-4d37-4249-84b6-e7d7d4cb1296 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:19:10.657903 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-21adff95-4d37-4249-84b6-e7d7d4cb1296 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:19:10.657903 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:10.657903 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:10.657903 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:10.657903 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:10.657903 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:10.657903 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:10.657903 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:10.657903 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:10.657903 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:10.657903 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:10.657903 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:10.657903 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:19:10.657903 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:19:10.657903 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:19:10.657903 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:19:10.659151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:19:10.659151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:19:10.659151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:19:10.659151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:19:10.659151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:10.659151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:10.659151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:10.659151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:10.659151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:10.659151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:10.659151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:10.659151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:10.659151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:10.659151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:10.659151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:10.659151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:10.660104 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:10.660104 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:10.660104 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:10.660104 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:10.660104 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:19:10.660104 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:19:10.660104 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:19:10.660104 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:19:10.660104 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:19:10.660104 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:19:10.660104 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:19:10.660104 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:10.663376 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 321/643] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 19 15:19:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:10.664219 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adff95-4d37-4249-84b6-e7d7d4cb1296 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:10.667331 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd317d95-ee3f-4c64-9e01-cdc493077ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:10.667608 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd317d95-ee3f-4c64-9e01-cdc493077ffa None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:10.667890 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd317d95-ee3f-4c64-9e01-cdc493077ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:10.668170 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd317d95-ee3f-4c64-9e01-cdc493077ffa None admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:10.669029 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd317d95-ee3f-4c64-9e01-cdc493077ffa None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:10.669348 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd317d95-ee3f-4c64-9e01-cdc493077ffa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:10.670778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd317d95-ee3f-4c64-9e01-cdc493077ffa None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:10.690176 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 323/644] 10.222.0.44 () {56 vars in 1137 bytes} [Tue Jul 19 15:19:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:10.690831 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd317d95-ee3f-4c64-9e01-cdc493077ffa None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:10.775028 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adff95-4d37-4249-84b6-e7d7d4cb1296 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:10.799481 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd317d95-ee3f-4c64-9e01-cdc493077ffa None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:10.811162 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b1916-24ba-4022-b17a-2646da288672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:10.811980 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b1916-24ba-4022-b17a-2646da288672 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:10.812358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b1916-24ba-4022-b17a-2646da288672 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:10.812731 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b1916-24ba-4022-b17a-2646da288672 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:10.813572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b1916-24ba-4022-b17a-2646da288672 None admin] RBAC: Adding query filter params (name=service) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:10.813981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b1916-24ba-4022-b17a-2646da288672 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:10.815559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b1916-24ba-4022-b17a-2646da288672 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:10.824622 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 322/645] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 19 15:19:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:10.825434 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b1916-24ba-4022-b17a-2646da288672 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:10.842441 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:10.849472 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d785cb-2519-4925-a780-79c481a8a026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:10.850148 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d785cb-2519-4925-a780-79c481a8a026 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:10.850693 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d785cb-2519-4925-a780-79c481a8a026 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:10.850809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d785cb-2519-4925-a780-79c481a8a026 None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:10.853757 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d785cb-2519-4925-a780-79c481a8a026 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:10.853757 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d785cb-2519-4925-a780-79c481a8a026 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:10.853757 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d785cb-2519-4925-a780-79c481a8a026 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:10.865758 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 324/646] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:10.870866 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d785cb-2519-4925-a780-79c481a8a026 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:10.894216 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:10.955522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b1916-24ba-4022-b17a-2646da288672 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:10.981457 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d785cb-2519-4925-a780-79c481a8a026 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:10.996474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f665370-0260-4314-999e-8b1b2eae0788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:10.997354 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f665370-0260-4314-999e-8b1b2eae0788 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:10.997798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f665370-0260-4314-999e-8b1b2eae0788 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:10.998227 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f665370-0260-4314-999e-8b1b2eae0788 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:10.999106 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f665370-0260-4314-999e-8b1b2eae0788 None admin] RBAC: Adding query filter params (name=service) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:10.999598 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f665370-0260-4314-999e-8b1b2eae0788 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:11.001095 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f665370-0260-4314-999e-8b1b2eae0788 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:11.010179 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 323/647] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 19 15:19:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:11.011165 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f665370-0260-4314-999e-8b1b2eae0788 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:11.020881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd3657-6835-4a03-bbfa-a48464e03c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:11.021540 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd3657-6835-4a03-bbfa-a48464e03c8d None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:11.021830 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd3657-6835-4a03-bbfa-a48464e03c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:11.022113 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd3657-6835-4a03-bbfa-a48464e03c8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:11.086776 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:11.096621 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd3657-6835-4a03-bbfa-a48464e03c8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:11.098097 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd3657-6835-4a03-bbfa-a48464e03c8d None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:11.130604 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f665370-0260-4314-999e-8b1b2eae0788 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:11.146216 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:11.168809 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59927940-cf9c-43e9-bfcb-beedecc3df40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:11.169597 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59927940-cf9c-43e9-bfcb-beedecc3df40 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:11.169880 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59927940-cf9c-43e9-bfcb-beedecc3df40 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:11.170154 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59927940-cf9c-43e9-bfcb-beedecc3df40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:11.181378 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59927940-cf9c-43e9-bfcb-beedecc3df40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:11.182816 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59927940-cf9c-43e9-bfcb-beedecc3df40 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:11.199755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-59927940-cf9c-43e9-bfcb-beedecc3df40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:11.199755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:11.199755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:11.199755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:11.199755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:11.199755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:11.199755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:11.199755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:11.199755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:11.199755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:11.199755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:11.199755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:11.199755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:11.199755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:11.199755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:11.200644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:11.200644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:11.200644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:11.200644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:11.200644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:11.200644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:11.200644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:11.200644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:11.200644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:11.200644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:11.200644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:11.200644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:11.200644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:11.200644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:11.200644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:11.200644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:11.200644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:11.201569 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:11.201569 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:11.201569 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:11.201569 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:11.201569 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 324/648] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:11.201850 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59927940-cf9c-43e9-bfcb-beedecc3df40 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:11.208485 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 325/649] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:19:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:19:11.209559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd3657-6835-4a03-bbfa-a48464e03c8d None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:11.313612 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:11.316986 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59927940-cf9c-43e9-bfcb-beedecc3df40 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:11.325085 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd3657-6835-4a03-bbfa-a48464e03c8d None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:11.357409 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da2943-b7c0-4965-b768-c0be19a1e938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:11.358123 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da2943-b7c0-4965-b768-c0be19a1e938 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:11.358418 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da2943-b7c0-4965-b768-c0be19a1e938 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:11.358681 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da2943-b7c0-4965-b768-c0be19a1e938 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:11.362672 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731aa841-35cc-437c-8d34-cea50c56577f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:11.363949 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731aa841-35cc-437c-8d34-cea50c56577f None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:11.364560 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731aa841-35cc-437c-8d34-cea50c56577f None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:11.365201 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731aa841-35cc-437c-8d34-cea50c56577f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:11.366195 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da2943-b7c0-4965-b768-c0be19a1e938 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:11.367659 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da2943-b7c0-4965-b768-c0be19a1e938 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:11.378318 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731aa841-35cc-437c-8d34-cea50c56577f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:11.380621 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731aa841-35cc-437c-8d34-cea50c56577f None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:11.383807 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-68da2943-b7c0-4965-b768-c0be19a1e938 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:11.383807 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:11.383807 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:11.383807 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:11.383807 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:11.383807 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:11.383807 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:11.383807 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:11.383807 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:11.383807 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:11.383807 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:11.383807 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:11.383807 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:19:11.383807 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:19:11.383807 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:19:11.384706 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:19:11.384706 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:11.384706 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:11.384706 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:11.384706 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:11.384706 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:11.384706 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:11.384706 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:11.384706 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:11.384706 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:11.384706 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:11.384706 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:11.384706 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:11.384706 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:11.384706 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:11.384706 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:11.384706 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:11.385592 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:19:11.385592 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:19:11.385592 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:19:11.385592 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:19:11.385592 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:19:11.385592 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:19:11.385592 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:11.385592 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:11.385592 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 325/650] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:19:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:11.386077 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da2943-b7c0-4965-b768-c0be19a1e938 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:11.403819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-731aa841-35cc-437c-8d34-cea50c56577f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:11.403819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:11.403819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:11.403819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:11.403819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:11.403819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:11.403819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:11.403819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:11.403819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:11.403819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:11.403819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:11.403819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:11.403819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:11.403819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:11.403819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:11.404792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:11.404792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:11.404792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:11.404792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:11.404792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:11.404792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:11.404792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:11.404792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:11.404792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:11.404792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:11.404792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:11.404792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:11.404792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:11.404792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:11.404792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:11.404792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:11.404792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:11.405956 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:11.405956 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:11.405956 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:11.405956 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:11.407904 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 326/651] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:11.408706 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731aa841-35cc-437c-8d34-cea50c56577f None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:11.421321 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:11.510610 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da2943-b7c0-4965-b768-c0be19a1e938 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:11.533005 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731aa841-35cc-437c-8d34-cea50c56577f None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:11.552019 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e810e-3277-4b51-8158-24c76aba83c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:11.552685 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e810e-3277-4b51-8158-24c76aba83c8 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:11.552971 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e810e-3277-4b51-8158-24c76aba83c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:11.553247 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e810e-3277-4b51-8158-24c76aba83c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:11.553983 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9e810e-3277-4b51-8158-24c76aba83c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:11.554291 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9e810e-3277-4b51-8158-24c76aba83c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:11.555690 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9e810e-3277-4b51-8158-24c76aba83c8 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:11.573505 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 326/652] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:11.573730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c008c2-7071-4d9c-9d31-19224831a1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:11.573730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c008c2-7071-4d9c-9d31-19224831a1e7 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:11.573916 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e810e-3277-4b51-8158-24c76aba83c8 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:11.574000 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c008c2-7071-4d9c-9d31-19224831a1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:11.574000 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c008c2-7071-4d9c-9d31-19224831a1e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:11.583018 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c008c2-7071-4d9c-9d31-19224831a1e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:11.584494 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c008c2-7071-4d9c-9d31-19224831a1e7 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:11.587053 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:11.602867 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-e1c008c2-7071-4d9c-9d31-19224831a1e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:11.602867 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:11.602867 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:11.602867 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:11.602867 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:11.602867 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:11.602867 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:11.602867 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:11.602867 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:11.602867 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:11.602867 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:11.602867 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:11.602867 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:11.602867 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:11.602867 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:11.603937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:11.603937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:11.603937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:11.603937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:11.603937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:11.603937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:11.603937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:11.603937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:11.603937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:11.603937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:11.603937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:11.603937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:11.603937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:11.603937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:11.603937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:11.603937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:11.603937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:11.604818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:11.604818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:11.604818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:11.604818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:11.604818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 327/653] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:11.605639 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c008c2-7071-4d9c-9d31-19224831a1e7 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:11.672279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:11.691020 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e810e-3277-4b51-8158-24c76aba83c8 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:11.716646 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c008c2-7071-4d9c-9d31-19224831a1e7 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:11.729926 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824bff7-5a7b-4d47-8f86-3e31a24275fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:11.730598 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824bff7-5a7b-4d47-8f86-3e31a24275fd None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:11.730882 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824bff7-5a7b-4d47-8f86-3e31a24275fd None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:11.731146 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824bff7-5a7b-4d47-8f86-3e31a24275fd None admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:11.731978 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824bff7-5a7b-4d47-8f86-3e31a24275fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:11.732278 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824bff7-5a7b-4d47-8f86-3e31a24275fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:11.733692 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824bff7-5a7b-4d47-8f86-3e31a24275fd None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:11.747392 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 327/654] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:19:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:11.748347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824bff7-5a7b-4d47-8f86-3e31a24275fd None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:11.759993 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415dad4-cc1c-43f6-8e19-8e343a8aa61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:11.760674 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415dad4-cc1c-43f6-8e19-8e343a8aa61e None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:11.760967 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415dad4-cc1c-43f6-8e19-8e343a8aa61e None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:11.761512 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415dad4-cc1c-43f6-8e19-8e343a8aa61e None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:11.761982 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415dad4-cc1c-43f6-8e19-8e343a8aa61e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:11.762296 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415dad4-cc1c-43f6-8e19-8e343a8aa61e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:11.763793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415dad4-cc1c-43f6-8e19-8e343a8aa61e None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:11.776413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 328/655] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:11.777070 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415dad4-cc1c-43f6-8e19-8e343a8aa61e None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:11.835376 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:11.863946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824bff7-5a7b-4d47-8f86-3e31a24275fd None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:11.885914 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415dad4-cc1c-43f6-8e19-8e343a8aa61e None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:11.898200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde40ca-4591-4b0a-b707-514d95aa58c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:11.898981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde40ca-4591-4b0a-b707-514d95aa58c9 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:11.899293 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde40ca-4591-4b0a-b707-514d95aa58c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:11.899571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde40ca-4591-4b0a-b707-514d95aa58c9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:11.907338 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde40ca-4591-4b0a-b707-514d95aa58c9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:11.908958 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde40ca-4591-4b0a-b707-514d95aa58c9 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:11.923437 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ce702-1219-4e93-b1c0-66a5dbe07d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:11.923829 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-ddde40ca-4591-4b0a-b707-514d95aa58c9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 15:19:11.923829 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:11.923829 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:11.923829 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:11.923829 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:11.923829 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:11.923829 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:11.923829 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:11.923829 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:11.923829 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:11.923829 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:11.923829 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:11.923829 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:19:11.923829 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:19:11.923829 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:19:11.923829 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:19:11.924856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:11.924856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:11.924856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:19:11.924856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:11.924856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:19:11.924856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:11.924856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:11.924856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:11.924856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:11.924856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:11.924856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:11.924856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:11.924856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:11.924856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:11.924856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:11.924856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:11.924856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:11.924856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:11.926408 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:11.926408 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:11.926408 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:19:11.926408 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:19:11.926408 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:19:11.926408 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:19:11.926408 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:19:11.926408 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:19:11.926408 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 15:19:11.926408 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:11.926953 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ce702-1219-4e93-b1c0-66a5dbe07d5b None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:11.926953 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ce702-1219-4e93-b1c0-66a5dbe07d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:11.926953 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ce702-1219-4e93-b1c0-66a5dbe07d5b None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:11.927138 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 328/656] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:19:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:11.927214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ce702-1219-4e93-b1c0-66a5dbe07d5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:11.927214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ce702-1219-4e93-b1c0-66a5dbe07d5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:11.927392 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde40ca-4591-4b0a-b707-514d95aa58c9 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:11.927575 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ce702-1219-4e93-b1c0-66a5dbe07d5b None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:11.936697 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:11.941549 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 329/657] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:11.942378 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ce702-1219-4e93-b1c0-66a5dbe07d5b None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:12.029068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde40ca-4591-4b0a-b707-514d95aa58c9 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:12.041055 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ce702-1219-4e93-b1c0-66a5dbe07d5b None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:12.057155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:12.064465 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e16657-22bd-483b-990c-eae10740cfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:12.065110 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e16657-22bd-483b-990c-eae10740cfe0 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:12.065391 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e16657-22bd-483b-990c-eae10740cfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:12.065666 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e16657-22bd-483b-990c-eae10740cfe0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:12.066519 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e16657-22bd-483b-990c-eae10740cfe0 None admin] RBAC: Adding query filter params (role.id=1ff62289fb434d09a13001c3ffbab080, scope.project.id=c54934775a86487295bdbc02ed3a0103, user.id=fef0511f56144ca9945b2dddfa2601a2) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:12.066834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e16657-22bd-483b-990c-eae10740cfe0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:12.068274 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e16657-22bd-483b-990c-eae10740cfe0 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:12.073967 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 329/658] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:19:11 2022] GET /identity/v3/role_assignments?user.id=fef0511f56144ca9945b2dddfa2601a2&scope.project.id=c54934775a86487295bdbc02ed3a0103&role.id=1ff62289fb434d09a13001c3ffbab080 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:12.075013 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77a0a8-463f-41e8-a36f-2610541ac986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:12.075268 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45ecf1-9734-4632-a877-5bfc2321a2ca None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:12.075556 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45ecf1-9734-4632-a877-5bfc2321a2ca None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:12.075832 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45ecf1-9734-4632-a877-5bfc2321a2ca None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:12.075927 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77a0a8-463f-41e8-a36f-2610541ac986 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:12.076125 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77a0a8-463f-41e8-a36f-2610541ac986 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:12.076408 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77a0a8-463f-41e8-a36f-2610541ac986 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:12.077564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 330/659] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:12.077747 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45ecf1-9734-4632-a877-5bfc2321a2ca None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:12.092087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77a0a8-463f-41e8-a36f-2610541ac986 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:12.093583 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77a0a8-463f-41e8-a36f-2610541ac986 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:12.110879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-1c77a0a8-463f-41e8-a36f-2610541ac986 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 15:19:12.110879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:12.110879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:12.110879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:12.110879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:12.110879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:12.110879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:12.110879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:12.110879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:12.110879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:12.110879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:12.110879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:12.110879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:19:12.110879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:19:12.110879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:19:12.110879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:19:12.112131 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:12.112131 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:12.112131 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:19:12.112131 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:12.112131 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:19:12.112131 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:12.112131 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:12.112131 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:12.112131 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:12.112131 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:12.112131 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:12.112131 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:12.112131 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:12.112131 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:12.112131 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:12.112131 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:12.112131 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:12.112131 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:12.113069 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:12.113069 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:12.113069 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:19:12.113069 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:19:12.113069 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:19:12.113069 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:19:12.113069 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:19:12.113069 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:19:12.113069 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 15:19:12.113069 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:12.115566 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 330/660] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 19 15:19:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:12.116288 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77a0a8-463f-41e8-a36f-2610541ac986 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:12.166647 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:12.205495 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45ecf1-9734-4632-a877-5bfc2321a2ca None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:12.235703 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77a0a8-463f-41e8-a36f-2610541ac986 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:12.248659 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65249fe8-c3ad-4d6a-88fa-2578c531ee31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:12.249337 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65249fe8-c3ad-4d6a-88fa-2578c531ee31 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:12.249622 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65249fe8-c3ad-4d6a-88fa-2578c531ee31 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:12.249900 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65249fe8-c3ad-4d6a-88fa-2578c531ee31 None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:12.251822 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65249fe8-c3ad-4d6a-88fa-2578c531ee31 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:12.251822 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65249fe8-c3ad-4d6a-88fa-2578c531ee31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:12.253058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65249fe8-c3ad-4d6a-88fa-2578c531ee31 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:12.272566 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 331/661] 10.222.0.44 () {56 vars in 1137 bytes} [Tue Jul 19 15:19:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:12.273973 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f0df7-8f5c-4615-b013-2668e9cf046c None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:12.274274 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f0df7-8f5c-4615-b013-2668e9cf046c None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:12.274551 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f0df7-8f5c-4615-b013-2668e9cf046c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:12.280843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0467a9-1635-48cd-9e3f-54730a1bd200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:12.281743 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0467a9-1635-48cd-9e3f-54730a1bd200 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:12.282102 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0467a9-1635-48cd-9e3f-54730a1bd200 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:12.282389 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0467a9-1635-48cd-9e3f-54730a1bd200 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:12.291666 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0467a9-1635-48cd-9e3f-54730a1bd200 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:12.293458 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0467a9-1635-48cd-9e3f-54730a1bd200 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:12.294318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-321f0df7-8f5c-4615-b013-2668e9cf046c None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:12.295563 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-321f0df7-8f5c-4615-b013-2668e9cf046c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:12.311010 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-af0467a9-1635-48cd-9e3f-54730a1bd200 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:12.311010 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:12.311010 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:12.311010 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:12.311010 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:12.311010 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:12.311010 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:12.311010 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:12.311010 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:12.311010 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:12.311010 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:12.311010 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:12.311010 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:19:12.311010 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:19:12.311010 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:19:12.312100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:19:12.312100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:12.312100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:12.312100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:12.312100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:12.312100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:12.312100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:12.312100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:12.312100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:12.312100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:12.312100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:12.312100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:12.312100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:12.312100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:12.312100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:12.312100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:12.312100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:12.313002 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:19:12.313002 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:19:12.313002 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:19:12.313002 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:19:12.313002 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:19:12.313002 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:19:12.313002 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:12.313002 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:12.313002 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 331/662] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:19:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:12.313002 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0467a9-1635-48cd-9e3f-54730a1bd200 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:12.348336 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:12.379366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 332/663] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:19:12.381327 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f0df7-8f5c-4615-b013-2668e9cf046c None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:12.427620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0467a9-1635-48cd-9e3f-54730a1bd200 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:12.453306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:12.467589 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343d627-7d67-4398-896f-4dd5cad020b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:12.468188 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343d627-7d67-4398-896f-4dd5cad020b5 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:12.468468 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343d627-7d67-4398-896f-4dd5cad020b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:12.468744 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343d627-7d67-4398-896f-4dd5cad020b5 None admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:12.469590 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f343d627-7d67-4398-896f-4dd5cad020b5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:12.469898 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f343d627-7d67-4398-896f-4dd5cad020b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:12.471326 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f343d627-7d67-4398-896f-4dd5cad020b5 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:12.489156 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 332/664] 10.222.0.44 () {56 vars in 1139 bytes} [Tue Jul 19 15:19:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:12.490256 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343d627-7d67-4398-896f-4dd5cad020b5 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:12.506458 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f0df7-8f5c-4615-b013-2668e9cf046c None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:12.544620 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727a9f9-143d-46bd-a579-5337ceca6c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:12.545318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727a9f9-143d-46bd-a579-5337ceca6c54 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:12.545609 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727a9f9-143d-46bd-a579-5337ceca6c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:12.545891 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727a9f9-143d-46bd-a579-5337ceca6c54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:12.594871 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:12.604540 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343d627-7d67-4398-896f-4dd5cad020b5 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:12.621472 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727a9f9-143d-46bd-a579-5337ceca6c54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:12.622935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727a9f9-143d-46bd-a579-5337ceca6c54 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:12.640829 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de198b-28ec-4e20-86f0-d363ac56e633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:12.641499 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de198b-28ec-4e20-86f0-d363ac56e633 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:12.641788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de198b-28ec-4e20-86f0-d363ac56e633 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:12.642070 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de198b-28ec-4e20-86f0-d363ac56e633 None admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:12.642864 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de198b-28ec-4e20-86f0-d363ac56e633 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:12.643180 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de198b-28ec-4e20-86f0-d363ac56e633 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:12.644658 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de198b-28ec-4e20-86f0-d363ac56e633 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:12.659274 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 333/665] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:19:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:12.659274 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de198b-28ec-4e20-86f0-d363ac56e633 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:12.688506 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:12.735743 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 333/666] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:19:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:19:12.737648 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727a9f9-143d-46bd-a579-5337ceca6c54 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:12.774623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de198b-28ec-4e20-86f0-d363ac56e633 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:12.809695 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac457d-7b0d-4b00-aea9-b3866da0fa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:12.810494 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac457d-7b0d-4b00-aea9-b3866da0fa46 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:12.810782 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac457d-7b0d-4b00-aea9-b3866da0fa46 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:12.811067 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac457d-7b0d-4b00-aea9-b3866da0fa46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:12.821310 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac457d-7b0d-4b00-aea9-b3866da0fa46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:19:12.829184 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-b5ac457d-7b0d-4b00-aea9-b3866da0fa46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:19:12.829184 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:12.829184 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:12.829184 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:12.829184 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:12.829184 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:12.829184 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:12.829184 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:12.829184 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:12.829184 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:12.829184 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:12.829184 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:12.829184 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:19:12.829184 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:19:12.829184 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:19:12.829184 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:19:12.830122 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:19:12.830122 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:19:12.830122 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:19:12.830122 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:19:12.830122 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:12.830122 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:12.830122 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:12.830122 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:12.830122 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:12.830122 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:12.830122 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:12.830122 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:12.830122 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:12.830122 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:12.830122 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:12.830122 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:12.830954 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:12.830954 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:12.830954 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:12.830954 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:12.830954 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:19:12.830954 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:19:12.830954 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:19:12.830954 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:19:12.830954 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:19:12.830954 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:19:12.830954 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:19:12.830954 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:12.830954 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 334/667] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 19 15:19:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:12.832425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac457d-7b0d-4b00-aea9-b3866da0fa46 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:12.855419 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:12.867008 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727a9f9-143d-46bd-a579-5337ceca6c54 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:12.908245 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d1927-5fb3-49ed-99bd-c17e34f72a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:12.909042 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d1927-5fb3-49ed-99bd-c17e34f72a87 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:12.909374 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d1927-5fb3-49ed-99bd-c17e34f72a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:12.909607 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d1927-5fb3-49ed-99bd-c17e34f72a87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:12.944594 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:12.944796 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac457d-7b0d-4b00-aea9-b3866da0fa46 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:12.984459 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de2425-3250-44b2-9531-c90343264f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:12.985436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de2425-3250-44b2-9531-c90343264f0a None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:12.985724 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de2425-3250-44b2-9531-c90343264f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:12.986061 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de2425-3250-44b2-9531-c90343264f0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:12.986845 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de2425-3250-44b2-9531-c90343264f0a None admin] RBAC: Adding query filter params (role.id=1ff62289fb434d09a13001c3ffbab080, scope.project.id=c54934775a86487295bdbc02ed3a0103, user.id=3e66abbda1744a71b4d26677dcef76be) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:12.987162 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de2425-3250-44b2-9531-c90343264f0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:12.988680 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de2425-3250-44b2-9531-c90343264f0a None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:12.991117 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d1927-5fb3-49ed-99bd-c17e34f72a87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:12.993050 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d1927-5fb3-49ed-99bd-c17e34f72a87 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:12.994675 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 335/668] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:19:12 2022] GET /identity/v3/role_assignments?user.id=3e66abbda1744a71b4d26677dcef76be&scope.project.id=c54934775a86487295bdbc02ed3a0103&role.id=1ff62289fb434d09a13001c3ffbab080 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:12.996936 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de2425-3250-44b2-9531-c90343264f0a None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:13.104029 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:13.130269 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de2425-3250-44b2-9531-c90343264f0a None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:13.135578 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 334/669] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:19:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:19:13.136755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d1927-5fb3-49ed-99bd-c17e34f72a87 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:13.185267 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed09f7b-4c0d-4edf-91e9-d6327cab7a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:13.186338 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed09f7b-4c0d-4edf-91e9-d6327cab7a4d None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:13.186658 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed09f7b-4c0d-4edf-91e9-d6327cab7a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:13.187895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed09f7b-4c0d-4edf-91e9-d6327cab7a4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:13.200366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed09f7b-4c0d-4edf-91e9-d6327cab7a4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:13.201822 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed09f7b-4c0d-4edf-91e9-d6327cab7a4d None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:13.218825 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:13.222121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-6ed09f7b-4c0d-4edf-91e9-d6327cab7a4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:13.222121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:13.222121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:13.222121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:13.222121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:13.222121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:13.222121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:13.222121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:13.222121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:13.222121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:13.222121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:13.222121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:13.222121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:13.222121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:13.222121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:13.223654 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:13.223654 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:13.223654 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:13.223654 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:13.223654 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:13.223654 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:13.223654 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:13.223654 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:13.223654 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:13.223654 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:13.223654 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:13.223654 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:13.223654 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:13.223654 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:13.223654 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:13.223654 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:13.223654 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:13.224567 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:13.224567 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:13.224567 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:13.224567 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:13.224567 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 336/670] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:13.224847 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed09f7b-4c0d-4edf-91e9-d6327cab7a4d None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:13.277727 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d1927-5fb3-49ed-99bd-c17e34f72a87 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:13.323398 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09ea70-4678-4710-88e1-797b5915d17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:13.324514 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09ea70-4678-4710-88e1-797b5915d17e None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:13.324798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09ea70-4678-4710-88e1-797b5915d17e None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:13.325392 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09ea70-4678-4710-88e1-797b5915d17e None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:13.326171 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09ea70-4678-4710-88e1-797b5915d17e None admin] RBAC: Adding query filter params (name=service) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:13.326744 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09ea70-4678-4710-88e1-797b5915d17e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:13.328911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09ea70-4678-4710-88e1-797b5915d17e None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:13.341301 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 335/671] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 19 15:19:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:13.342131 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09ea70-4678-4710-88e1-797b5915d17e None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:13.348095 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed09f7b-4c0d-4edf-91e9-d6327cab7a4d None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:13.378585 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:13.385254 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af1584-5d4a-4d24-8d08-baee8f4088e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:13.386055 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af1584-5d4a-4d24-8d08-baee8f4088e2 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:13.386342 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af1584-5d4a-4d24-8d08-baee8f4088e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:13.386620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af1584-5d4a-4d24-8d08-baee8f4088e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:13.398099 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af1584-5d4a-4d24-8d08-baee8f4088e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:13.399580 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af1584-5d4a-4d24-8d08-baee8f4088e2 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:13.417995 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-77af1584-5d4a-4d24-8d08-baee8f4088e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:13.417995 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:13.417995 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:13.417995 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:13.417995 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:13.417995 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:13.417995 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:13.417995 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:13.417995 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:13.417995 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:13.417995 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:13.417995 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:13.417995 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:13.417995 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:13.417995 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:13.420100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:13.420100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:13.420100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:13.420100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:13.420100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:13.420100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:13.420100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:13.420100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:13.420100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:13.420100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:13.420100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:13.420100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:13.420100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:13.420100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:13.420100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:13.420100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:13.420100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:13.422386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:13.422386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:13.422386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:13.422386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:13.422386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 337/672] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:13.422386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af1584-5d4a-4d24-8d08-baee8f4088e2 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:13.456175 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09ea70-4678-4710-88e1-797b5915d17e None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:13.477740 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:13.494061 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e098b-c5f7-4fc3-a718-65301cee0549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:13.494725 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e098b-c5f7-4fc3-a718-65301cee0549 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:13.495009 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e098b-c5f7-4fc3-a718-65301cee0549 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:13.495331 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e098b-c5f7-4fc3-a718-65301cee0549 None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:13.496059 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e098b-c5f7-4fc3-a718-65301cee0549 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:13.496429 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e098b-c5f7-4fc3-a718-65301cee0549 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:13.497830 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e098b-c5f7-4fc3-a718-65301cee0549 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:13.515278 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 336/673] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:13.516156 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e098b-c5f7-4fc3-a718-65301cee0549 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:13.531619 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af1584-5d4a-4d24-8d08-baee8f4088e2 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:13.568037 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66471370-a97c-4e4e-9d7c-78510347ec7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:13.568841 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66471370-a97c-4e4e-9d7c-78510347ec7d None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:13.569131 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66471370-a97c-4e4e-9d7c-78510347ec7d None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:13.569416 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66471370-a97c-4e4e-9d7c-78510347ec7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:13.580684 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66471370-a97c-4e4e-9d7c-78510347ec7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:13.582176 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66471370-a97c-4e4e-9d7c-78510347ec7d None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:13.601910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-66471370-a97c-4e4e-9d7c-78510347ec7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:13.601910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:13.601910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:13.601910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:13.601910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:13.601910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:13.601910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:13.601910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:13.601910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:13.601910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:13.601910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:13.601910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:13.601910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:13.601910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:13.601910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:13.604033 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:13.604033 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:13.604033 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:13.604033 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:13.604033 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:13.604033 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:13.604033 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:13.604033 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:13.604033 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:13.604033 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:13.604033 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:13.604033 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:13.604033 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:13.604033 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:13.604033 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:13.604033 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:13.604033 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:13.606257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:13.606257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:13.606257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:13.606257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:13.606257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 338/674] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:13.606257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66471370-a97c-4e4e-9d7c-78510347ec7d None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:13.629553 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e098b-c5f7-4fc3-a718-65301cee0549 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:13.655727 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:13.674592 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bed3a8-665f-48c6-a125-2af3db22832a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:13.675554 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bed3a8-665f-48c6-a125-2af3db22832a None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:13.675912 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bed3a8-665f-48c6-a125-2af3db22832a None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:13.676197 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bed3a8-665f-48c6-a125-2af3db22832a None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:13.676943 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bed3a8-665f-48c6-a125-2af3db22832a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:13.677255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bed3a8-665f-48c6-a125-2af3db22832a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:13.679910 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bed3a8-665f-48c6-a125-2af3db22832a None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:13.697859 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 337/675] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:13.698868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bed3a8-665f-48c6-a125-2af3db22832a None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:13.716616 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66471370-a97c-4e4e-9d7c-78510347ec7d None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:13.747593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:13.760809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c54bea-1be2-437d-87af-c91d2fc485d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:13.761714 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c54bea-1be2-437d-87af-c91d2fc485d2 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:13.762007 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c54bea-1be2-437d-87af-c91d2fc485d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:13.762340 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c54bea-1be2-437d-87af-c91d2fc485d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:13.770649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c54bea-1be2-437d-87af-c91d2fc485d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:13.772213 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c54bea-1be2-437d-87af-c91d2fc485d2 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:13.790895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-12c54bea-1be2-437d-87af-c91d2fc485d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:13.790895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:13.790895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:13.790895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:13.790895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:13.790895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:13.790895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:13.790895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:13.790895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:13.790895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:13.790895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:13.790895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:13.790895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:19:13.790895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:19:13.790895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:19:13.791852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:19:13.791852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:13.791852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:13.791852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:13.791852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:13.791852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:13.791852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:13.791852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:13.791852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:13.791852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:13.791852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:13.791852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:13.791852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:13.791852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:13.791852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:13.791852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:13.791852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:13.792746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:19:13.792746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:19:13.792746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:19:13.792746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:19:13.792746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:19:13.792746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:19:13.792746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:13.792746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:13.797126 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 339/676] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:19:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:13.798066 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c54bea-1be2-437d-87af-c91d2fc485d2 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:13.818878 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bed3a8-665f-48c6-a125-2af3db22832a None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:13.872556 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7000b2-be92-41ae-8ab2-0259f43036cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:13.873853 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7000b2-be92-41ae-8ab2-0259f43036cd None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:13.874343 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7000b2-be92-41ae-8ab2-0259f43036cd None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:13.874958 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7000b2-be92-41ae-8ab2-0259f43036cd None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:13.876612 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7000b2-be92-41ae-8ab2-0259f43036cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:13.877136 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7000b2-be92-41ae-8ab2-0259f43036cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:13.878943 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7000b2-be92-41ae-8ab2-0259f43036cd None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:13.895099 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 338/677] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:13.896211 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7000b2-be92-41ae-8ab2-0259f43036cd None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:13.912511 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:13.918546 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c54bea-1be2-437d-87af-c91d2fc485d2 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:13.960834 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3907c0f-6410-4a56-8ecc-c1382a247299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:13.961642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3907c0f-6410-4a56-8ecc-c1382a247299 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:13.961934 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3907c0f-6410-4a56-8ecc-c1382a247299 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:13.962214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3907c0f-6410-4a56-8ecc-c1382a247299 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:13.969591 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3907c0f-6410-4a56-8ecc-c1382a247299 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:13.971321 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3907c0f-6410-4a56-8ecc-c1382a247299 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:13.986063 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-f3907c0f-6410-4a56-8ecc-c1382a247299 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:13.986063 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:13.986063 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:13.986063 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:13.986063 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:13.986063 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:13.986063 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:13.986063 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:13.986063 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:13.986063 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:13.986063 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:13.986063 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:13.986063 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:19:13.986063 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:19:13.986063 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:19:13.986973 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:19:13.986973 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:13.986973 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:13.986973 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:13.986973 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:13.986973 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:13.986973 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:13.986973 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:13.986973 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:13.986973 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:13.986973 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:13.986973 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:13.986973 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:13.986973 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:13.986973 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:13.986973 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:13.986973 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:13.987904 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:19:13.987904 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:19:13.987904 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:19:13.987904 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:19:13.987904 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:19:13.987904 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:19:13.987904 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:13.987904 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:13.992658 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 340/678] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:19:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:13.993716 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3907c0f-6410-4a56-8ecc-c1382a247299 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:14.021224 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7000b2-be92-41ae-8ab2-0259f43036cd None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:14.023836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:14.085255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e261a23-82b8-4690-9f83-f00b039105c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:14.086272 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e261a23-82b8-4690-9f83-f00b039105c5 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:14.086707 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e261a23-82b8-4690-9f83-f00b039105c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:14.087399 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e261a23-82b8-4690-9f83-f00b039105c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:14.089250 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e261a23-82b8-4690-9f83-f00b039105c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:14.089738 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e261a23-82b8-4690-9f83-f00b039105c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:14.091351 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e261a23-82b8-4690-9f83-f00b039105c5 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:14.108257 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 339/679] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:19:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:14.109408 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e261a23-82b8-4690-9f83-f00b039105c5 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:14.127043 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3907c0f-6410-4a56-8ecc-c1382a247299 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:14.164349 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9d8c5-9a9f-43a6-90e1-aa8de58d5ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:14.165027 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9d8c5-9a9f-43a6-90e1-aa8de58d5ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:14.165417 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9d8c5-9a9f-43a6-90e1-aa8de58d5ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:14.165798 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9d8c5-9a9f-43a6-90e1-aa8de58d5ac3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:14.174161 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9d8c5-9a9f-43a6-90e1-aa8de58d5ac3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:14.175908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9d8c5-9a9f-43a6-90e1-aa8de58d5ac3 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:14.190802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-0ad9d8c5-9a9f-43a6-90e1-aa8de58d5ac3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 15:19:14.190802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:14.190802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:14.190802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:14.190802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:14.190802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:14.190802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:14.190802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:14.190802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:14.190802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:14.190802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:14.190802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:14.190802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:19:14.190802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:19:14.190802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:19:14.190802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:19:14.192553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:14.192553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:14.192553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:19:14.192553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:14.192553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:19:14.192553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:14.192553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:14.192553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:14.192553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:14.192553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:14.192553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:14.192553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:14.192553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:14.192553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:14.192553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:14.192553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:14.192553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:14.192553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:14.193785 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:14.193785 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:14.193785 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:19:14.193785 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:19:14.193785 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:19:14.193785 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:19:14.193785 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:19:14.193785 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:19:14.193785 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 15:19:14.193785 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:14.195599 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 341/680] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:19:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:14.196545 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9d8c5-9a9f-43a6-90e1-aa8de58d5ac3 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:14.213723 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:14.241189 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e261a23-82b8-4690-9f83-f00b039105c5 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:14.279860 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10dd6ba-d5bf-4223-9e4e-bf7f1506fdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:14.280797 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dd6ba-d5bf-4223-9e4e-bf7f1506fdf2 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:14.281078 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dd6ba-d5bf-4223-9e4e-bf7f1506fdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:14.281355 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dd6ba-d5bf-4223-9e4e-bf7f1506fdf2 None admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:14.282159 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10dd6ba-d5bf-4223-9e4e-bf7f1506fdf2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:14.282468 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10dd6ba-d5bf-4223-9e4e-bf7f1506fdf2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:14.283938 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10dd6ba-d5bf-4223-9e4e-bf7f1506fdf2 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:14.299396 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 340/681] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:19:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:14.299396 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10dd6ba-d5bf-4223-9e4e-bf7f1506fdf2 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:14.317086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9d8c5-9a9f-43a6-90e1-aa8de58d5ac3 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:14.323721 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:14.353578 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691e0a9-2c98-4ffe-8b43-be3ef91baf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:14.354148 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691e0a9-2c98-4ffe-8b43-be3ef91baf74 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:14.354458 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691e0a9-2c98-4ffe-8b43-be3ef91baf74 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:14.354715 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691e0a9-2c98-4ffe-8b43-be3ef91baf74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:14.355565 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691e0a9-2c98-4ffe-8b43-be3ef91baf74 None admin] RBAC: Adding query filter params (role.id=1ff62289fb434d09a13001c3ffbab080, scope.project.id=c54934775a86487295bdbc02ed3a0103, user.id=fcf1f5f0ccf8449191a8660e5b1906d3) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:14.355879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691e0a9-2c98-4ffe-8b43-be3ef91baf74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:14.357309 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691e0a9-2c98-4ffe-8b43-be3ef91baf74 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:14.371250 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 342/682] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:19:14 2022] GET /identity/v3/role_assignments?user.id=fcf1f5f0ccf8449191a8660e5b1906d3&scope.project.id=c54934775a86487295bdbc02ed3a0103&role.id=1ff62289fb434d09a13001c3ffbab080 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:14.371250 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fadf7e-5c46-41f9-a644-317490673c0a None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:14.371250 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fadf7e-5c46-41f9-a644-317490673c0a None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:14.371250 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fadf7e-5c46-41f9-a644-317490673c0a None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:14.371250 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 343/683] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:14.371250 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fadf7e-5c46-41f9-a644-317490673c0a None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:14.428172 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10dd6ba-d5bf-4223-9e4e-bf7f1506fdf2 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:14.475243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fd9cc-e8d4-4c0c-808b-80a06dce4b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:14.476072 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fd9cc-e8d4-4c0c-808b-80a06dce4b39 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:14.476427 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fd9cc-e8d4-4c0c-808b-80a06dce4b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:14.476778 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fd9cc-e8d4-4c0c-808b-80a06dce4b39 None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:14.477703 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20fd9cc-e8d4-4c0c-808b-80a06dce4b39 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:14.478089 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20fd9cc-e8d4-4c0c-808b-80a06dce4b39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:14.480065 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20fd9cc-e8d4-4c0c-808b-80a06dce4b39 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:14.483873 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:14.507098 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 341/684] 10.222.0.44 () {56 vars in 1135 bytes} [Tue Jul 19 15:19:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:14.508959 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb30e6d-652e-4a93-8f5a-941d1dec86ee None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:14.509262 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb30e6d-652e-4a93-8f5a-941d1dec86ee None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:14.509795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb30e6d-652e-4a93-8f5a-941d1dec86ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:14.512729 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fadf7e-5c46-41f9-a644-317490673c0a None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:14.531200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-3bb30e6d-652e-4a93-8f5a-941d1dec86ee None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:14.532711 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-3bb30e6d-652e-4a93-8f5a-941d1dec86ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:14.554789 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4362373-e51c-42e4-9af8-d247575923ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:14.555842 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4362373-e51c-42e4-9af8-d247575923ff None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:14.556442 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4362373-e51c-42e4-9af8-d247575923ff None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:14.556908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4362373-e51c-42e4-9af8-d247575923ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:14.558087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4362373-e51c-42e4-9af8-d247575923ff None admin] RBAC: Adding query filter params (role.id=1ff62289fb434d09a13001c3ffbab080, scope.project.id=c54934775a86487295bdbc02ed3a0103, user.id=c89e7fbcc22c478c98d74b802f4bf8f0) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:14.558582 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4362373-e51c-42e4-9af8-d247575923ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:14.560308 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4362373-e51c-42e4-9af8-d247575923ff None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:14.568066 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 344/685] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:19:14 2022] GET /identity/v3/role_assignments?user.id=c89e7fbcc22c478c98d74b802f4bf8f0&scope.project.id=c54934775a86487295bdbc02ed3a0103&role.id=1ff62289fb434d09a13001c3ffbab080 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:14.569330 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4362373-e51c-42e4-9af8-d247575923ff None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:14.639638 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 342/686] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:19:14.672368 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb30e6d-652e-4a93-8f5a-941d1dec86ee None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:14.688684 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:14.720347 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4362373-e51c-42e4-9af8-d247575923ff None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:14.772695 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc3e4b-7071-4c86-93ad-c60b0245695b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:14.773360 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc3e4b-7071-4c86-93ad-c60b0245695b None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:14.773655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc3e4b-7071-4c86-93ad-c60b0245695b None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:14.774205 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc3e4b-7071-4c86-93ad-c60b0245695b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:14.792654 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:14.827588 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb30e6d-652e-4a93-8f5a-941d1dec86ee None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:14.881230 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc3e4b-7071-4c86-93ad-c60b0245695b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:14.881591 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783113f-900a-4275-81df-ba0cc6aaa83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:14.882453 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783113f-900a-4275-81df-ba0cc6aaa83a None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:14.882794 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783113f-900a-4275-81df-ba0cc6aaa83a None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:14.883078 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783113f-900a-4275-81df-ba0cc6aaa83a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:14.883957 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc3e4b-7071-4c86-93ad-c60b0245695b None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:14.897718 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783113f-900a-4275-81df-ba0cc6aaa83a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:19:14.908090 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-c783113f-900a-4275-81df-ba0cc6aaa83a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:19:14.908090 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:14.908090 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:14.908090 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:14.908090 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:14.908090 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:14.908090 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:14.908090 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:14.908090 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:14.908090 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:14.908090 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:14.908090 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:14.908090 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:19:14.908090 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:19:14.908090 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:19:14.908090 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:19:14.909075 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:19:14.909075 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:19:14.909075 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:19:14.909075 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:19:14.909075 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:14.909075 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:14.909075 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:14.909075 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:14.909075 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:14.909075 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:14.909075 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:14.909075 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:14.909075 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:14.909075 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:14.909075 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:14.909075 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:14.909921 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:14.909921 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:14.909921 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:14.909921 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:14.909921 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:19:14.909921 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:19:14.909921 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:19:14.909921 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:19:14.909921 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:19:14.909921 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:19:14.909921 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:19:14.909921 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:14.909921 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 343/687] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:19:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:19:14.916473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783113f-900a-4275-81df-ba0cc6aaa83a None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:15.007612 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 345/688] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:19:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:19:15.011904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:15.013237 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc3e4b-7071-4c86-93ad-c60b0245695b None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:15.051939 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783113f-900a-4275-81df-ba0cc6aaa83a None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:15.091493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a022d-08d5-47ad-834e-e0e090c89dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:15.092180 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a022d-08d5-47ad-834e-e0e090c89dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:15.092466 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a022d-08d5-47ad-834e-e0e090c89dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:15.092745 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a022d-08d5-47ad-834e-e0e090c89dc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:15.093508 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a022d-08d5-47ad-834e-e0e090c89dc2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:15.093823 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a022d-08d5-47ad-834e-e0e090c89dc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:15.095254 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a022d-08d5-47ad-834e-e0e090c89dc2 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:15.103655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:15.105091 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 344/689] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:19:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:15.110300 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a022d-08d5-47ad-834e-e0e090c89dc2 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:15.206147 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc3e4b-7071-4c86-93ad-c60b0245695b None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:15.224159 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a022d-08d5-47ad-834e-e0e090c89dc2 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:15.255207 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:15.262801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749741b2-d89e-4907-81fe-6d7a36f0b393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:15.263632 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749741b2-d89e-4907-81fe-6d7a36f0b393 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:15.263991 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749741b2-d89e-4907-81fe-6d7a36f0b393 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:15.264270 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749741b2-d89e-4907-81fe-6d7a36f0b393 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:15.273072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101e64d-2f47-455d-b0f4-b683fc88c9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:15.273893 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101e64d-2f47-455d-b0f4-b683fc88c9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:15.274182 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101e64d-2f47-455d-b0f4-b683fc88c9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:15.274488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101e64d-2f47-455d-b0f4-b683fc88c9f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:15.276996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749741b2-d89e-4907-81fe-6d7a36f0b393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:15.278574 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749741b2-d89e-4907-81fe-6d7a36f0b393 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:15.286839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101e64d-2f47-455d-b0f4-b683fc88c9f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:15.288719 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101e64d-2f47-455d-b0f4-b683fc88c9f4 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:15.297783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-749741b2-d89e-4907-81fe-6d7a36f0b393 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:15.297783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:15.297783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:15.297783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:15.297783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:15.297783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:15.297783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:15.297783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:15.297783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:15.297783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:15.297783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:15.297783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:15.297783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:15.297783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:15.297783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:15.298681 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:15.298681 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:15.298681 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:15.298681 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:15.298681 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:15.298681 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:15.298681 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:15.298681 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:15.298681 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:15.298681 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:15.298681 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:15.298681 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:15.298681 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:15.298681 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:15.298681 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:15.298681 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:15.298681 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:15.299618 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:15.299618 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:15.299618 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:15.299618 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:15.299618 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 345/690] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:19:15.303248 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d30f74-b9e5-4647-9a1d-07f73ee459c4 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:15.303248 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d30f74-b9e5-4647-9a1d-07f73ee459c4 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:15.303248 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d30f74-b9e5-4647-9a1d-07f73ee459c4 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:15.303248 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 346/691] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:15.307601 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d30f74-b9e5-4647-9a1d-07f73ee459c4 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:15.311931 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-f101e64d-2f47-455d-b0f4-b683fc88c9f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:15.311931 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:15.311931 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:15.311931 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:15.311931 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:15.311931 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:15.311931 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:15.311931 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:15.311931 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:15.311931 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:15.311931 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:15.311931 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:15.311931 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:15.311931 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:15.311931 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:15.312827 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:15.312827 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:15.312827 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:15.312827 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:15.312827 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:15.312827 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:15.312827 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:15.312827 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:15.312827 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:15.312827 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:15.312827 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:15.312827 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:15.312827 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:15.312827 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:15.312827 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:15.312827 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:15.312827 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:15.313798 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:15.313798 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:15.313798 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:15.313798 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:15.313798 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 346/692] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:15.314500 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae6955-9b20-466a-9cd6-fde1a4a95637 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:15.314609 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae6955-9b20-466a-9cd6-fde1a4a95637 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:15.314885 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae6955-9b20-466a-9cd6-fde1a4a95637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:15.343306 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-a6ae6955-9b20-466a-9cd6-fde1a4a95637 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:15.345492 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-a6ae6955-9b20-466a-9cd6-fde1a4a95637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:15.430506 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d30f74-b9e5-4647-9a1d-07f73ee459c4 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:15.446843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 347/693] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:19:15.446843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae6955-9b20-466a-9cd6-fde1a4a95637 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:15.488676 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:15.490715 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9e09a-4a4f-40ed-84eb-ee60c13b77ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:15.491325 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9e09a-4a4f-40ed-84eb-ee60c13b77ef None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:15.491588 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9e09a-4a4f-40ed-84eb-ee60c13b77ef None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:15.492096 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9e09a-4a4f-40ed-84eb-ee60c13b77ef None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:15.494205 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9e09a-4a4f-40ed-84eb-ee60c13b77ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:15.494525 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9e09a-4a4f-40ed-84eb-ee60c13b77ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:15.495922 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9e09a-4a4f-40ed-84eb-ee60c13b77ef None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:15.514922 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 347/694] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:15.514922 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9e09a-4a4f-40ed-84eb-ee60c13b77ef None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:15.572533 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:15.595171 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae6955-9b20-466a-9cd6-fde1a4a95637 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:15.634598 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9e09a-4a4f-40ed-84eb-ee60c13b77ef None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:15.640294 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae37c5-d0e6-4b45-bdca-157e2cf1311d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:15.641233 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae37c5-d0e6-4b45-bdca-157e2cf1311d None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:15.641700 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae37c5-d0e6-4b45-bdca-157e2cf1311d None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:15.642156 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae37c5-d0e6-4b45-bdca-157e2cf1311d None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:15.643551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae37c5-d0e6-4b45-bdca-157e2cf1311d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:15.644050 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae37c5-d0e6-4b45-bdca-157e2cf1311d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:15.646633 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae37c5-d0e6-4b45-bdca-157e2cf1311d None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:15.667272 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 348/695] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:15.669376 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae37c5-d0e6-4b45-bdca-157e2cf1311d None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:15.677639 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff81c16-d299-438e-95ee-852cb1d58e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:15.678436 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff81c16-d299-438e-95ee-852cb1d58e42 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:15.678721 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff81c16-d299-438e-95ee-852cb1d58e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:15.679005 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff81c16-d299-438e-95ee-852cb1d58e42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:15.689947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff81c16-d299-438e-95ee-852cb1d58e42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:15.692075 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff81c16-d299-438e-95ee-852cb1d58e42 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:15.710852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-9ff81c16-d299-438e-95ee-852cb1d58e42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:15.710852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:15.710852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:15.710852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:15.710852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:15.710852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:15.710852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:15.710852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:15.710852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:15.710852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:15.710852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:15.710852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:15.710852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:15.710852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:15.710852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:15.711819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:15.711819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:15.711819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:15.711819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:15.711819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:15.711819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:15.711819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:15.711819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:15.711819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:15.711819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:15.711819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:15.711819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:15.711819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:15.711819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:15.711819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:15.711819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:15.711819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:15.712730 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:15.712730 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:15.712730 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:15.712730 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:15.717093 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 348/696] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:15.718020 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff81c16-d299-438e-95ee-852cb1d58e42 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:15.777120 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:15.794998 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae37c5-d0e6-4b45-bdca-157e2cf1311d None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:15.841848 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee779f56-9ae2-453b-aa1b-4a3a683fe172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:15.842773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee779f56-9ae2-453b-aa1b-4a3a683fe172 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:15.842995 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee779f56-9ae2-453b-aa1b-4a3a683fe172 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:15.843297 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee779f56-9ae2-453b-aa1b-4a3a683fe172 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:15.846321 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:15.854374 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee779f56-9ae2-453b-aa1b-4a3a683fe172 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:15.856235 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff81c16-d299-438e-95ee-852cb1d58e42 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:15.859051 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee779f56-9ae2-453b-aa1b-4a3a683fe172 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:15.874483 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-ee779f56-9ae2-453b-aa1b-4a3a683fe172 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:19:15.874483 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:15.874483 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:15.874483 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:15.874483 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:15.874483 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:15.874483 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:15.874483 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:15.874483 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:15.874483 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:15.874483 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:15.874483 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:15.874483 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:19:15.874483 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:19:15.874483 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:19:15.874483 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:19:15.875696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:15.875696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:15.875696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:19:15.875696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:15.875696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:19:15.875696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:15.875696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:15.875696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:15.875696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:15.875696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:15.875696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:15.875696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:15.875696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:15.875696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:15.875696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:15.875696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:15.875696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:15.875696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:15.876810 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:15.876810 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:15.876810 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:19:15.876810 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:19:15.876810 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:19:15.876810 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:19:15.876810 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:19:15.876810 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:19:15.876810 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:19:15.876810 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:15.883697 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 349/697] 10.222.0.44 () {56 vars in 1093 bytes} [Tue Jul 19 15:19:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:15.883697 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee779f56-9ae2-453b-aa1b-4a3a683fe172 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:15.911731 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8949c-cfe0-44c6-908b-0fa4ca398770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:15.913196 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8949c-cfe0-44c6-908b-0fa4ca398770 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:15.913951 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8949c-cfe0-44c6-908b-0fa4ca398770 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:15.914887 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8949c-cfe0-44c6-908b-0fa4ca398770 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:15.924955 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8949c-cfe0-44c6-908b-0fa4ca398770 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:15.927586 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8949c-cfe0-44c6-908b-0fa4ca398770 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:15.948149 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-13a8949c-cfe0-44c6-908b-0fa4ca398770 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:15.948149 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:15.948149 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:15.948149 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:15.948149 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:15.948149 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:15.948149 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:15.948149 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:15.948149 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:15.948149 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:15.948149 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:15.948149 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:15.948149 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:19:15.948149 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:19:15.948149 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:19:15.949093 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:19:15.949093 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:15.949093 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:15.949093 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:15.949093 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:15.949093 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:15.949093 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:15.949093 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:15.949093 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:15.949093 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:15.949093 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:15.949093 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:15.949093 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:15.949093 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:15.949093 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:15.949093 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:15.949093 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:15.949976 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:19:15.949976 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:19:15.949976 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:19:15.949976 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:19:15.949976 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:19:15.949976 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:19:15.949976 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:15.949976 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:15.952925 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 349/698] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:19:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:15.954001 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8949c-cfe0-44c6-908b-0fa4ca398770 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:16.000253 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee779f56-9ae2-453b-aa1b-4a3a683fe172 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:16.040377 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063467dc-f3f3-476e-8136-d9cfafadc75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:16.041203 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063467dc-f3f3-476e-8136-d9cfafadc75a None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:16.041593 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063467dc-f3f3-476e-8136-d9cfafadc75a None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:16.041977 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063467dc-f3f3-476e-8136-d9cfafadc75a None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:16.042810 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063467dc-f3f3-476e-8136-d9cfafadc75a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:16.043254 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063467dc-f3f3-476e-8136-d9cfafadc75a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:16.045051 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063467dc-f3f3-476e-8136-d9cfafadc75a None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:16.063003 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 350/699] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:16.063911 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063467dc-f3f3-476e-8136-d9cfafadc75a None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:16.067932 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:16.085680 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8949c-cfe0-44c6-908b-0fa4ca398770 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:16.125789 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77757b60-4aa3-49e2-8d67-e4449c7bfc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:16.126719 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77757b60-4aa3-49e2-8d67-e4449c7bfc9c None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:16.127108 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77757b60-4aa3-49e2-8d67-e4449c7bfc9c None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:16.127642 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77757b60-4aa3-49e2-8d67-e4449c7bfc9c None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:16.128695 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77757b60-4aa3-49e2-8d67-e4449c7bfc9c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:16.129161 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77757b60-4aa3-49e2-8d67-e4449c7bfc9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:16.131083 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77757b60-4aa3-49e2-8d67-e4449c7bfc9c None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:16.154906 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 350/700] 10.222.0.44 () {56 vars in 1133 bytes} [Tue Jul 19 15:19:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:16.154906 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77757b60-4aa3-49e2-8d67-e4449c7bfc9c None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:16.170887 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:16.197387 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063467dc-f3f3-476e-8136-d9cfafadc75a None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:16.246132 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd839a6-ba1f-4729-a9f2-c1e372b2d3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:16.246879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd839a6-ba1f-4729-a9f2-c1e372b2d3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:16.247164 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd839a6-ba1f-4729-a9f2-c1e372b2d3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:16.247481 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd839a6-ba1f-4729-a9f2-c1e372b2d3a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:16.248289 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd839a6-ba1f-4729-a9f2-c1e372b2d3a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:16.248877 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd839a6-ba1f-4729-a9f2-c1e372b2d3a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:16.250013 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd839a6-ba1f-4729-a9f2-c1e372b2d3a6 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:16.264078 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 351/701] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:19:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:16.265311 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd839a6-ba1f-4729-a9f2-c1e372b2d3a6 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:16.280284 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77757b60-4aa3-49e2-8d67-e4449c7bfc9c None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:16.326114 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231e4bb-9491-46cb-b788-4be774b8abe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:16.327527 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231e4bb-9491-46cb-b788-4be774b8abe8 None admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:16.328340 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231e4bb-9491-46cb-b788-4be774b8abe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:16.328806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231e4bb-9491-46cb-b788-4be774b8abe8 None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:16.329858 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231e4bb-9491-46cb-b788-4be774b8abe8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:16.332751 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231e4bb-9491-46cb-b788-4be774b8abe8 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:16.336872 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:16.358072 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 351/702] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jul 19 15:19:16 2022] POST /identity/v3/users => generated 254 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:19:16.359622 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231e4bb-9491-46cb-b788-4be774b8abe8 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:16.425624 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd839a6-ba1f-4729-a9f2-c1e372b2d3a6 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:16.484848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:16.539909 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231e4bb-9491-46cb-b788-4be774b8abe8 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:16.540782 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd884a61-8d45-4f11-843c-df7697c178be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:16.541356 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd884a61-8d45-4f11-843c-df7697c178be None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:16.541632 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd884a61-8d45-4f11-843c-df7697c178be None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:16.541908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd884a61-8d45-4f11-843c-df7697c178be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:16.586198 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8eb0c-536d-4046-9962-2e15f90b10e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:16.587533 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8eb0c-536d-4046-9962-2e15f90b10e8 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:16.588208 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8eb0c-536d-4046-9962-2e15f90b10e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:16.588691 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8eb0c-536d-4046-9962-2e15f90b10e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:16.589777 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8eb0c-536d-4046-9962-2e15f90b10e8 None admin] RBAC: Adding query filter params (role.id=1ff62289fb434d09a13001c3ffbab080, scope.project.id=c54934775a86487295bdbc02ed3a0103, user.id=bd1dceaddb6e414faef0e0448cdf1be8) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:16.590626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8eb0c-536d-4046-9962-2e15f90b10e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:16.592551 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8eb0c-536d-4046-9962-2e15f90b10e8 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:16.602172 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 352/703] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:19:16 2022] GET /identity/v3/role_assignments?user.id=bd1dceaddb6e414faef0e0448cdf1be8&scope.project.id=c54934775a86487295bdbc02ed3a0103&role.id=1ff62289fb434d09a13001c3ffbab080 => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:16.639151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd884a61-8d45-4f11-843c-df7697c178be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:16.640775 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd884a61-8d45-4f11-843c-df7697c178be None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:16.715898 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:16.767347 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 352/704] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:19:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:19:16.769537 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8eb0c-536d-4046-9962-2e15f90b10e8 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:16.879772 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54dba9-5cd0-4422-a07d-4731f1e8580f None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:16.880066 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54dba9-5cd0-4422-a07d-4731f1e8580f None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:16.880666 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54dba9-5cd0-4422-a07d-4731f1e8580f None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:16.883586 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 353/705] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:16.889399 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baebeae-fb66-4908-9e95-45fa5610c484 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:16.889694 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baebeae-fb66-4908-9e95-45fa5610c484 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:16.889975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baebeae-fb66-4908-9e95-45fa5610c484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:16.897258 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8eb0c-536d-4046-9962-2e15f90b10e8 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:16.911608 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-2baebeae-fb66-4908-9e95-45fa5610c484 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:16.913020 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-2baebeae-fb66-4908-9e95-45fa5610c484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:16.932313 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:16.938796 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a897b-a6ea-4e54-ba1f-78aa731d10ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:16.939630 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a897b-a6ea-4e54-ba1f-78aa731d10ff None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:16.939916 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a897b-a6ea-4e54-ba1f-78aa731d10ff None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:16.940194 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a897b-a6ea-4e54-ba1f-78aa731d10ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:16.953654 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a897b-a6ea-4e54-ba1f-78aa731d10ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:16.955115 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a897b-a6ea-4e54-ba1f-78aa731d10ff None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:16.972899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-988a897b-a6ea-4e54-ba1f-78aa731d10ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:16.972899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:16.972899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:16.972899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:16.972899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:16.972899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:16.972899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:16.972899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:16.972899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:16.972899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:16.972899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:16.972899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:16.972899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:16.972899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:16.972899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:16.973848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:16.973848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:16.973848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:16.973848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:16.973848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:16.973848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:16.973848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:16.973848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:16.973848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:16.973848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:16.973848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:16.973848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:16.973848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:16.973848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:16.973848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:16.973848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:16.973848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:16.974738 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:16.974738 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:16.974738 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:16.974738 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:16.978716 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 353/706] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:16.979984 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a897b-a6ea-4e54-ba1f-78aa731d10ff None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:16.992198 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 354/707] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:19:17.017370 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baebeae-fb66-4908-9e95-45fa5610c484 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:17.105402 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a897b-a6ea-4e54-ba1f-78aa731d10ff None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:17.124057 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:17.132464 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baebeae-fb66-4908-9e95-45fa5610c484 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:17.154574 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d33eb-49a1-400d-97b2-1966a18ee283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:17.155540 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d33eb-49a1-400d-97b2-1966a18ee283 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:17.155825 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d33eb-49a1-400d-97b2-1966a18ee283 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:17.156101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d33eb-49a1-400d-97b2-1966a18ee283 None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:17.156848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d33eb-49a1-400d-97b2-1966a18ee283 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:17.157155 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d33eb-49a1-400d-97b2-1966a18ee283 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:17.159193 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d33eb-49a1-400d-97b2-1966a18ee283 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:17.178032 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95409046-39e4-4d50-be6d-0366952a4b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:17.178354 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 354/708] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:17.178848 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95409046-39e4-4d50-be6d-0366952a4b50 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:17.179192 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95409046-39e4-4d50-be6d-0366952a4b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:17.179441 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95409046-39e4-4d50-be6d-0366952a4b50 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:17.179772 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89972f-63ce-4eae-bd7f-8552a7e7cdfa None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:17.180058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89972f-63ce-4eae-bd7f-8552a7e7cdfa None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:17.180160 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95409046-39e4-4d50-be6d-0366952a4b50 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:17.180327 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89972f-63ce-4eae-bd7f-8552a7e7cdfa None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:17.181465 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95409046-39e4-4d50-be6d-0366952a4b50 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:17.181932 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 355/709] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:17.184087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89972f-63ce-4eae-bd7f-8552a7e7cdfa None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:17.210791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-95409046-39e4-4d50-be6d-0366952a4b50 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 15:19:17.210791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:17.210791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:19:17.210791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:19:17.210791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:19:17.210791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:19:17.210791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:19:17.210791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:17.210791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 15:19:17.210791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:17.210791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:19:17.210791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:17.210791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:17.210791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:17.210791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:17.210791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:17.212086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:17.212086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:17.212086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:17.212086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:17.212086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:17.212086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:17.212086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:17.212086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:19:17.212086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:19:17.212086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:19:17.212086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:19:17.212086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:17.212086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:17.212086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:17.212086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:17.212086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:17.213268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:17.213268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:17.213268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:17.213268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:17.213268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:17.213268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:17.213268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:17.213268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:17.213268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:17.213268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:17.213268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:17.213268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:19:17.213268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:17.213268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 15:19:17.213268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:17.214950 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 355/710] 10.222.0.44 () {56 vars in 1129 bytes} [Tue Jul 19 15:19:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:19:17.214950 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ab14c-e43c-4af9-ab88-c1fc0b5cd0eb None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:17.215212 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ab14c-e43c-4af9-ab88-c1fc0b5cd0eb None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:17.219407 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ab14c-e43c-4af9-ab88-c1fc0b5cd0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:17.243460 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-761ab14c-e43c-4af9-ab88-c1fc0b5cd0eb None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:17.245384 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-761ab14c-e43c-4af9-ab88-c1fc0b5cd0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:17.247272 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:17.310261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89972f-63ce-4eae-bd7f-8552a7e7cdfa None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:17.324760 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 356/711] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:19:17.325861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ab14c-e43c-4af9-ab88-c1fc0b5cd0eb None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:17.349909 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61111332-c8c6-461f-aff4-c0456afbf5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:17.350836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61111332-c8c6-461f-aff4-c0456afbf5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:17.351181 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61111332-c8c6-461f-aff4-c0456afbf5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:17.351692 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61111332-c8c6-461f-aff4-c0456afbf5c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:17.359651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61111332-c8c6-461f-aff4-c0456afbf5c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:17.361222 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61111332-c8c6-461f-aff4-c0456afbf5c3 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:17.378846 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-61111332-c8c6-461f-aff4-c0456afbf5c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:17.378846 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:17.378846 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:17.378846 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:17.378846 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:17.378846 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:17.378846 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:17.378846 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:17.378846 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:17.378846 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:17.378846 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:17.378846 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:17.378846 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:19:17.378846 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:19:17.378846 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:19:17.380840 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:19:17.380840 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:17.380840 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:17.380840 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:17.380840 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:17.380840 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:17.380840 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:17.380840 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:17.380840 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:17.380840 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:17.380840 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:17.380840 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:17.380840 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:17.380840 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:17.380840 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:17.380840 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:17.380840 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:17.381748 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:19:17.381748 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:19:17.381748 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:19:17.381748 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:19:17.381748 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:19:17.381748 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:19:17.381748 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:17.381748 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:17.381748 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 356/712] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:19:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:17.381748 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61111332-c8c6-461f-aff4-c0456afbf5c3 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:17.423781 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:17.438605 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ab14c-e43c-4af9-ab88-c1fc0b5cd0eb None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:17.475526 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946542c2-c887-4bef-a436-bb672d7bfbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:17.476443 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946542c2-c887-4bef-a436-bb672d7bfbb4 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:17.476984 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946542c2-c887-4bef-a436-bb672d7bfbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:17.477475 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946542c2-c887-4bef-a436-bb672d7bfbb4 None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:17.478574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946542c2-c887-4bef-a436-bb672d7bfbb4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:17.479140 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946542c2-c887-4bef-a436-bb672d7bfbb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:17.480831 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946542c2-c887-4bef-a436-bb672d7bfbb4 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:17.491142 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 357/713] 10.222.0.44 () {56 vars in 1124 bytes} [Tue Jul 19 15:19:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:17.493023 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946542c2-c887-4bef-a436-bb672d7bfbb4 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:17.496960 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61111332-c8c6-461f-aff4-c0456afbf5c3 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:17.499361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:17.534467 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55892f24-4706-4d73-b0d9-85c771b3a856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:17.535871 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55892f24-4706-4d73-b0d9-85c771b3a856 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:17.536151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55892f24-4706-4d73-b0d9-85c771b3a856 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:17.536425 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55892f24-4706-4d73-b0d9-85c771b3a856 None admin] PATH_INFO: `/v3/services/network` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:17.537082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55892f24-4706-4d73-b0d9-85c771b3a856 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:17.538451 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55892f24-4706-4d73-b0d9-85c771b3a856 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:17.552923 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-55892f24-4706-4d73-b0d9-85c771b3a856 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 15:19:17.552923 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:17.552923 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:19:17.552923 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:19:17.552923 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:19:17.552923 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:19:17.552923 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:19:17.552923 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:17.552923 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 15:19:17.552923 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:17.552923 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:19:17.552923 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:17.552923 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:17.552923 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:17.552923 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:17.552923 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:17.552923 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:17.554407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:17.554407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:17.554407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:17.554407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:17.554407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:17.554407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:17.554407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:19:17.554407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:19:17.554407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:19:17.554407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:19:17.554407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:17.554407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:17.554407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:17.554407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:17.554407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:17.554407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:17.555308 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:17.555308 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:17.555308 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:17.555308 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:17.555308 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:17.555308 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:17.555308 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:17.555308 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:17.555308 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:17.555308 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:17.555308 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:19:17.555308 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:17.555308 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 15:19:17.555308 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:17.555308 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 357/714] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:19:17 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:17.556149 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55892f24-4706-4d73-b0d9-85c771b3a856 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:17.605159 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946542c2-c887-4bef-a436-bb672d7bfbb4 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:17.642159 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11beba6c-6768-494d-9366-9f493da4957d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:17.643215 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11beba6c-6768-494d-9366-9f493da4957d None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:17.643795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11beba6c-6768-494d-9366-9f493da4957d None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:17.644435 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11beba6c-6768-494d-9366-9f493da4957d None admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:17.645426 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11beba6c-6768-494d-9366-9f493da4957d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:17.645933 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11beba6c-6768-494d-9366-9f493da4957d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:17.647582 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11beba6c-6768-494d-9366-9f493da4957d None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:17.667143 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 358/715] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:19:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:17.668099 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11beba6c-6768-494d-9366-9f493da4957d None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:17.669638 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55892f24-4706-4d73-b0d9-85c771b3a856 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:17.684363 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:17.711728 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b725dd-0de1-4ebf-a4e7-cc8c6076e826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:17.712395 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b725dd-0de1-4ebf-a4e7-cc8c6076e826 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:17.712677 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b725dd-0de1-4ebf-a4e7-cc8c6076e826 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:17.712954 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b725dd-0de1-4ebf-a4e7-cc8c6076e826 None admin] PATH_INFO: `/v3/services` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:17.713719 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b725dd-0de1-4ebf-a4e7-cc8c6076e826 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:17.714028 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b725dd-0de1-4ebf-a4e7-cc8c6076e826 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:17.715609 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b725dd-0de1-4ebf-a4e7-cc8c6076e826 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:17.727256 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 358/716] 10.222.0.44 () {56 vars in 1124 bytes} [Tue Jul 19 15:19:17 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:17.727256 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b725dd-0de1-4ebf-a4e7-cc8c6076e826 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:17.762057 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:17.813035 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11beba6c-6768-494d-9366-9f493da4957d None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:17.851676 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0c79d-cefc-4465-b052-81e48203ae3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:17.852795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0c79d-cefc-4465-b052-81e48203ae3c None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:17.853305 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0c79d-cefc-4465-b052-81e48203ae3c None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:17.853790 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0c79d-cefc-4465-b052-81e48203ae3c None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:17.854731 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0c79d-cefc-4465-b052-81e48203ae3c None admin] RBAC: Adding query filter params (name=network) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:17.855301 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0c79d-cefc-4465-b052-81e48203ae3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:17.857599 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0c79d-cefc-4465-b052-81e48203ae3c None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:17.863628 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 359/717] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jul 19 15:19:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:17.872893 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0c79d-cefc-4465-b052-81e48203ae3c None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:17.906539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b725dd-0de1-4ebf-a4e7-cc8c6076e826 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:17.956148 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e437a9-1157-4808-a394-9d7ccb97416e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:17.957386 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e437a9-1157-4808-a394-9d7ccb97416e None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:17.957831 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e437a9-1157-4808-a394-9d7ccb97416e None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:17.958106 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e437a9-1157-4808-a394-9d7ccb97416e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:17.958943 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e437a9-1157-4808-a394-9d7ccb97416e None admin] RBAC: Adding query filter params (role.id=d884ddf33c1440d9b3a3351b85e83e76, scope.project.id=c54934775a86487295bdbc02ed3a0103, user.id=fef0511f56144ca9945b2dddfa2601a2) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:17.959475 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e437a9-1157-4808-a394-9d7ccb97416e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:17.961066 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e437a9-1157-4808-a394-9d7ccb97416e None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:17.970158 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 359/718] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:19:17 2022] GET /identity/v3/role_assignments?user.id=fef0511f56144ca9945b2dddfa2601a2&scope.project.id=c54934775a86487295bdbc02ed3a0103&role.id=d884ddf33c1440d9b3a3351b85e83e76 => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:18.021191 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:18.052335 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0c79d-cefc-4465-b052-81e48203ae3c None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:18.116962 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79838901-e59a-4e91-b961-85d011e46cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:18.117637 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79838901-e59a-4e91-b961-85d011e46cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:18.117925 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79838901-e59a-4e91-b961-85d011e46cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:18.118203 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79838901-e59a-4e91-b961-85d011e46cd5 None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:18.118920 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79838901-e59a-4e91-b961-85d011e46cd5 None admin] RBAC: Adding query filter params (type=network) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:18.119248 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79838901-e59a-4e91-b961-85d011e46cd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:18.120620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79838901-e59a-4e91-b961-85d011e46cd5 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:18.128269 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 360/719] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jul 19 15:19:17 2022] GET /identity/v3/services?type=network => generated 124 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:19.090665 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bbbd8-e0a7-41c8-b046-1b23a35a5c70 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:19.091185 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bbbd8-e0a7-41c8-b046-1b23a35a5c70 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:19.091317 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bbbd8-e0a7-41c8-b046-1b23a35a5c70 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:19.092883 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 360/720] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:19.098842 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ee435-35ec-40e5-a4bc-9d14318ee994 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:19.099286 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ee435-35ec-40e5-a4bc-9d14318ee994 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:19.099463 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ee435-35ec-40e5-a4bc-9d14318ee994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:19.124315 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-841ee435-35ec-40e5-a4bc-9d14318ee994 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:19.125462 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-841ee435-35ec-40e5-a4bc-9d14318ee994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:19.192509 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee76af-3d2c-49e8-a272-3a2dba5a870b None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:19.193197 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee76af-3d2c-49e8-a272-3a2dba5a870b None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:19.193676 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee76af-3d2c-49e8-a272-3a2dba5a870b None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:19.195506 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 361/721] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:19.201717 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d0564-6cca-42e1-a7ff-040bbfeea024 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:19.202314 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d0564-6cca-42e1-a7ff-040bbfeea024 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:19.202787 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d0564-6cca-42e1-a7ff-040bbfeea024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:19.222959 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-cc2d0564-6cca-42e1-a7ff-040bbfeea024 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:19.224651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-cc2d0564-6cca-42e1-a7ff-040bbfeea024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:19.225047 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 361/722] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:19:19.264877 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ee435-35ec-40e5-a4bc-9d14318ee994 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:19.327243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 362/723] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 15:19:19.387641 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:19.416464 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d0564-6cca-42e1-a7ff-040bbfeea024 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:19.426344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ee435-35ec-40e5-a4bc-9d14318ee994 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:19.459624 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:19.504539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d261a-423f-42b2-84bf-fa981ff56e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:19.505349 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d261a-423f-42b2-84bf-fa981ff56e34 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:19.505634 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d261a-423f-42b2-84bf-fa981ff56e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:19.505907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d261a-423f-42b2-84bf-fa981ff56e34 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:19.527472 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d261a-423f-42b2-84bf-fa981ff56e34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:19:19.540647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-123d261a-423f-42b2-84bf-fa981ff56e34 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:19:19.540647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:19.540647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:19.540647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:19.540647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:19.540647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:19.540647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:19.540647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:19.540647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:19.540647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:19.540647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:19.540647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:19.540647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:19:19.540647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:19:19.540647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:19:19.540647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:19:19.541649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:19:19.541649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:19:19.541649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:19:19.541649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:19:19.541649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:19.541649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:19.541649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:19.541649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:19.541649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:19.541649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:19.541649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:19.541649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:19.541649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:19.541649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:19.541649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:19.541649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:19.542501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:19.542501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:19.542501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:19.542501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:19.542501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:19:19.542501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:19:19.542501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:19:19.542501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:19:19.542501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:19:19.542501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:19:19.542501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:19:19.542501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:19.543708 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 362/724] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 19 15:19:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:19:19.551620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d261a-423f-42b2-84bf-fa981ff56e34 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:19.586555 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d0564-6cca-42e1-a7ff-040bbfeea024 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:19.624103 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc738fa-3907-4e4f-9fd4-f8a51ca6195d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:19.625554 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc738fa-3907-4e4f-9fd4-f8a51ca6195d None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:19.626037 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc738fa-3907-4e4f-9fd4-f8a51ca6195d None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:19.626507 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc738fa-3907-4e4f-9fd4-f8a51ca6195d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:19.638771 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc738fa-3907-4e4f-9fd4-f8a51ca6195d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:19:19.647336 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-3cc738fa-3907-4e4f-9fd4-f8a51ca6195d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:19:19.647336 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:19.647336 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:19.647336 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:19.647336 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:19.647336 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:19.647336 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:19.647336 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:19.647336 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:19.647336 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:19.647336 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:19.647336 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:19.647336 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:19:19.647336 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:19:19.647336 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:19:19.647336 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:19:19.648256 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:19:19.648256 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:19:19.648256 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:19:19.648256 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:19:19.648256 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:19.648256 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:19.648256 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:19.648256 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:19.648256 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:19.648256 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:19.648256 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:19.648256 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:19.648256 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:19.648256 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:19.648256 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:19.648256 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:19.649167 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:19.649167 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:19.649167 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:19.649167 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:19.649167 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:19:19.649167 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:19:19.649167 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:19:19.649167 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:19:19.649167 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:19:19.649167 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:19:19.649167 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:19:19.649167 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:19.651744 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 363/725] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:19:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:19:19.659635 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc738fa-3907-4e4f-9fd4-f8a51ca6195d None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:19.692587 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d261a-423f-42b2-84bf-fa981ff56e34 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:19.753947 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:19.763741 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765ad34-7b57-40d9-a57b-532b66f6b4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:19.764412 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765ad34-7b57-40d9-a57b-532b66f6b4ff None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:19.764695 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765ad34-7b57-40d9-a57b-532b66f6b4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:19.764970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765ad34-7b57-40d9-a57b-532b66f6b4ff None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:19.765722 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765ad34-7b57-40d9-a57b-532b66f6b4ff None admin] RBAC: Adding query filter params (name=service) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:19.766028 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765ad34-7b57-40d9-a57b-532b66f6b4ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:19.767396 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765ad34-7b57-40d9-a57b-532b66f6b4ff None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:19.783347 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 363/726] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 19 15:19:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:19.790145 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765ad34-7b57-40d9-a57b-532b66f6b4ff None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:19.847627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:19.880848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc738fa-3907-4e4f-9fd4-f8a51ca6195d None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:19.937664 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bedd98-89c6-4dba-9a69-f14b977827d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:19.938482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bedd98-89c6-4dba-9a69-f14b977827d4 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:19.938865 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bedd98-89c6-4dba-9a69-f14b977827d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:19.939412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bedd98-89c6-4dba-9a69-f14b977827d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:19.940269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bedd98-89c6-4dba-9a69-f14b977827d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:19.940773 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bedd98-89c6-4dba-9a69-f14b977827d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:19.942917 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bedd98-89c6-4dba-9a69-f14b977827d4 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:19.952634 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 364/727] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:19:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:19.959972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bedd98-89c6-4dba-9a69-f14b977827d4 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:19.962106 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765ad34-7b57-40d9-a57b-532b66f6b4ff None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:19.997771 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7df5e-756f-4316-a8d5-68fd2661ca85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:19.998616 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7df5e-756f-4316-a8d5-68fd2661ca85 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:19.998912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7df5e-756f-4316-a8d5-68fd2661ca85 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:19.999195 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7df5e-756f-4316-a8d5-68fd2661ca85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:20.010495 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7df5e-756f-4316-a8d5-68fd2661ca85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:20.011991 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7df5e-756f-4316-a8d5-68fd2661ca85 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:20.031081 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-6ba7df5e-756f-4316-a8d5-68fd2661ca85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:20.031081 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:20.031081 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:20.031081 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:20.031081 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:20.031081 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:20.031081 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:20.031081 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:20.031081 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:20.031081 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:20.031081 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:20.031081 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:20.031081 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:20.031081 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:20.031081 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:20.032181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:20.032181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:20.032181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:20.032181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:20.032181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:20.032181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:20.032181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:20.032181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:20.032181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:20.032181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:20.032181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:20.032181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:20.032181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:20.032181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:20.032181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:20.032181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:20.032181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:20.033080 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:20.033080 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:20.033080 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:20.033080 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:20.033300 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 364/728] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:20.040256 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7df5e-756f-4316-a8d5-68fd2661ca85 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:20.137908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:20.151672 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bedd98-89c6-4dba-9a69-f14b977827d4 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:20.207696 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f6e27-c6e3-43fd-879c-33dbcc46a047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:20.208446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f6e27-c6e3-43fd-879c-33dbcc46a047 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:20.208802 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f6e27-c6e3-43fd-879c-33dbcc46a047 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:20.209081 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f6e27-c6e3-43fd-879c-33dbcc46a047 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:20.221713 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f6e27-c6e3-43fd-879c-33dbcc46a047 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:20.222051 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7df5e-756f-4316-a8d5-68fd2661ca85 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:20.223183 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f6e27-c6e3-43fd-879c-33dbcc46a047 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:20.232140 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:20.242372 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-1a7f6e27-c6e3-43fd-879c-33dbcc46a047 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:20.242372 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:20.242372 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:20.242372 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:20.242372 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:20.242372 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:20.242372 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:20.242372 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:20.242372 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:20.242372 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:20.242372 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:20.242372 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:20.242372 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:20.242372 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:20.242372 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:20.243349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:20.243349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:20.243349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:20.243349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:20.243349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:20.243349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:20.243349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:20.243349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:20.243349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:20.243349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:20.243349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:20.243349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:20.243349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:20.243349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:20.243349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:20.243349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:20.243349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:20.244238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:20.244238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:20.244238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:20.244238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:20.244238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 365/729] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:20.247243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb69eb-e5c0-4887-8a90-8fb0dd5c9d50 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:20.247243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb69eb-e5c0-4887-8a90-8fb0dd5c9d50 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:20.247243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb69eb-e5c0-4887-8a90-8fb0dd5c9d50 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:20.251324 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 366/730] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:20.252290 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb69eb-e5c0-4887-8a90-8fb0dd5c9d50 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:20.261115 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6deabaa-b16e-49d3-b566-02fbb42c75da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:20.261788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deabaa-b16e-49d3-b566-02fbb42c75da None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:20.262068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deabaa-b16e-49d3-b566-02fbb42c75da None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:20.262453 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deabaa-b16e-49d3-b566-02fbb42c75da None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:20.263190 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6deabaa-b16e-49d3-b566-02fbb42c75da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:20.263594 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6deabaa-b16e-49d3-b566-02fbb42c75da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:20.265066 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6deabaa-b16e-49d3-b566-02fbb42c75da None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:20.279534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 365/731] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:20.281133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6cfe6-f698-4251-95b5-bd06880a7550 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:20.281426 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6cfe6-f698-4251-95b5-bd06880a7550 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:20.281700 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6cfe6-f698-4251-95b5-bd06880a7550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:20.299058 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-c6d6cfe6-f698-4251-95b5-bd06880a7550 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:20.300287 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-c6d6cfe6-f698-4251-95b5-bd06880a7550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:20.368809 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb69eb-e5c0-4887-8a90-8fb0dd5c9d50 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:20.373355 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 366/732] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:19:20.374214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6cfe6-f698-4251-95b5-bd06880a7550 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:20.410001 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:20.424320 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c19ecd-60f1-4b7e-b17a-db836bc36e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:20.425000 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c19ecd-60f1-4b7e-b17a-db836bc36e7d None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:20.425287 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c19ecd-60f1-4b7e-b17a-db836bc36e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:20.426103 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c19ecd-60f1-4b7e-b17a-db836bc36e7d None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:20.426846 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c19ecd-60f1-4b7e-b17a-db836bc36e7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:20.427164 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c19ecd-60f1-4b7e-b17a-db836bc36e7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:20.428589 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c19ecd-60f1-4b7e-b17a-db836bc36e7d None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:20.441421 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 367/733] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:20.442251 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c19ecd-60f1-4b7e-b17a-db836bc36e7d None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:20.486846 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6cfe6-f698-4251-95b5-bd06880a7550 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:20.508964 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:20.527420 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61d86f-bb7c-4144-8751-b1bc2a6ded68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:20.528562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61d86f-bb7c-4144-8751-b1bc2a6ded68 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:20.529092 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61d86f-bb7c-4144-8751-b1bc2a6ded68 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:20.529568 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61d86f-bb7c-4144-8751-b1bc2a6ded68 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:20.539668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61d86f-bb7c-4144-8751-b1bc2a6ded68 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:20.541904 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61d86f-bb7c-4144-8751-b1bc2a6ded68 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:20.551933 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c19ecd-60f1-4b7e-b17a-db836bc36e7d None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:20.559386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-9b61d86f-bb7c-4144-8751-b1bc2a6ded68 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 15:19:20.559386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:20.559386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:20.559386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:20.559386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:20.559386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:20.559386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:20.559386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:20.559386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:20.559386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:20.559386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:20.559386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:20.559386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:19:20.559386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:19:20.559386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:19:20.559386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:19:20.560562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:20.560562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:20.560562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:19:20.560562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:20.560562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:19:20.560562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:20.560562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:20.560562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:20.560562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:20.560562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:20.560562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:20.560562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:20.560562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:20.560562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:20.560562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:20.560562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:20.560562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:20.560562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:20.561739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:20.561739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:20.561739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:19:20.561739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:19:20.561739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:19:20.561739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:19:20.561739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:19:20.561739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:19:20.561739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 15:19:20.561739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:20.564242 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 367/734] 10.222.0.44 () {56 vars in 1117 bytes} [Tue Jul 19 15:19:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:20.565225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61d86f-bb7c-4144-8751-b1bc2a6ded68 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:20.592980 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cae831-1ce4-4555-b019-0070a2a873e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:20.593653 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cae831-1ce4-4555-b019-0070a2a873e7 None admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:20.593959 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cae831-1ce4-4555-b019-0070a2a873e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:20.594217 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cae831-1ce4-4555-b019-0070a2a873e7 None admin] PATH_INFO: `/v3/services` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:20.594946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cae831-1ce4-4555-b019-0070a2a873e7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:20.596363 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cae831-1ce4-4555-b019-0070a2a873e7 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:20.612243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 368/735] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jul 19 15:19:20 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:19:20.613447 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cae831-1ce4-4555-b019-0070a2a873e7 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:20.670059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:20.678595 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61d86f-bb7c-4144-8751-b1bc2a6ded68 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:20.732214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790076d1-1cf0-45f5-9d37-85faad1cfbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:20.733031 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790076d1-1cf0-45f5-9d37-85faad1cfbc3 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:20.733319 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790076d1-1cf0-45f5-9d37-85faad1cfbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:20.733602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790076d1-1cf0-45f5-9d37-85faad1cfbc3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:20.741730 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cae831-1ce4-4555-b019-0070a2a873e7 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:20.741938 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790076d1-1cf0-45f5-9d37-85faad1cfbc3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:20.743424 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790076d1-1cf0-45f5-9d37-85faad1cfbc3 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:20.759601 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-790076d1-1cf0-45f5-9d37-85faad1cfbc3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 15:19:20.759601 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:20.759601 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:20.759601 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:20.759601 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:20.759601 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:20.759601 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:20.759601 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:20.759601 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:20.759601 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:20.759601 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:20.759601 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:20.759601 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:19:20.759601 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:19:20.759601 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:19:20.759601 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:19:20.760770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:20.760770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:20.760770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:19:20.760770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:20.760770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:19:20.760770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:20.760770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:20.760770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:20.760770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:20.760770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:20.760770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:20.760770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:20.760770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:20.760770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:20.760770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:20.760770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:20.760770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:20.760770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:20.761697 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:20.761697 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:20.761697 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:19:20.761697 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:19:20.761697 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:19:20.761697 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:19:20.761697 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:19:20.761697 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:19:20.761697 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 15:19:20.761697 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:20.761697 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 368/736] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:19:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:20.762373 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90efaa4-b7ef-4dce-a948-a70698032b1a None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:20.762443 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90efaa4-b7ef-4dce-a948-a70698032b1a None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:20.762716 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90efaa4-b7ef-4dce-a948-a70698032b1a None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:20.764245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 369/737] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:20.765178 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea39e46-0f54-45dc-b946-ee3586f3ac3c None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:20.765512 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea39e46-0f54-45dc-b946-ee3586f3ac3c None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:20.766005 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea39e46-0f54-45dc-b946-ee3586f3ac3c None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:20.767436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 370/738] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:20.772566 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea39e46-0f54-45dc-b946-ee3586f3ac3c None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:20.775643 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:20.797910 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb0a52-6936-4a89-a8e0-4277caf31369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:20.798684 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb0a52-6936-4a89-a8e0-4277caf31369 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:20.799434 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb0a52-6936-4a89-a8e0-4277caf31369 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:20.799434 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb0a52-6936-4a89-a8e0-4277caf31369 None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:20.800275 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb0a52-6936-4a89-a8e0-4277caf31369 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:20.800694 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb0a52-6936-4a89-a8e0-4277caf31369 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:20.802568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb0a52-6936-4a89-a8e0-4277caf31369 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:20.825214 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 369/739] 10.222.0.44 () {56 vars in 1149 bytes} [Tue Jul 19 15:19:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:20.826530 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abd513-747e-4471-8c2d-ba6728c2cf4c None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:20.826822 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abd513-747e-4471-8c2d-ba6728c2cf4c None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:20.827099 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abd513-747e-4471-8c2d-ba6728c2cf4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:20.846765 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-64abd513-747e-4471-8c2d-ba6728c2cf4c None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:20.848113 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-64abd513-747e-4471-8c2d-ba6728c2cf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:20.896178 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea39e46-0f54-45dc-b946-ee3586f3ac3c None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:20.921042 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 370/740] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:20 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:19:20.922335 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fc2ec-5337-427e-a578-32807ab5f88f None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:20.922626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fc2ec-5337-427e-a578-32807ab5f88f None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:20.922972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fc2ec-5337-427e-a578-32807ab5f88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:20.940574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f872473-a47a-41d4-811c-a7a4e037e8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:20.941775 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f872473-a47a-41d4-811c-a7a4e037e8ad None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:20.941928 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-1a4fc2ec-5337-427e-a578-32807ab5f88f None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:20.942383 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f872473-a47a-41d4-811c-a7a4e037e8ad None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:20.942814 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f872473-a47a-41d4-811c-a7a4e037e8ad None admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:20.943379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-1a4fc2ec-5337-427e-a578-32807ab5f88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:20.944338 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f872473-a47a-41d4-811c-a7a4e037e8ad None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:20.944817 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f872473-a47a-41d4-811c-a7a4e037e8ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:20.946808 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f872473-a47a-41d4-811c-a7a4e037e8ad None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:20.969033 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 371/741] 10.222.0.44 () {56 vars in 1135 bytes} [Tue Jul 19 15:19:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:20.969955 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f872473-a47a-41d4-811c-a7a4e037e8ad None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:20.983441 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:21.021064 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 371/742] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:20 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 15:19:21.022027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fc2ec-5337-427e-a578-32807ab5f88f None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:21.078044 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:21.147484 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fc2ec-5337-427e-a578-32807ab5f88f None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:21.188921 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d7dfe-1275-4dc9-a210-1a4743ed21c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:21.190438 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d7dfe-1275-4dc9-a210-1a4743ed21c1 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:21.190894 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d7dfe-1275-4dc9-a210-1a4743ed21c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:21.191833 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d7dfe-1275-4dc9-a210-1a4743ed21c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:21.196000 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f872473-a47a-41d4-811c-a7a4e037e8ad None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:21.202493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d7dfe-1275-4dc9-a210-1a4743ed21c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:19:21.210175 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-648d7dfe-1275-4dc9-a210-1a4743ed21c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:19:21.210175 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:21.210175 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:21.210175 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:21.210175 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:21.210175 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:21.210175 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:21.210175 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:21.210175 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:21.210175 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:21.210175 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:21.210175 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:21.210175 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:19:21.210175 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:19:21.210175 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:19:21.210175 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:19:21.211172 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:19:21.211172 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:19:21.211172 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:19:21.211172 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:19:21.211172 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:21.211172 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:21.211172 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:21.211172 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:21.211172 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:21.211172 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:21.211172 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:21.211172 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:21.211172 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:21.211172 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:21.211172 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:21.211172 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:21.212060 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:21.212060 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:21.212060 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:21.212060 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:21.212060 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:19:21.212060 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:19:21.212060 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:19:21.212060 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:19:21.212060 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:19:21.212060 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:19:21.212060 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:19:21.212060 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:21.212060 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 372/743] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:19:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:21.213378 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d7dfe-1275-4dc9-a210-1a4743ed21c1 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:21.234543 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81abcd-a448-4118-8a33-aee955a68dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:21.235188 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81abcd-a448-4118-8a33-aee955a68dce None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:21.235509 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81abcd-a448-4118-8a33-aee955a68dce None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:21.235785 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81abcd-a448-4118-8a33-aee955a68dce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:21.312871 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81abcd-a448-4118-8a33-aee955a68dce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:21.314324 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81abcd-a448-4118-8a33-aee955a68dce None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:21.328933 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:21.335397 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:21.339925 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d7dfe-1275-4dc9-a210-1a4743ed21c1 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:21.381642 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee55ab-6ce9-40f5-ad39-9179e639a76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:21.382334 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee55ab-6ce9-40f5-ad39-9179e639a76e None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:21.382711 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee55ab-6ce9-40f5-ad39-9179e639a76e None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:21.382994 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee55ab-6ce9-40f5-ad39-9179e639a76e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:21.433497 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 372/744] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:19:20 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:19:21.434147 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81abcd-a448-4118-8a33-aee955a68dce None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:21.463346 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee55ab-6ce9-40f5-ad39-9179e639a76e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:21.464809 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee55ab-6ce9-40f5-ad39-9179e639a76e None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:21.536559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81abcd-a448-4118-8a33-aee955a68dce None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:21.546063 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:21.571427 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:21.575416 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301ea8d-1fbc-4ca0-b13e-832cb5917d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:21.576111 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301ea8d-1fbc-4ca0-b13e-832cb5917d44 None admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:21.576401 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301ea8d-1fbc-4ca0-b13e-832cb5917d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:21.581429 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301ea8d-1fbc-4ca0-b13e-832cb5917d44 None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:21.581670 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 373/745] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:19:21 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 15:19:21.582270 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301ea8d-1fbc-4ca0-b13e-832cb5917d44 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:21.582358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee55ab-6ce9-40f5-ad39-9179e639a76e None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:21.582431 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301ea8d-1fbc-4ca0-b13e-832cb5917d44 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:21.603252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 373/746] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jul 19 15:19:21 2022] POST /identity/v3/services => generated 240 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:19:21.603252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301ea8d-1fbc-4ca0-b13e-832cb5917d44 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:21.722393 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee55ab-6ce9-40f5-ad39-9179e639a76e None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:21.744331 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301ea8d-1fbc-4ca0-b13e-832cb5917d44 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:21.766675 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14914d84-6d82-44bf-8371-5ca367ae5529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:21.767619 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14914d84-6d82-44bf-8371-5ca367ae5529 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:21.767881 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14914d84-6d82-44bf-8371-5ca367ae5529 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:21.768360 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14914d84-6d82-44bf-8371-5ca367ae5529 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:21.769604 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14914d84-6d82-44bf-8371-5ca367ae5529 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:21.769920 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14914d84-6d82-44bf-8371-5ca367ae5529 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:21.772955 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14914d84-6d82-44bf-8371-5ca367ae5529 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:21.785819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 374/747] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:19:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:21.787350 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14914d84-6d82-44bf-8371-5ca367ae5529 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:21.794389 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62eb6f-ab99-4932-b80e-acfebd5f9f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:21.795202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62eb6f-ab99-4932-b80e-acfebd5f9f68 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:21.795517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62eb6f-ab99-4932-b80e-acfebd5f9f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:21.795839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62eb6f-ab99-4932-b80e-acfebd5f9f68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:21.807284 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62eb6f-ab99-4932-b80e-acfebd5f9f68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:21.808746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62eb6f-ab99-4932-b80e-acfebd5f9f68 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:21.831040 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-8f62eb6f-ab99-4932-b80e-acfebd5f9f68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:21.831040 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:21.831040 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:21.831040 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:21.831040 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:21.831040 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:21.831040 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:21.831040 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:21.831040 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:21.831040 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:21.831040 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:21.831040 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:21.831040 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:21.831040 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:21.831040 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:21.832287 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:21.832287 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:21.832287 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:21.832287 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:21.832287 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:21.832287 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:21.832287 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:21.832287 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:21.832287 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:21.832287 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:21.832287 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:21.832287 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:21.832287 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:21.832287 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:21.832287 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:21.832287 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:21.832287 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:21.833561 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:21.833561 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:21.833561 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:21.833561 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:21.833561 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 374/748] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:21.833561 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62eb6f-ab99-4932-b80e-acfebd5f9f68 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:21.866415 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:21.871447 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:21.924267 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14914d84-6d82-44bf-8371-5ca367ae5529 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:21.969367 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d47d6-5408-4685-967c-3485e5167df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:21.970288 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d47d6-5408-4685-967c-3485e5167df6 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:21.970583 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d47d6-5408-4685-967c-3485e5167df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:21.970866 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d47d6-5408-4685-967c-3485e5167df6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:21.971651 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62eb6f-ab99-4932-b80e-acfebd5f9f68 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:21.989736 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d47d6-5408-4685-967c-3485e5167df6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:21.991211 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d47d6-5408-4685-967c-3485e5167df6 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:22.008893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-a39d47d6-5408-4685-967c-3485e5167df6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:22.008893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:22.008893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:22.008893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:22.008893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:22.008893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:22.008893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:22.008893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:22.008893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:22.008893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:22.008893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:22.008893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:22.008893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:22.008893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:22.008893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:22.009974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:22.009974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:22.009974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:22.009974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:22.009974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:22.009974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:22.009974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:22.009974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:22.009974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:22.009974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:22.009974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:22.009974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:22.009974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:22.009974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:22.009974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:22.009974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:22.009974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:22.010933 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:22.010933 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:22.010933 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:22.010933 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:22.010933 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 375/749] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:22.010933 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d47d6-5408-4685-967c-3485e5167df6 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:22.013257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361ec22-74b7-4803-b24c-9e14a2cb948c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:22.014241 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361ec22-74b7-4803-b24c-9e14a2cb948c None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:22.014710 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361ec22-74b7-4803-b24c-9e14a2cb948c None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:22.015063 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361ec22-74b7-4803-b24c-9e14a2cb948c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:22.027441 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361ec22-74b7-4803-b24c-9e14a2cb948c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:22.029111 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361ec22-74b7-4803-b24c-9e14a2cb948c None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:22.048167 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-6361ec22-74b7-4803-b24c-9e14a2cb948c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:22.048167 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:22.048167 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:22.048167 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:22.048167 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:22.048167 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:22.048167 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:22.048167 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:22.048167 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:22.048167 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:22.048167 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:22.048167 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:22.048167 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:22.048167 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:22.048167 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:22.049912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:22.049912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:22.049912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:22.049912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:22.049912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:22.049912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:22.049912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:22.049912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:22.049912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:22.049912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:22.049912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:22.049912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:22.049912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:22.049912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:22.049912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:22.049912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:22.049912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:22.052613 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:22.052613 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:22.052613 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:22.052613 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:22.052613 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 375/750] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:22.052613 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361ec22-74b7-4803-b24c-9e14a2cb948c None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:22.115742 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d47d6-5408-4685-967c-3485e5167df6 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:22.124115 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:22.130755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:22.153972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf245db-2cf9-4f87-ac82-632c8b0d5974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:22.154815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf245db-2cf9-4f87-ac82-632c8b0d5974 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:22.155485 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf245db-2cf9-4f87-ac82-632c8b0d5974 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:22.155865 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf245db-2cf9-4f87-ac82-632c8b0d5974 None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:22.156700 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf245db-2cf9-4f87-ac82-632c8b0d5974 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:22.157291 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf245db-2cf9-4f87-ac82-632c8b0d5974 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:22.158777 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf245db-2cf9-4f87-ac82-632c8b0d5974 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:22.164491 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361ec22-74b7-4803-b24c-9e14a2cb948c None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:22.172052 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 376/751] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:22.173049 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf245db-2cf9-4f87-ac82-632c8b0d5974 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:22.202199 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67126f4-abf0-4e6b-b1cd-8d306a1ca4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:22.202969 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67126f4-abf0-4e6b-b1cd-8d306a1ca4df None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:22.203284 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67126f4-abf0-4e6b-b1cd-8d306a1ca4df None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:22.203566 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67126f4-abf0-4e6b-b1cd-8d306a1ca4df None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:22.204300 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67126f4-abf0-4e6b-b1cd-8d306a1ca4df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:22.204612 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67126f4-abf0-4e6b-b1cd-8d306a1ca4df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:22.206159 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67126f4-abf0-4e6b-b1cd-8d306a1ca4df None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:22.219472 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 376/752] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:22.220340 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67126f4-abf0-4e6b-b1cd-8d306a1ca4df None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:22.277440 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf245db-2cf9-4f87-ac82-632c8b0d5974 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:22.313599 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8dc72a-5919-4617-a537-9341fed2513d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:22.314275 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dc72a-5919-4617-a537-9341fed2513d None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:22.314562 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dc72a-5919-4617-a537-9341fed2513d None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:22.314841 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dc72a-5919-4617-a537-9341fed2513d None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:22.315604 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8dc72a-5919-4617-a537-9341fed2513d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:22.316440 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8dc72a-5919-4617-a537-9341fed2513d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:22.317825 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8dc72a-5919-4617-a537-9341fed2513d None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:22.329853 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67126f4-abf0-4e6b-b1cd-8d306a1ca4df None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:22.330127 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 377/753] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:22.330694 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8dc72a-5919-4617-a537-9341fed2513d None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:22.359328 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:22.364086 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:22.370080 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494bfb6-73d0-42ee-a007-5e9da49a1e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:22.371199 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494bfb6-73d0-42ee-a007-5e9da49a1e90 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:22.371693 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494bfb6-73d0-42ee-a007-5e9da49a1e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:22.372184 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494bfb6-73d0-42ee-a007-5e9da49a1e90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:22.380390 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494bfb6-73d0-42ee-a007-5e9da49a1e90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:22.382045 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494bfb6-73d0-42ee-a007-5e9da49a1e90 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:22.397629 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-c494bfb6-73d0-42ee-a007-5e9da49a1e90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:22.397629 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:22.397629 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:22.397629 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:22.397629 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:22.397629 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:22.397629 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:22.397629 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:22.397629 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:22.397629 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:22.397629 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:22.397629 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:22.397629 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:19:22.397629 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:19:22.397629 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:19:22.398746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:19:22.398746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:22.398746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:22.398746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:22.398746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:22.398746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:22.398746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:22.398746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:22.398746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:22.398746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:22.398746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:22.398746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:22.398746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:22.398746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:22.398746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:22.398746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:22.398746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:22.399795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:19:22.399795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:19:22.399795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:19:22.399795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:19:22.399795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:19:22.399795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:19:22.399795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:22.399795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:22.401846 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 377/754] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:19:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:22.402863 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494bfb6-73d0-42ee-a007-5e9da49a1e90 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:22.438485 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8dc72a-5919-4617-a537-9341fed2513d None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:22.474058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e2468-7022-47b9-aa4b-d128ef146d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:22.474861 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e2468-7022-47b9-aa4b-d128ef146d39 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:22.475150 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e2468-7022-47b9-aa4b-d128ef146d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:22.475468 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e2468-7022-47b9-aa4b-d128ef146d39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:22.483198 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e2468-7022-47b9-aa4b-d128ef146d39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:22.484122 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e2468-7022-47b9-aa4b-d128ef146d39 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:22.499368 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-c85e2468-7022-47b9-aa4b-d128ef146d39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:22.499368 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:22.499368 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:22.499368 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:22.499368 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:22.499368 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:22.499368 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:22.499368 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:22.499368 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:22.499368 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:22.499368 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:22.499368 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:22.499368 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:19:22.499368 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:19:22.499368 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:19:22.500335 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:19:22.500335 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:22.500335 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:22.500335 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:22.500335 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:22.500335 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:22.500335 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:22.500335 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:22.500335 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:22.500335 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:22.500335 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:22.500335 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:22.500335 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:22.500335 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:22.500335 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:22.500335 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:22.500335 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:22.501232 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:19:22.501232 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:19:22.501232 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:19:22.501232 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:19:22.501232 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:19:22.501232 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:19:22.501232 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:22.501232 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:22.501232 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 378/755] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:19:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:22.501722 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e2468-7022-47b9-aa4b-d128ef146d39 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:22.518064 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494bfb6-73d0-42ee-a007-5e9da49a1e90 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:22.554262 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160fdf5-616f-4a51-9d2b-158374ef77ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:22.555345 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160fdf5-616f-4a51-9d2b-158374ef77ec None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:22.555783 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160fdf5-616f-4a51-9d2b-158374ef77ec None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:22.556201 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160fdf5-616f-4a51-9d2b-158374ef77ec None admin] PATH_INFO: `/v3/users/nova` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:22.564217 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5160fdf5-616f-4a51-9d2b-158374ef77ec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:22.565835 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5160fdf5-616f-4a51-9d2b-158374ef77ec None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:22.580332 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-5160fdf5-616f-4a51-9d2b-158374ef77ec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:19:22.580332 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:22.580332 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:22.580332 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:22.580332 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:22.580332 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:22.580332 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:22.580332 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:22.580332 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:22.580332 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:22.580332 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:22.580332 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:22.580332 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:19:22.580332 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:19:22.580332 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:19:22.580332 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:19:22.581317 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:22.581317 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:22.581317 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:19:22.581317 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:22.581317 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:19:22.581317 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:22.581317 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:22.581317 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:22.581317 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:22.581317 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:22.581317 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:22.581317 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:22.581317 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:22.581317 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:22.581317 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:22.581317 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:22.581317 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:22.581317 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:22.582344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:22.582344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:22.582344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:19:22.582344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:19:22.582344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:19:22.582344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:19:22.582344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:19:22.582344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:19:22.582344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:19:22.582344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:22.585013 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 378/756] 10.222.0.44 () {56 vars in 1093 bytes} [Tue Jul 19 15:19:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:22.586144 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160fdf5-616f-4a51-9d2b-158374ef77ec None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:22.596862 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:22.607793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e2468-7022-47b9-aa4b-d128ef146d39 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:22.638212 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:22.648572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2e1a2-74ec-4907-981c-85e62f0cffd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:22.649293 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2e1a2-74ec-4907-981c-85e62f0cffd8 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:22.649588 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2e1a2-74ec-4907-981c-85e62f0cffd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:22.649870 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2e1a2-74ec-4907-981c-85e62f0cffd8 None admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:22.650780 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2e1a2-74ec-4907-981c-85e62f0cffd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:22.651098 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2e1a2-74ec-4907-981c-85e62f0cffd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:22.652669 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2e1a2-74ec-4907-981c-85e62f0cffd8 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:22.666287 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 379/757] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:19:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:22.667164 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2e1a2-74ec-4907-981c-85e62f0cffd8 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:22.694348 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160fdf5-616f-4a51-9d2b-158374ef77ec None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:22.729383 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb317d17-e7b2-489a-a4c6-ab3106efb980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:22.730421 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb317d17-e7b2-489a-a4c6-ab3106efb980 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:22.730932 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb317d17-e7b2-489a-a4c6-ab3106efb980 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:22.731452 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb317d17-e7b2-489a-a4c6-ab3106efb980 None admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:22.732448 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb317d17-e7b2-489a-a4c6-ab3106efb980 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:22.732963 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb317d17-e7b2-489a-a4c6-ab3106efb980 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:22.734587 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb317d17-e7b2-489a-a4c6-ab3106efb980 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:22.748270 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 379/758] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:19:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:22.749442 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb317d17-e7b2-489a-a4c6-ab3106efb980 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:22.777517 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2e1a2-74ec-4907-981c-85e62f0cffd8 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:22.813320 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8850c0-cb1d-473d-93be-e78a92fa5056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:22.814003 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8850c0-cb1d-473d-93be-e78a92fa5056 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:22.814287 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8850c0-cb1d-473d-93be-e78a92fa5056 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:22.814780 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8850c0-cb1d-473d-93be-e78a92fa5056 None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:22.815432 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8850c0-cb1d-473d-93be-e78a92fa5056 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:22.815737 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8850c0-cb1d-473d-93be-e78a92fa5056 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:22.817196 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8850c0-cb1d-473d-93be-e78a92fa5056 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:22.837929 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 380/759] 10.222.0.44 () {56 vars in 1133 bytes} [Tue Jul 19 15:19:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:22.837929 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d7804-dcb8-4c47-8113-470638067150 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:22.837929 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d7804-dcb8-4c47-8113-470638067150 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:22.837929 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d7804-dcb8-4c47-8113-470638067150 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:22.839271 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 381/760] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:22.839975 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d7804-dcb8-4c47-8113-470638067150 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:22.864658 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:22.868348 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb317d17-e7b2-489a-a4c6-ab3106efb980 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:22.879602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:22.909666 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a8bf9-e8ec-4de1-8d98-cd8ca188b4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:22.910854 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a8bf9-e8ec-4de1-8d98-cd8ca188b4e9 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:22.911251 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a8bf9-e8ec-4de1-8d98-cd8ca188b4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:22.911504 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a8bf9-e8ec-4de1-8d98-cd8ca188b4e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:22.912270 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a8bf9-e8ec-4de1-8d98-cd8ca188b4e9 None admin] RBAC: Adding query filter params (role.id=1ff62289fb434d09a13001c3ffbab080, scope.project.id=c54934775a86487295bdbc02ed3a0103, user.id=cea1d8409c754ec797d6c694481a3112) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:22.912566 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a8bf9-e8ec-4de1-8d98-cd8ca188b4e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:22.913986 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a8bf9-e8ec-4de1-8d98-cd8ca188b4e9 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:22.931590 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 380/761] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:19:22 2022] GET /identity/v3/role_assignments?user.id=cea1d8409c754ec797d6c694481a3112&scope.project.id=c54934775a86487295bdbc02ed3a0103&role.id=1ff62289fb434d09a13001c3ffbab080 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:22.932449 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a8bf9-e8ec-4de1-8d98-cd8ca188b4e9 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:22.973634 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d7804-dcb8-4c47-8113-470638067150 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:23.012853 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40185db2-2b9e-4647-b243-9c3faabae6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:23.013752 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40185db2-2b9e-4647-b243-9c3faabae6e9 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:23.013867 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40185db2-2b9e-4647-b243-9c3faabae6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:23.014077 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40185db2-2b9e-4647-b243-9c3faabae6e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:23.015003 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40185db2-2b9e-4647-b243-9c3faabae6e9 None admin] RBAC: Adding query filter params (role.id=d884ddf33c1440d9b3a3351b85e83e76, scope.project.id=c54934775a86487295bdbc02ed3a0103, user.id=bd1dceaddb6e414faef0e0448cdf1be8) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:23.015370 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40185db2-2b9e-4647-b243-9c3faabae6e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:23.016884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40185db2-2b9e-4647-b243-9c3faabae6e9 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:23.026215 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 382/762] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:19:22 2022] GET /identity/v3/role_assignments?user.id=bd1dceaddb6e414faef0e0448cdf1be8&scope.project.id=c54934775a86487295bdbc02ed3a0103&role.id=d884ddf33c1440d9b3a3351b85e83e76 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:23.027960 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6efae-4344-49d1-afd8-4cad25dcd14d None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:23.028465 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6efae-4344-49d1-afd8-4cad25dcd14d None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:23.028970 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6efae-4344-49d1-afd8-4cad25dcd14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:23.051318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-ceb6efae-4344-49d1-afd8-4cad25dcd14d None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:23.052948 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-ceb6efae-4344-49d1-afd8-4cad25dcd14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:23.135425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a8bf9-e8ec-4de1-8d98-cd8ca188b4e9 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:23.156687 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 383/763] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:19:23.181682 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d06b5b-a20d-4fad-bbcc-49d2e62ea18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:23.182870 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d06b5b-a20d-4fad-bbcc-49d2e62ea18f None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:23.183415 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d06b5b-a20d-4fad-bbcc-49d2e62ea18f None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:23.183899 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d06b5b-a20d-4fad-bbcc-49d2e62ea18f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:23.196545 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6efae-4344-49d1-afd8-4cad25dcd14d None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:23.206444 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:23.212956 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d06b5b-a20d-4fad-bbcc-49d2e62ea18f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:23.215145 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d06b5b-a20d-4fad-bbcc-49d2e62ea18f None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:23.239975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-79d06b5b-a20d-4fad-bbcc-49d2e62ea18f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:23.239975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:23.239975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:23.239975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:23.239975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:23.239975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:23.239975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:23.239975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:23.239975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:23.239975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:23.239975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:23.239975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:23.239975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:23.239975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:23.239975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:23.240939 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:23.240939 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:23.240939 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:23.240939 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:23.240939 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:23.240939 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:23.240939 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:23.240939 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:23.240939 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:23.240939 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:23.240939 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:23.240939 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:23.240939 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:23.240939 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:23.240939 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:23.240939 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:23.240939 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:23.241855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:23.241855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:23.241855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:23.241855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:23.246468 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 381/764] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:23.248662 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d06b5b-a20d-4fad-bbcc-49d2e62ea18f None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:23.279044 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:23.343684 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6efae-4344-49d1-afd8-4cad25dcd14d None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:23.364836 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d06b5b-a20d-4fad-bbcc-49d2e62ea18f None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:23.380915 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dcf42-5bd9-4476-8108-35d81640d7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:23.381727 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dcf42-5bd9-4476-8108-35d81640d7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:23.382107 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dcf42-5bd9-4476-8108-35d81640d7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:23.382389 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dcf42-5bd9-4476-8108-35d81640d7a7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:23.383157 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961dcf42-5bd9-4476-8108-35d81640d7a7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:23.384555 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961dcf42-5bd9-4476-8108-35d81640d7a7 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:23.407928 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-961dcf42-5bd9-4476-8108-35d81640d7a7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 15:19:23.407928 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:23.407928 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:19:23.407928 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:19:23.407928 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:19:23.407928 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:19:23.407928 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:19:23.407928 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:23.407928 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 15:19:23.407928 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:23.407928 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:19:23.407928 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:23.407928 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:23.407928 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:23.407928 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:23.407928 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:23.408927 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:23.408927 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:23.408927 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:23.408927 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:23.408927 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:23.408927 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:23.408927 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:23.408927 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:19:23.408927 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:19:23.408927 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:19:23.408927 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:19:23.408927 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:23.408927 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:23.408927 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:23.408927 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:23.408927 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:23.410347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:23.410347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:23.410347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:23.410347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:23.410347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:23.410347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:23.410347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:23.410347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:23.410347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:23.410347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:23.410347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:23.410347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:19:23.410347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:23.410347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 15:19:23.410347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:23.411145 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12b5a8-d2a3-40a1-bf99-84e65a7c6a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:23.411145 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12b5a8-d2a3-40a1-bf99-84e65a7c6a2a None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:23.413802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12b5a8-d2a3-40a1-bf99-84e65a7c6a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:23.413802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12b5a8-d2a3-40a1-bf99-84e65a7c6a2a None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:23.413802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12b5a8-d2a3-40a1-bf99-84e65a7c6a2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:23.413802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12b5a8-d2a3-40a1-bf99-84e65a7c6a2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:23.414537 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 384/765] 10.222.0.44 () {56 vars in 1129 bytes} [Tue Jul 19 15:19:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:23.414948 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12b5a8-d2a3-40a1-bf99-84e65a7c6a2a None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:23.420934 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dcf42-5bd9-4476-8108-35d81640d7a7 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:23.442005 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 382/766] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:23.447504 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12b5a8-d2a3-40a1-bf99-84e65a7c6a2a None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:23.543092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:23.547291 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:23.576872 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12b5a8-d2a3-40a1-bf99-84e65a7c6a2a None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:23.606207 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dcf42-5bd9-4476-8108-35d81640d7a7 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:23.646583 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba2680-7fee-4731-b197-2e97532f8e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:23.647404 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba2680-7fee-4731-b197-2e97532f8e96 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:23.647689 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba2680-7fee-4731-b197-2e97532f8e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:23.647962 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba2680-7fee-4731-b197-2e97532f8e96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:23.653131 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448033a-c2ec-4b2f-a25f-cb43535ac6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:23.653796 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448033a-c2ec-4b2f-a25f-cb43535ac6a4 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:23.654078 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448033a-c2ec-4b2f-a25f-cb43535ac6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:23.654355 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448033a-c2ec-4b2f-a25f-cb43535ac6a4 None admin] PATH_INFO: `/v3/services` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:23.655359 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448033a-c2ec-4b2f-a25f-cb43535ac6a4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:23.655668 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448033a-c2ec-4b2f-a25f-cb43535ac6a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:23.657027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448033a-c2ec-4b2f-a25f-cb43535ac6a4 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:23.664235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba2680-7fee-4731-b197-2e97532f8e96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:23.665773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba2680-7fee-4731-b197-2e97532f8e96 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:23.668330 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 385/767] 10.222.0.44 () {56 vars in 1124 bytes} [Tue Jul 19 15:19:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:23.673895 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448033a-c2ec-4b2f-a25f-cb43535ac6a4 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:23.687119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-50ba2680-7fee-4731-b197-2e97532f8e96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:23.687119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:23.687119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:23.687119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:23.687119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:23.687119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:23.687119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:23.687119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:23.687119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:23.687119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:23.687119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:23.687119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:23.687119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:19:23.687119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:19:23.687119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:19:23.688090 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:19:23.688090 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:23.688090 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:23.688090 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:23.688090 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:23.688090 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:23.688090 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:23.688090 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:23.688090 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:23.688090 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:23.688090 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:23.688090 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:23.688090 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:23.688090 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:23.688090 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:23.688090 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:23.688090 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:23.688981 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:19:23.688981 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:19:23.688981 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:19:23.688981 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:19:23.688981 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:19:23.688981 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:19:23.688981 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:23.688981 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:23.692584 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 383/768] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:19:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:23.698114 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba2680-7fee-4731-b197-2e97532f8e96 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:23.884643 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba2680-7fee-4731-b197-2e97532f8e96 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:23.889856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448033a-c2ec-4b2f-a25f-cb43535ac6a4 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:23.926669 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:23.932339 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfbf085-3831-47f0-9f59-d5f6e3a4ab95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:23.933085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf4fac-8e4f-43fb-8721-f2de340ad31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:23.933234 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbf085-3831-47f0-9f59-d5f6e3a4ab95 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:23.933410 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbf085-3831-47f0-9f59-d5f6e3a4ab95 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:23.933668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbf085-3831-47f0-9f59-d5f6e3a4ab95 None admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:23.933772 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf4fac-8e4f-43fb-8721-f2de340ad31b None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:23.934023 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf4fac-8e4f-43fb-8721-f2de340ad31b None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:23.934305 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf4fac-8e4f-43fb-8721-f2de340ad31b None admin] PATH_INFO: `/v3/services` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:23.934527 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfbf085-3831-47f0-9f59-d5f6e3a4ab95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:23.934847 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfbf085-3831-47f0-9f59-d5f6e3a4ab95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:23.935021 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf4fac-8e4f-43fb-8721-f2de340ad31b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:23.935365 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf4fac-8e4f-43fb-8721-f2de340ad31b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:23.936404 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfbf085-3831-47f0-9f59-d5f6e3a4ab95 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:23.936721 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf4fac-8e4f-43fb-8721-f2de340ad31b None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:23.943241 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 386/769] 10.222.0.44 () {56 vars in 1124 bytes} [Tue Jul 19 15:19:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:23.944493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e210df7-f2f1-43fc-8777-85a0317fa305 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:23.944789 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e210df7-f2f1-43fc-8777-85a0317fa305 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:23.945072 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e210df7-f2f1-43fc-8777-85a0317fa305 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:23.950674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 387/770] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:23.951613 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e210df7-f2f1-43fc-8777-85a0317fa305 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:23.957495 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 384/771] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:19:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:23.958875 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61a46d-af7f-4090-af39-4cc69c0a974b None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:23.959270 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61a46d-af7f-4090-af39-4cc69c0a974b None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:23.959565 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61a46d-af7f-4090-af39-4cc69c0a974b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:23.966364 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:23.980855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-3d61a46d-af7f-4090-af39-4cc69c0a974b None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:23.982593 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-3d61a46d-af7f-4090-af39-4cc69c0a974b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:24.072235 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e210df7-f2f1-43fc-8777-85a0317fa305 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:24.083336 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 385/772] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:19:24.084316 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61a46d-af7f-4090-af39-4cc69c0a974b None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:24.112162 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b7454-62e2-4459-bdff-6315d65da593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:24.113178 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b7454-62e2-4459-bdff-6315d65da593 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:24.113490 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b7454-62e2-4459-bdff-6315d65da593 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:24.114242 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b7454-62e2-4459-bdff-6315d65da593 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:24.115407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b7454-62e2-4459-bdff-6315d65da593 None admin] RBAC: Adding query filter params (interface=public, service_id=23b5240573c34a6fa2e424bd228c1f34, region_id=RegionOne) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:24.115727 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b7454-62e2-4459-bdff-6315d65da593 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:24.117762 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b7454-62e2-4459-bdff-6315d65da593 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:24.129338 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 388/773] 10.222.0.44 () {56 vars in 1251 bytes} [Tue Jul 19 15:19:23 2022] GET /identity/v3/endpoints?service_id=23b5240573c34a6fa2e424bd228c1f34&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:24.134555 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b7454-62e2-4459-bdff-6315d65da593 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:24.206223 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:24.210517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61a46d-af7f-4090-af39-4cc69c0a974b None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:24.252749 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b7454-62e2-4459-bdff-6315d65da593 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:24.253014 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6b7b0-f898-44e5-a106-38a9f772f34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:24.254003 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6b7b0-f898-44e5-a106-38a9f772f34e None admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:24.254288 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6b7b0-f898-44e5-a106-38a9f772f34e None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:24.254670 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6b7b0-f898-44e5-a106-38a9f772f34e None admin] PATH_INFO: `/v3/projects/c54934775a86487295bdbc02ed3a0103/users/fef0511f56144ca9945b2dddfa2601a2/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:24.257836 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6b7b0-f898-44e5-a106-38a9f772f34e None admin] RBAC: Authorizing `identity:create_grant(project_id=c54934775a86487295bdbc02ed3a0103, user_id=fef0511f56144ca9945b2dddfa2601a2, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:24.259314 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6b7b0-f898-44e5-a106-38a9f772f34e None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:24.261686 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:24.277042 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 386/774] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 19 15:19:24 2022] PUT /identity/v3/projects/c54934775a86487295bdbc02ed3a0103/users/fef0511f56144ca9945b2dddfa2601a2/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:19:24.277985 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6b7b0-f898-44e5-a106-38a9f772f34e None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:24.292823 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f920a-f942-4f4c-a246-2a55e72beaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:24.293830 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f920a-f942-4f4c-a246-2a55e72beaa5 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:24.294235 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f920a-f942-4f4c-a246-2a55e72beaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:24.294614 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f920a-f942-4f4c-a246-2a55e72beaa5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:24.295407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f920a-f942-4f4c-a246-2a55e72beaa5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:24.296935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f920a-f942-4f4c-a246-2a55e72beaa5 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:24.309957 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-c73f920a-f942-4f4c-a246-2a55e72beaa5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 15:19:24.309957 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:24.309957 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:19:24.309957 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:19:24.309957 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:19:24.309957 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:19:24.309957 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:19:24.309957 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:24.309957 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 15:19:24.309957 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:24.309957 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:19:24.309957 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:24.309957 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:24.309957 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:24.309957 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:24.309957 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:24.309957 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:24.311481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:24.311481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:24.311481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:24.311481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:24.311481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:24.311481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:24.311481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:19:24.311481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:19:24.311481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:19:24.311481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:19:24.311481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:24.311481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:24.311481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:24.311481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:24.311481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:24.311481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:24.313347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:24.313347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:24.313347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:24.313347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:24.313347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:24.313347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:24.313347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:24.313347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:24.313347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:24.313347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:24.313347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:19:24.313347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:24.313347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 15:19:24.313347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:24.313347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 389/775] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:19:24 2022] GET /identity/v3/services/network => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:24.324245 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f920a-f942-4f4c-a246-2a55e72beaa5 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:24.403297 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6b7b0-f898-44e5-a106-38a9f772f34e None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:24.442688 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb40c68-0de8-48fa-a96a-bf6c2cc15d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:24.443396 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb40c68-0de8-48fa-a96a-bf6c2cc15d70 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:24.443683 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb40c68-0de8-48fa-a96a-bf6c2cc15d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:24.443956 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb40c68-0de8-48fa-a96a-bf6c2cc15d70 None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:24.444762 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb40c68-0de8-48fa-a96a-bf6c2cc15d70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:24.446154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb40c68-0de8-48fa-a96a-bf6c2cc15d70 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:24.452521 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 387/776] 10.222.0.44 () {56 vars in 1087 bytes} [Tue Jul 19 15:19:24 2022] GET /identity/v3/services => generated 772 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:24.505062 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f920a-f942-4f4c-a246-2a55e72beaa5 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:24.532905 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:24.545477 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00174a59-b71f-4221-bb9c-254b2b728bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:24.546167 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00174a59-b71f-4221-bb9c-254b2b728bdf None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:24.546454 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00174a59-b71f-4221-bb9c-254b2b728bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:24.546734 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00174a59-b71f-4221-bb9c-254b2b728bdf None admin] PATH_INFO: `/v3/services` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:24.547493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00174a59-b71f-4221-bb9c-254b2b728bdf None admin] RBAC: Adding query filter params (name=network) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:24.547807 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00174a59-b71f-4221-bb9c-254b2b728bdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:24.549209 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00174a59-b71f-4221-bb9c-254b2b728bdf None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:24.554938 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 390/777] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jul 19 15:19:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:24.561805 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb40c68-0de8-48fa-a96a-bf6c2cc15d70 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:24.631699 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:24.682101 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb40c68-0de8-48fa-a96a-bf6c2cc15d70 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:24.717449 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada3a31-d182-460b-b16f-91d983d46f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:24.718364 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada3a31-d182-460b-b16f-91d983d46f3e None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:24.718801 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada3a31-d182-460b-b16f-91d983d46f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:24.719251 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada3a31-d182-460b-b16f-91d983d46f3e None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:24.720112 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada3a31-d182-460b-b16f-91d983d46f3e None admin] RBAC: Adding query filter params (type=network) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:24.720595 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada3a31-d182-460b-b16f-91d983d46f3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:24.722637 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada3a31-d182-460b-b16f-91d983d46f3e None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:24.732729 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 388/778] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jul 19 15:19:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:24.734300 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00174a59-b71f-4221-bb9c-254b2b728bdf None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:24.843123 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00174a59-b71f-4221-bb9c-254b2b728bdf None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:24.888103 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93691c2b-2352-49c3-b5b6-edc247d7841c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:24.888767 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93691c2b-2352-49c3-b5b6-edc247d7841c None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:24.889051 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93691c2b-2352-49c3-b5b6-edc247d7841c None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:24.889326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93691c2b-2352-49c3-b5b6-edc247d7841c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:24.890121 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93691c2b-2352-49c3-b5b6-edc247d7841c None admin] RBAC: Adding query filter params (interface=public, service_id=1ca61018048447769af55e02a49204b7, region_id=RegionOne) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:24.890436 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93691c2b-2352-49c3-b5b6-edc247d7841c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:24.891829 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93691c2b-2352-49c3-b5b6-edc247d7841c None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:24.902417 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 391/779] 10.222.0.44 () {56 vars in 1251 bytes} [Tue Jul 19 15:19:24 2022] GET /identity/v3/endpoints?service_id=1ca61018048447769af55e02a49204b7&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:24.908020 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada3a31-d182-460b-b16f-91d983d46f3e None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:25.020912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada3a31-d182-460b-b16f-91d983d46f3e None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:25.045344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:25.058983 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f126cc-f9aa-48f8-9afe-23b833f548c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:25.059696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f126cc-f9aa-48f8-9afe-23b833f548c4 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:25.059989 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f126cc-f9aa-48f8-9afe-23b833f548c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:25.060271 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f126cc-f9aa-48f8-9afe-23b833f548c4 None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:25.060968 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f126cc-f9aa-48f8-9afe-23b833f548c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:25.062402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f126cc-f9aa-48f8-9afe-23b833f548c4 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:25.072636 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 389/780] 10.222.0.44 () {56 vars in 1087 bytes} [Tue Jul 19 15:19:24 2022] GET /identity/v3/services => generated 772 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:25.428180 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f54a4-2937-4df7-b725-c3dac4d31e5c None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:25.428586 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f54a4-2937-4df7-b725-c3dac4d31e5c None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:25.428770 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f54a4-2937-4df7-b725-c3dac4d31e5c None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:25.429534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f236117-9e0d-43b0-ae6d-23b9cde51dff None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:25.430365 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f236117-9e0d-43b0-ae6d-23b9cde51dff None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:25.430472 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 392/781] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:25.430958 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f236117-9e0d-43b0-ae6d-23b9cde51dff None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:25.432823 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 390/782] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:25.437536 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ddcad-6e04-47c5-86e9-97ca0cec78b6 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:25.437826 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ddcad-6e04-47c5-86e9-97ca0cec78b6 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:25.438101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ddcad-6e04-47c5-86e9-97ca0cec78b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:25.440678 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313de954-e4e4-41ac-9ff5-661b3cedd290 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:25.441495 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313de954-e4e4-41ac-9ff5-661b3cedd290 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:25.441778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313de954-e4e4-41ac-9ff5-661b3cedd290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:25.461701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-313de954-e4e4-41ac-9ff5-661b3cedd290 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:25.462923 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-313de954-e4e4-41ac-9ff5-661b3cedd290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:25.466250 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-778ddcad-6e04-47c5-86e9-97ca0cec78b6 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:25.467455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-778ddcad-6e04-47c5-86e9-97ca0cec78b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:25.556291 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:25.580095 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 393/783] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:19:25.585277 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 391/784] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:19:25.602099 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ddcad-6e04-47c5-86e9-97ca0cec78b6 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:25.608078 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313de954-e4e4-41ac-9ff5-661b3cedd290 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:25.786048 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ddcad-6e04-47c5-86e9-97ca0cec78b6 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:25.791601 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313de954-e4e4-41ac-9ff5-661b3cedd290 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:25.812783 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:25.852106 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125d76b-87a5-4d75-915a-f3c2b932b807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:25.853092 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701314be-5d26-43f7-ab16-b2f5e61f6bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:25.854154 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125d76b-87a5-4d75-915a-f3c2b932b807 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:25.855154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701314be-5d26-43f7-ab16-b2f5e61f6bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:25.855728 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125d76b-87a5-4d75-915a-f3c2b932b807 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:25.855944 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125d76b-87a5-4d75-915a-f3c2b932b807 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:25.861951 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701314be-5d26-43f7-ab16-b2f5e61f6bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:25.861951 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701314be-5d26-43f7-ab16-b2f5e61f6bb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:25.875121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701314be-5d26-43f7-ab16-b2f5e61f6bb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:19:25.876304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125d76b-87a5-4d75-915a-f3c2b932b807 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:19:25.883600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-701314be-5d26-43f7-ab16-b2f5e61f6bb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:19:25.883600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:25.883600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:25.883600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:25.883600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:25.883600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:25.883600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:25.883600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:25.883600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:25.883600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:25.883600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:25.883600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:25.883600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:19:25.883600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:19:25.883600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:19:25.883600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:19:25.884574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:19:25.884574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:19:25.884574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:19:25.884574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:19:25.884574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:25.884574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:25.884574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:25.884574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:25.884574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:25.884574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:25.884574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:25.884574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:25.884574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:25.884574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:25.884574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:25.884574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:25.890730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:25.890730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:25.890730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:25.890730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:25.890730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:19:25.890730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:19:25.890730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:19:25.890730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:19:25.890730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:19:25.890730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:19:25.890730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:19:25.890730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:25.890730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 392/785] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:19:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:19:25.891500 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701314be-5d26-43f7-ab16-b2f5e61f6bb9 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:25.892865 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-3125d76b-87a5-4d75-915a-f3c2b932b807 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:19:25.892865 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:25.892865 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:25.892865 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:25.892865 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:25.892865 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:25.892865 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:25.892865 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:25.892865 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:25.892865 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:25.892865 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:25.892865 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:25.892865 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:19:25.892865 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:19:25.892865 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:19:25.892865 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:19:25.893775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:19:25.893775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:19:25.893775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:19:25.893775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:19:25.893775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:25.893775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:25.893775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:25.893775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:25.893775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:25.893775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:25.893775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:25.893775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:25.893775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:25.893775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:25.893775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:25.893775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:25.895189 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:25.895189 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:25.895189 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:25.895189 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:25.895189 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:19:25.895189 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:19:25.895189 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:19:25.895189 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:19:25.895189 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:19:25.895189 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:19:25.895189 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:19:25.895189 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:25.902883 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 394/786] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 19 15:19:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:25.904341 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125d76b-87a5-4d75-915a-f3c2b932b807 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:25.979140 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:26.045002 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125d76b-87a5-4d75-915a-f3c2b932b807 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:26.082452 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fc852-d036-43ce-a71f-5aaeb94c14b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:26.083257 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fc852-d036-43ce-a71f-5aaeb94c14b6 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:26.083559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fc852-d036-43ce-a71f-5aaeb94c14b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:26.083839 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fc852-d036-43ce-a71f-5aaeb94c14b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:26.084593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5fc852-d036-43ce-a71f-5aaeb94c14b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:26.084904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5fc852-d036-43ce-a71f-5aaeb94c14b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:26.086275 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5fc852-d036-43ce-a71f-5aaeb94c14b6 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:26.095128 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 395/787] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 19 15:19:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:26.100909 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fc852-d036-43ce-a71f-5aaeb94c14b6 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:26.102116 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701314be-5d26-43f7-ab16-b2f5e61f6bb9 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:26.188861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b614354-3ff3-4907-876b-a323e553f432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:26.189542 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b614354-3ff3-4907-876b-a323e553f432 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:26.189829 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b614354-3ff3-4907-876b-a323e553f432 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:26.190109 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b614354-3ff3-4907-876b-a323e553f432 None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:26.191421 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b614354-3ff3-4907-876b-a323e553f432 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:26.191735 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b614354-3ff3-4907-876b-a323e553f432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:26.193086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b614354-3ff3-4907-876b-a323e553f432 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:26.211092 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 393/788] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:19:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:26.221739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fc852-d036-43ce-a71f-5aaeb94c14b6 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:26.225118 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:26.225933 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b614354-3ff3-4907-876b-a323e553f432 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:26.276198 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93688896-9e3e-4e73-8475-85befc2c1fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:26.277063 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93688896-9e3e-4e73-8475-85befc2c1fca None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:26.277452 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93688896-9e3e-4e73-8475-85befc2c1fca None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:26.277743 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93688896-9e3e-4e73-8475-85befc2c1fca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:26.283583 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:26.300348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93688896-9e3e-4e73-8475-85befc2c1fca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:26.308631 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93688896-9e3e-4e73-8475-85befc2c1fca None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:26.343868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-93688896-9e3e-4e73-8475-85befc2c1fca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:26.343868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:26.343868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:26.343868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:26.343868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:26.343868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:26.343868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:26.343868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:26.343868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:26.343868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:26.343868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:26.343868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:26.343868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:26.343868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:26.343868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:26.344828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:26.344828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:26.344828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:26.344828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:26.344828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:26.344828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:26.344828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:26.344828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:26.344828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:26.344828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:26.344828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:26.344828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:26.344828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:26.344828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:26.344828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:26.344828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:26.344828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:26.346213 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:26.346213 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:26.346213 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:26.346213 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:26.346213 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 396/789] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:19:26.346499 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b614354-3ff3-4907-876b-a323e553f432 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:26.352629 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93688896-9e3e-4e73-8475-85befc2c1fca None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:26.385039 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda63b52-5cbd-4287-923b-d71248805fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:26.386139 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda63b52-5cbd-4287-923b-d71248805fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:26.386599 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda63b52-5cbd-4287-923b-d71248805fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:26.387074 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda63b52-5cbd-4287-923b-d71248805fb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:26.397906 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda63b52-5cbd-4287-923b-d71248805fb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:26.399697 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda63b52-5cbd-4287-923b-d71248805fb5 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:26.435244 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-dda63b52-5cbd-4287-923b-d71248805fb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:26.435244 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:26.435244 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:26.435244 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:26.435244 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:26.435244 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:26.435244 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:26.435244 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:26.435244 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:26.435244 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:26.435244 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:26.435244 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:26.435244 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:26.435244 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:26.435244 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:26.436734 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:26.436734 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:26.436734 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:26.436734 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:26.436734 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:26.436734 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:26.436734 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:26.436734 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:26.436734 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:26.436734 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:26.436734 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:26.436734 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:26.436734 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:26.436734 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:26.436734 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:26.436734 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:26.436734 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:26.437612 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:26.437612 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:26.437612 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:26.437612 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:26.439655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 394/790] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:19:26.446243 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda63b52-5cbd-4287-923b-d71248805fb5 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:26.491129 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93688896-9e3e-4e73-8475-85befc2c1fca None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:26.529047 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a6d0d-f8fe-423a-a813-f14da44dcfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:26.529726 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a6d0d-f8fe-423a-a813-f14da44dcfcb None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:26.530279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a6d0d-f8fe-423a-a813-f14da44dcfcb None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:26.530562 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a6d0d-f8fe-423a-a813-f14da44dcfcb None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:26.531436 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a6d0d-f8fe-423a-a813-f14da44dcfcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:26.531746 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a6d0d-f8fe-423a-a813-f14da44dcfcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:26.533121 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a6d0d-f8fe-423a-a813-f14da44dcfcb None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:26.546572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 397/791] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:26.557866 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a6d0d-f8fe-423a-a813-f14da44dcfcb None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:26.595953 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:26.614945 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:26.642054 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda63b52-5cbd-4287-923b-d71248805fb5 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:26.690867 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a6d0d-f8fe-423a-a813-f14da44dcfcb None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:26.730471 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca5c3e-0206-4394-860f-0ce26404f481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:26.731708 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca5c3e-0206-4394-860f-0ce26404f481 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:26.732191 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca5c3e-0206-4394-860f-0ce26404f481 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:26.732661 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca5c3e-0206-4394-860f-0ce26404f481 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:26.742875 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d60726-b2e5-4d2d-bef2-135b59b613c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:26.743960 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d60726-b2e5-4d2d-bef2-135b59b613c8 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:26.744497 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d60726-b2e5-4d2d-bef2-135b59b613c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:26.744993 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d60726-b2e5-4d2d-bef2-135b59b613c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:26.745983 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d60726-b2e5-4d2d-bef2-135b59b613c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:26.746911 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d60726-b2e5-4d2d-bef2-135b59b613c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:26.747964 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca5c3e-0206-4394-860f-0ce26404f481 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:26.751089 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca5c3e-0206-4394-860f-0ce26404f481 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:26.751648 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d60726-b2e5-4d2d-bef2-135b59b613c8 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:26.780165 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 395/792] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:26.782707 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-4aca5c3e-0206-4394-860f-0ce26404f481 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 15:19:26.782707 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:26.782707 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:26.782707 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:26.782707 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:26.782707 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:26.782707 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:26.782707 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:26.782707 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:26.782707 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:26.782707 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:26.782707 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:26.782707 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:19:26.782707 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:19:26.782707 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:19:26.782707 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:19:26.783651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:26.783651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:26.783651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:19:26.783651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:26.783651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:19:26.783651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:26.783651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:26.783651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:26.783651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:26.783651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:26.783651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:26.783651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:26.783651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:26.783651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:26.783651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:26.783651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:26.783651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:26.783651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:26.784645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:26.784645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:26.784645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:19:26.784645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:19:26.784645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:19:26.784645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:19:26.784645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:19:26.784645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:19:26.784645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 15:19:26.784645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:26.786861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d60726-b2e5-4d2d-bef2-135b59b613c8 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:26.788965 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 398/793] 10.222.0.44 () {56 vars in 1117 bytes} [Tue Jul 19 15:19:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:26.796642 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca5c3e-0206-4394-860f-0ce26404f481 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:26.913261 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d60726-b2e5-4d2d-bef2-135b59b613c8 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:26.921808 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:26.951826 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca5c3e-0206-4394-860f-0ce26404f481 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:26.953879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c579c1d-f774-4adc-b5a5-295acda3b1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:26.955581 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c579c1d-f774-4adc-b5a5-295acda3b1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:26.957469 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c579c1d-f774-4adc-b5a5-295acda3b1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:26.957895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c579c1d-f774-4adc-b5a5-295acda3b1d0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:26.967561 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c579c1d-f774-4adc-b5a5-295acda3b1d0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:26.969737 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c579c1d-f774-4adc-b5a5-295acda3b1d0 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:26.988425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-2c579c1d-f774-4adc-b5a5-295acda3b1d0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 15:19:26.988425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:26.988425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:26.988425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:26.988425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:26.988425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:26.988425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:26.988425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:26.988425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:26.988425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:26.988425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:26.988425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:26.988425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:19:26.988425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:19:26.988425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:19:26.988425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:19:26.989402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:26.989402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:26.989402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:19:26.989402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:26.989402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:19:26.989402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:26.989402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:26.989402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:26.989402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:26.989402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:26.989402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:26.989402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:26.989402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:26.989402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:26.989402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:26.989402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:26.989402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:26.989402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:26.990368 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:26.990368 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:26.990368 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:19:26.990368 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:19:26.990368 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:19:26.990368 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:19:26.990368 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:19:26.990368 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:19:26.990368 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 15:19:26.990368 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:26.990368 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 396/794] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:19:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:26.992111 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560e81f-e5e3-4fff-abb3-4da7d62e455e None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:26.992598 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560e81f-e5e3-4fff-abb3-4da7d62e455e None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:26.992972 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560e81f-e5e3-4fff-abb3-4da7d62e455e None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:26.998864 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 397/795] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:26.999679 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be72fec-3f47-4e4e-9e62-0806c1444152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:26.999813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560e81f-e5e3-4fff-abb3-4da7d62e455e None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:27.000604 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be72fec-3f47-4e4e-9e62-0806c1444152 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:27.001082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be72fec-3f47-4e4e-9e62-0806c1444152 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:27.001530 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be72fec-3f47-4e4e-9e62-0806c1444152 None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:27.002561 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be72fec-3f47-4e4e-9e62-0806c1444152 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:27.003772 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be72fec-3f47-4e4e-9e62-0806c1444152 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:27.006312 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be72fec-3f47-4e4e-9e62-0806c1444152 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:27.014962 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:27.025013 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 399/796] 10.222.0.44 () {56 vars in 1149 bytes} [Tue Jul 19 15:19:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:27.026536 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b462c-54e0-42ab-aa28-7a0168b3abc9 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:27.026536 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b462c-54e0-42ab-aa28-7a0168b3abc9 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:27.026735 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b462c-54e0-42ab-aa28-7a0168b3abc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:27.043546 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-a39b462c-54e0-42ab-aa28-7a0168b3abc9 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:27.044755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-a39b462c-54e0-42ab-aa28-7a0168b3abc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:27.115767 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 400/797] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:19:27.117118 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3bda4-8e7b-4931-b0a2-9bd4b3d510c3 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:27.117414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3bda4-8e7b-4931-b0a2-9bd4b3d510c3 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:27.117697 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3bda4-8e7b-4931-b0a2-9bd4b3d510c3 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:27.119115 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 401/798] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:27.123829 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3bda4-8e7b-4931-b0a2-9bd4b3d510c3 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:27.125230 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560e81f-e5e3-4fff-abb3-4da7d62e455e None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:27.162642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d849d4b-f9b2-4fa0-bc33-12ab6de256e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:27.163340 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d849d4b-f9b2-4fa0-bc33-12ab6de256e8 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:27.163633 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d849d4b-f9b2-4fa0-bc33-12ab6de256e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:27.163913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d849d4b-f9b2-4fa0-bc33-12ab6de256e8 None admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:27.164765 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d849d4b-f9b2-4fa0-bc33-12ab6de256e8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:27.165095 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d849d4b-f9b2-4fa0-bc33-12ab6de256e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:27.166483 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d849d4b-f9b2-4fa0-bc33-12ab6de256e8 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:27.188576 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 398/799] 10.222.0.44 () {56 vars in 1135 bytes} [Tue Jul 19 15:19:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:27.188576 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc53c26-8eac-40f2-858b-69d7db85a785 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:27.188576 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc53c26-8eac-40f2-858b-69d7db85a785 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:27.188576 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc53c26-8eac-40f2-858b-69d7db85a785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:27.199491 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:27.202758 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-2dc53c26-8eac-40f2-858b-69d7db85a785 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:27.203969 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-2dc53c26-8eac-40f2-858b-69d7db85a785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:27.249979 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3bda4-8e7b-4931-b0a2-9bd4b3d510c3 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:27.271810 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:27.287247 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 399/800] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:19:27.287247 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc53c26-8eac-40f2-858b-69d7db85a785 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:27.297442 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7efc96-f054-49c3-ab0a-3b797a9675cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:27.298318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7efc96-f054-49c3-ab0a-3b797a9675cf None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:27.298601 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7efc96-f054-49c3-ab0a-3b797a9675cf None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:27.298876 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7efc96-f054-49c3-ab0a-3b797a9675cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:27.310468 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7efc96-f054-49c3-ab0a-3b797a9675cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:27.312224 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7efc96-f054-49c3-ab0a-3b797a9675cf None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:27.331041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-fd7efc96-f054-49c3-ab0a-3b797a9675cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:27.331041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:27.331041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:27.331041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:27.331041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:27.331041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:27.331041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:27.331041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:27.331041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:27.331041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:27.331041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:27.331041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:27.331041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:27.331041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:27.331041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:27.332906 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:27.332906 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:27.332906 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:27.332906 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:27.332906 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:27.332906 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:27.332906 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:27.332906 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:27.332906 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:27.332906 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:27.332906 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:27.332906 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:27.332906 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:27.332906 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:27.332906 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:27.332906 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:27.332906 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:27.336571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:27.336571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:27.336571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:27.336571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:27.336571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 402/801] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:27.336571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7efc96-f054-49c3-ab0a-3b797a9675cf None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:27.397973 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc53c26-8eac-40f2-858b-69d7db85a785 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:27.434358 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083fae3-49c4-441b-b8a7-990a23e57a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:27.435158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083fae3-49c4-441b-b8a7-990a23e57a61 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:27.435478 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083fae3-49c4-441b-b8a7-990a23e57a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:27.436036 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083fae3-49c4-441b-b8a7-990a23e57a61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:27.445897 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083fae3-49c4-441b-b8a7-990a23e57a61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:19:27.446822 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7efc96-f054-49c3-ab0a-3b797a9675cf None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:27.453852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-f083fae3-49c4-441b-b8a7-990a23e57a61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:19:27.453852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:27.453852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:27.453852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:27.453852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:27.453852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:27.453852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:27.453852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:27.453852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:27.453852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:27.453852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:27.453852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:27.453852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:19:27.453852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:19:27.453852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:19:27.453852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:19:27.454843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:19:27.454843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:19:27.454843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:19:27.454843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:19:27.454843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:27.454843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:27.454843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:27.454843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:27.454843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:27.454843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:27.454843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:27.454843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:27.454843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:27.454843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:27.454843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:27.454843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:27.455700 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:27.455700 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:27.455700 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:27.455700 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:27.455700 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:19:27.455700 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:19:27.455700 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:19:27.455700 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:19:27.455700 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:19:27.455700 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:19:27.455700 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:19:27.455700 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:27.455700 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 400/802] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:19:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:27.456940 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083fae3-49c4-441b-b8a7-990a23e57a61 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:27.471451 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:27.492397 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3b403-c2ab-4248-96f3-2f902089c3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:27.493192 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3b403-c2ab-4248-96f3-2f902089c3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:27.493470 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3b403-c2ab-4248-96f3-2f902089c3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:27.493744 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3b403-c2ab-4248-96f3-2f902089c3d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:27.504458 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3b403-c2ab-4248-96f3-2f902089c3d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:27.506140 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3b403-c2ab-4248-96f3-2f902089c3d9 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:27.518267 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:27.525735 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-2db3b403-c2ab-4248-96f3-2f902089c3d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:27.525735 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:27.525735 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:27.525735 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:27.525735 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:27.525735 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:27.525735 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:27.525735 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:27.525735 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:27.525735 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:27.525735 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:27.525735 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:27.525735 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:27.525735 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:27.525735 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:27.526632 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:27.526632 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:27.526632 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:27.526632 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:27.526632 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:27.526632 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:27.526632 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:27.526632 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:27.526632 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:27.526632 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:27.526632 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:27.526632 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:27.526632 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:27.526632 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:27.526632 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:27.526632 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:27.526632 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:27.527565 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:27.527565 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:27.527565 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:27.527565 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:27.527565 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 403/803] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:27.527840 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3b403-c2ab-4248-96f3-2f902089c3d9 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:27.568449 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083fae3-49c4-441b-b8a7-990a23e57a61 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:27.605353 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472e902-8e32-4edd-96da-29e99604f922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:27.606166 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472e902-8e32-4edd-96da-29e99604f922 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:27.606496 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472e902-8e32-4edd-96da-29e99604f922 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:27.606776 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472e902-8e32-4edd-96da-29e99604f922 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:27.607464 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472e902-8e32-4edd-96da-29e99604f922 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:27.608825 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472e902-8e32-4edd-96da-29e99604f922 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:27.621534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-4472e902-8e32-4edd-96da-29e99604f922 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 15:19:27.621534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:27.621534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:19:27.621534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:19:27.621534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:19:27.621534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:19:27.621534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:19:27.621534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:27.621534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 15:19:27.621534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:27.621534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:19:27.621534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:27.621534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:27.621534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:27.621534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:27.621534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:27.622569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:27.622569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:27.622569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:27.622569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:27.622569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:27.622569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:27.622569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:27.622569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:19:27.622569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:19:27.622569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:19:27.622569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:19:27.622569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:27.622569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:27.622569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:27.622569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:27.622569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:27.623428 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:27.623428 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:27.623428 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:27.623428 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:27.623428 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:27.623428 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:27.623428 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:27.623428 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:27.623428 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:27.623428 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:27.623428 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:27.623428 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:19:27.623428 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:27.623428 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 15:19:27.623428 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:27.623428 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 401/804] 10.222.0.44 () {56 vars in 1129 bytes} [Tue Jul 19 15:19:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:27.624899 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472e902-8e32-4edd-96da-29e99604f922 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:27.638187 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3b403-c2ab-4248-96f3-2f902089c3d9 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:27.675405 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7793667-9297-4f11-a865-918df29ed6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:27.675992 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7793667-9297-4f11-a865-918df29ed6a0 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:27.676274 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7793667-9297-4f11-a865-918df29ed6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:27.676552 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7793667-9297-4f11-a865-918df29ed6a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:27.677279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7793667-9297-4f11-a865-918df29ed6a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:27.677588 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7793667-9297-4f11-a865-918df29ed6a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:27.678945 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7793667-9297-4f11-a865-918df29ed6a0 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:27.691613 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 404/805] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:27.692385 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7793667-9297-4f11-a865-918df29ed6a0 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:27.722507 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:27.739698 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472e902-8e32-4edd-96da-29e99604f922 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:27.762642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:27.775458 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171ff6c-1877-4109-ba0c-5c8c9d002fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:27.776133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171ff6c-1877-4109-ba0c-5c8c9d002fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:27.776418 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171ff6c-1877-4109-ba0c-5c8c9d002fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:27.776709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171ff6c-1877-4109-ba0c-5c8c9d002fd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:27.777454 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171ff6c-1877-4109-ba0c-5c8c9d002fd9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:27.777766 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171ff6c-1877-4109-ba0c-5c8c9d002fd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:27.779122 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171ff6c-1877-4109-ba0c-5c8c9d002fd9 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:27.787390 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 402/806] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:19:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:27.788172 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171ff6c-1877-4109-ba0c-5c8c9d002fd9 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:27.798962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7793667-9297-4f11-a865-918df29ed6a0 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:27.833093 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9d7e4-3ded-43c5-b280-81bc58a1bc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:27.833759 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9d7e4-3ded-43c5-b280-81bc58a1bc9d None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:27.834046 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9d7e4-3ded-43c5-b280-81bc58a1bc9d None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:27.834327 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9d7e4-3ded-43c5-b280-81bc58a1bc9d None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:27.835054 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9d7e4-3ded-43c5-b280-81bc58a1bc9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:27.835396 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9d7e4-3ded-43c5-b280-81bc58a1bc9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:27.836785 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9d7e4-3ded-43c5-b280-81bc58a1bc9d None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:27.848810 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 405/807] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:27.849627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9d7e4-3ded-43c5-b280-81bc58a1bc9d None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:27.889852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171ff6c-1877-4109-ba0c-5c8c9d002fd9 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:27.928204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08bb98-997a-414b-ac95-dd5f952060f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:27.928796 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08bb98-997a-414b-ac95-dd5f952060f6 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:27.929088 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08bb98-997a-414b-ac95-dd5f952060f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:27.929374 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08bb98-997a-414b-ac95-dd5f952060f6 None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:27.930097 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08bb98-997a-414b-ac95-dd5f952060f6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:27.930419 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08bb98-997a-414b-ac95-dd5f952060f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:27.931822 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08bb98-997a-414b-ac95-dd5f952060f6 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:27.936697 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 403/808] 10.222.0.44 () {56 vars in 1124 bytes} [Tue Jul 19 15:19:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:27.937904 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78360c03-282b-4df8-81ca-91b4415f8d23 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:27.938200 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78360c03-282b-4df8-81ca-91b4415f8d23 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:27.938482 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78360c03-282b-4df8-81ca-91b4415f8d23 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:27.939744 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 404/809] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:27.940437 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78360c03-282b-4df8-81ca-91b4415f8d23 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:27.949498 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:27.962662 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9d7e4-3ded-43c5-b280-81bc58a1bc9d None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:27.991377 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:27.997065 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee0b75-1659-4d7f-b96f-c1ea281eabbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:27.997855 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee0b75-1659-4d7f-b96f-c1ea281eabbb None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:27.998143 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee0b75-1659-4d7f-b96f-c1ea281eabbb None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:27.998419 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee0b75-1659-4d7f-b96f-c1ea281eabbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:28.005775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee0b75-1659-4d7f-b96f-c1ea281eabbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:28.007191 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee0b75-1659-4d7f-b96f-c1ea281eabbb None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:28.021493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-6aee0b75-1659-4d7f-b96f-c1ea281eabbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:28.021493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:28.021493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:28.021493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:28.021493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:28.021493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:28.021493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:28.021493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:28.021493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:28.021493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:28.021493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:28.021493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:28.021493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:19:28.021493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:19:28.021493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:19:28.022626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:19:28.022626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:28.022626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:28.022626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:28.022626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:28.022626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:28.022626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:28.022626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:28.022626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:28.022626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:28.022626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:28.022626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:28.022626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:28.022626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:28.022626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:28.022626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:28.022626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:28.028490 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:19:28.028490 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:19:28.028490 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:19:28.028490 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:19:28.028490 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:19:28.028490 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:19:28.028490 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:28.028490 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:28.028490 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 406/810] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:19:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:28.028490 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee0b75-1659-4d7f-b96f-c1ea281eabbb None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:28.042097 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78360c03-282b-4df8-81ca-91b4415f8d23 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:28.076886 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5a644-fa33-4144-b89b-b30e4a3a0740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:28.077672 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5a644-fa33-4144-b89b-b30e4a3a0740 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:28.077947 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5a644-fa33-4144-b89b-b30e4a3a0740 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:28.078219 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5a644-fa33-4144-b89b-b30e4a3a0740 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:28.088187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5a644-fa33-4144-b89b-b30e4a3a0740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:28.089607 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5a644-fa33-4144-b89b-b30e4a3a0740 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:28.106907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-5ac5a644-fa33-4144-b89b-b30e4a3a0740 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:28.106907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:28.106907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:28.106907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:28.106907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:28.106907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:28.106907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:28.106907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:28.106907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:28.106907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:28.106907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:28.106907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:28.106907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:28.106907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:28.106907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:28.107843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:28.107843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:28.107843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:28.107843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:28.107843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:28.107843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:28.107843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:28.107843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:28.107843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:28.107843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:28.107843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:28.107843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:28.107843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:28.107843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:28.107843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:28.107843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:28.107843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:28.108954 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:28.108954 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:28.108954 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:28.108954 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:28.108954 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 405/811] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:28.108954 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5a644-fa33-4144-b89b-b30e4a3a0740 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:28.127366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee0b75-1659-4d7f-b96f-c1ea281eabbb None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:28.160649 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d3b9ef-3b8d-431c-98f2-8cfbaa611da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:28.161438 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3b9ef-3b8d-431c-98f2-8cfbaa611da8 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:28.161723 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3b9ef-3b8d-431c-98f2-8cfbaa611da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:28.161999 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3b9ef-3b8d-431c-98f2-8cfbaa611da8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:28.168852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d3b9ef-3b8d-431c-98f2-8cfbaa611da8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:28.170289 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d3b9ef-3b8d-431c-98f2-8cfbaa611da8 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:28.184828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-69d3b9ef-3b8d-431c-98f2-8cfbaa611da8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:28.184828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:28.184828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:28.184828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:28.184828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:28.184828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:28.184828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:28.184828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:28.184828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:28.184828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:28.184828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:28.184828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:28.184828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:19:28.184828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:19:28.184828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:19:28.185755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:19:28.185755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:28.185755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:28.185755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:28.185755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:28.185755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:28.185755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:28.185755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:28.185755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:28.185755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:28.185755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:28.185755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:28.185755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:28.185755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:28.185755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:28.185755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:28.185755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:28.187160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:19:28.187160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:19:28.187160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:19:28.187160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:19:28.187160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:19:28.187160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:19:28.187160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:28.187160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:28.187160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 407/812] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:19:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:28.187795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a4448-e24a-4de7-a670-198b6ff6d620 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:28.187795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a4448-e24a-4de7-a670-198b6ff6d620 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:28.188006 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a4448-e24a-4de7-a670-198b6ff6d620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:28.204344 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-b48a4448-e24a-4de7-a670-198b6ff6d620 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:28.205577 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-b48a4448-e24a-4de7-a670-198b6ff6d620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:28.208171 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:28.211556 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:28.215107 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5a644-fa33-4144-b89b-b30e4a3a0740 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:28.251886 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b422fc-55f7-428e-acfc-2a10923a47df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:28.252556 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b422fc-55f7-428e-acfc-2a10923a47df None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:28.252843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b422fc-55f7-428e-acfc-2a10923a47df None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:28.253212 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b422fc-55f7-428e-acfc-2a10923a47df None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:28.253877 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b422fc-55f7-428e-acfc-2a10923a47df None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:28.254191 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b422fc-55f7-428e-acfc-2a10923a47df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:28.255583 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b422fc-55f7-428e-acfc-2a10923a47df None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:28.260357 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 406/813] 10.222.0.44 () {56 vars in 1124 bytes} [Tue Jul 19 15:19:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:28.261133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b422fc-55f7-428e-acfc-2a10923a47df None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:28.279253 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 408/814] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:19:28.280281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a4448-e24a-4de7-a670-198b6ff6d620 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:28.364583 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b422fc-55f7-428e-acfc-2a10923a47df None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:28.378695 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a4448-e24a-4de7-a670-198b6ff6d620 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:28.400140 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa87be-efa2-4f95-aad3-565140b5cb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:28.400799 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa87be-efa2-4f95-aad3-565140b5cb81 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:28.401096 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa87be-efa2-4f95-aad3-565140b5cb81 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:28.401376 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa87be-efa2-4f95-aad3-565140b5cb81 None admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:28.402171 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa87be-efa2-4f95-aad3-565140b5cb81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:28.402484 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa87be-efa2-4f95-aad3-565140b5cb81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:28.403973 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa87be-efa2-4f95-aad3-565140b5cb81 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:28.412911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14fff1-fbf9-47f6-88e0-794acefef35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:28.413570 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14fff1-fbf9-47f6-88e0-794acefef35f None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:28.413854 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14fff1-fbf9-47f6-88e0-794acefef35f None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:28.414131 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14fff1-fbf9-47f6-88e0-794acefef35f None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:28.414850 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14fff1-fbf9-47f6-88e0-794acefef35f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:28.415156 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14fff1-fbf9-47f6-88e0-794acefef35f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:28.415583 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 407/815] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:19:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:28.416380 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa87be-efa2-4f95-aad3-565140b5cb81 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:28.416543 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14fff1-fbf9-47f6-88e0-794acefef35f None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:28.422944 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:28.428939 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 409/816] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:28.429732 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14fff1-fbf9-47f6-88e0-794acefef35f None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:28.449931 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:28.524368 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa87be-efa2-4f95-aad3-565140b5cb81 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:28.532081 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14fff1-fbf9-47f6-88e0-794acefef35f None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:28.557255 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c410ea7-9d19-4c28-a6c1-14d7c872c147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:28.557914 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c410ea7-9d19-4c28-a6c1-14d7c872c147 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:28.558201 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c410ea7-9d19-4c28-a6c1-14d7c872c147 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:28.558486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c410ea7-9d19-4c28-a6c1-14d7c872c147 None admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:28.559300 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c410ea7-9d19-4c28-a6c1-14d7c872c147 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:28.559622 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c410ea7-9d19-4c28-a6c1-14d7c872c147 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:28.561033 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c410ea7-9d19-4c28-a6c1-14d7c872c147 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:28.566459 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268fa832-d1fb-4b6a-b5f3-a1de1364089c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:28.567116 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268fa832-d1fb-4b6a-b5f3-a1de1364089c None admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:28.567434 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268fa832-d1fb-4b6a-b5f3-a1de1364089c None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:28.567717 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268fa832-d1fb-4b6a-b5f3-a1de1364089c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:28.568523 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268fa832-d1fb-4b6a-b5f3-a1de1364089c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:28.569879 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268fa832-d1fb-4b6a-b5f3-a1de1364089c None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:28.573398 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 408/817] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:19:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:28.574216 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c410ea7-9d19-4c28-a6c1-14d7c872c147 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:28.590782 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 410/818] 10.222.0.44 () {60 vars in 1144 bytes} [Tue Jul 19 15:19:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:19:28.591601 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268fa832-d1fb-4b6a-b5f3-a1de1364089c None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:28.655173 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:28.688761 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:28.707925 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c410ea7-9d19-4c28-a6c1-14d7c872c147 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:28.715137 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268fa832-d1fb-4b6a-b5f3-a1de1364089c None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:28.746847 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2787d9-9ad0-4e2a-9c5a-8c354adf14f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:28.747688 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2787d9-9ad0-4e2a-9c5a-8c354adf14f6 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:28.747966 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2787d9-9ad0-4e2a-9c5a-8c354adf14f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:28.748238 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2787d9-9ad0-4e2a-9c5a-8c354adf14f6 None admin] PATH_INFO: `/v3/services/network` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:28.748905 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2787d9-9ad0-4e2a-9c5a-8c354adf14f6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:28.750256 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2787d9-9ad0-4e2a-9c5a-8c354adf14f6 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:28.756366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2454c-4522-4b0d-9380-520b198e4ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:28.757382 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2454c-4522-4b0d-9380-520b198e4ec7 None admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:28.757785 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2454c-4522-4b0d-9380-520b198e4ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:28.758163 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2454c-4522-4b0d-9380-520b198e4ec7 None admin] PATH_INFO: `/v3/projects/c54934775a86487295bdbc02ed3a0103/users/cea1d8409c754ec797d6c694481a3112/roles/1ff62289fb434d09a13001c3ffbab080` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:28.764750 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-3e2787d9-9ad0-4e2a-9c5a-8c354adf14f6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 15:19:28.764750 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:28.764750 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:19:28.764750 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:19:28.764750 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:19:28.764750 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:19:28.764750 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:19:28.764750 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:28.764750 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 15:19:28.764750 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:28.764750 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:19:28.764750 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:28.764750 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:28.764750 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:28.764750 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:28.764750 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:28.764750 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:28.765905 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:28.765905 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:28.765905 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:28.765905 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:28.765905 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:28.765905 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:28.765905 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:19:28.765905 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:19:28.765905 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:19:28.765905 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:19:28.765905 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:28.765905 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:28.765905 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:28.765905 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:28.765905 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:28.765905 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:28.766819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:28.766819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:28.766819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:28.766819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:28.766819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:28.766819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:28.766819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:28.766819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:28.766819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:28.766819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:28.766819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:19:28.766819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:28.766819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 15:19:28.766819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:28.766819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 409/819] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:19:28 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:28.768735 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2787d9-9ad0-4e2a-9c5a-8c354adf14f6 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:28.776326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2454c-4522-4b0d-9380-520b198e4ec7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c54934775a86487295bdbc02ed3a0103, user_id=cea1d8409c754ec797d6c694481a3112, role_id=1ff62289fb434d09a13001c3ffbab080)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:28.777004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2454c-4522-4b0d-9380-520b198e4ec7 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:28.794743 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 411/820] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 19 15:19:28 2022] PUT /identity/v3/projects/c54934775a86487295bdbc02ed3a0103/users/cea1d8409c754ec797d6c694481a3112/roles/1ff62289fb434d09a13001c3ffbab080 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:19:28.795670 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2454c-4522-4b0d-9380-520b198e4ec7 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:28.907022 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2787d9-9ad0-4e2a-9c5a-8c354adf14f6 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:28.923536 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:28.927747 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2454c-4522-4b0d-9380-520b198e4ec7 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:28.955960 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fd73d-767e-4e06-bac1-e4b2ed3d1e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:28.957992 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fd73d-767e-4e06-bac1-e4b2ed3d1e7f None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:28.958424 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fd73d-767e-4e06-bac1-e4b2ed3d1e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:28.958894 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fd73d-767e-4e06-bac1-e4b2ed3d1e7f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:28.968469 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fd73d-767e-4e06-bac1-e4b2ed3d1e7f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:28.970251 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fd73d-767e-4e06-bac1-e4b2ed3d1e7f None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:28.975178 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c31da-d3f5-40db-88d2-063208c97348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:28.976187 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c31da-d3f5-40db-88d2-063208c97348 None admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:28.977024 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c31da-d3f5-40db-88d2-063208c97348 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:28.977024 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c31da-d3f5-40db-88d2-063208c97348 None admin] PATH_INFO: `/v3/projects/c54934775a86487295bdbc02ed3a0103/users/bd1dceaddb6e414faef0e0448cdf1be8/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:28.979074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c31da-d3f5-40db-88d2-063208c97348 None admin] RBAC: Authorizing `identity:create_grant(project_id=c54934775a86487295bdbc02ed3a0103, user_id=bd1dceaddb6e414faef0e0448cdf1be8, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:28.980512 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c31da-d3f5-40db-88d2-063208c97348 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:28.986255 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-5c8fd73d-767e-4e06-bac1-e4b2ed3d1e7f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:19:28.986255 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:28.986255 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:28.986255 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:28.986255 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:28.986255 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:28.986255 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:28.986255 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:28.986255 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:28.986255 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:28.986255 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:28.986255 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:28.986255 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:19:28.986255 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:19:28.986255 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:19:28.986255 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:19:28.988158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:28.988158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:28.988158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:19:28.988158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:28.988158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:19:28.988158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:28.988158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:28.988158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:28.988158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:28.988158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:28.988158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:28.988158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:28.988158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:28.988158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:28.988158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:28.988158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:28.988158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:28.988158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:28.989270 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:28.989270 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:28.989270 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:19:28.989270 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:19:28.989270 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:19:28.989270 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:19:28.989270 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:19:28.989270 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:19:28.989270 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:19:28.989270 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:28.989270 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 410/821] 10.222.0.44 () {56 vars in 1093 bytes} [Tue Jul 19 15:19:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:28.989270 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fd73d-767e-4e06-bac1-e4b2ed3d1e7f None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:29.000121 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 412/822] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 19 15:19:28 2022] PUT /identity/v3/projects/c54934775a86487295bdbc02ed3a0103/users/bd1dceaddb6e414faef0e0448cdf1be8/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:19:29.003261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c31da-d3f5-40db-88d2-063208c97348 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:29.003437 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:29.126481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c31da-d3f5-40db-88d2-063208c97348 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:29.152550 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fd73d-767e-4e06-bac1-e4b2ed3d1e7f None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:29.187820 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4843b-93d2-407d-b5f3-655ea05204f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:29.188932 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4843b-93d2-407d-b5f3-655ea05204f4 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:29.189326 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4843b-93d2-407d-b5f3-655ea05204f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:29.189713 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4843b-93d2-407d-b5f3-655ea05204f4 None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:29.191654 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4843b-93d2-407d-b5f3-655ea05204f4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:29.192089 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4843b-93d2-407d-b5f3-655ea05204f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:29.193805 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4843b-93d2-407d-b5f3-655ea05204f4 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:29.199585 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 411/823] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jul 19 15:19:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:29.204656 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4843b-93d2-407d-b5f3-655ea05204f4 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:29.212144 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ae5f7-53dc-4d06-8348-613dfcc5602c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:29.213105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ae5f7-53dc-4d06-8348-613dfcc5602c None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:29.213534 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ae5f7-53dc-4d06-8348-613dfcc5602c None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:29.213949 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ae5f7-53dc-4d06-8348-613dfcc5602c None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:29.214951 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ae5f7-53dc-4d06-8348-613dfcc5602c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:29.215435 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ae5f7-53dc-4d06-8348-613dfcc5602c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:29.217170 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ae5f7-53dc-4d06-8348-613dfcc5602c None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:29.241182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 413/824] 10.222.0.44 () {56 vars in 1133 bytes} [Tue Jul 19 15:19:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:29.246646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ae5f7-53dc-4d06-8348-613dfcc5602c None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:29.269887 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:29.305172 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:29.340266 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4843b-93d2-407d-b5f3-655ea05204f4 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:29.362820 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ae5f7-53dc-4d06-8348-613dfcc5602c None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:29.379300 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785356b-a13f-4ef2-b4e4-66effc8c3842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:29.380091 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785356b-a13f-4ef2-b4e4-66effc8c3842 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:29.380807 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785356b-a13f-4ef2-b4e4-66effc8c3842 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:29.380807 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785356b-a13f-4ef2-b4e4-66effc8c3842 None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:29.381588 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785356b-a13f-4ef2-b4e4-66effc8c3842 None admin] RBAC: Adding query filter params (type=network) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:29.381985 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785356b-a13f-4ef2-b4e4-66effc8c3842 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:29.383430 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785356b-a13f-4ef2-b4e4-66effc8c3842 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:29.389579 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 412/825] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jul 19 15:19:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:29.395882 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785356b-a13f-4ef2-b4e4-66effc8c3842 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:29.403868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a670f-5edf-45ce-914c-41a7d4de1211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:29.405036 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a670f-5edf-45ce-914c-41a7d4de1211 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:29.405498 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a670f-5edf-45ce-914c-41a7d4de1211 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:29.405948 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a670f-5edf-45ce-914c-41a7d4de1211 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:29.476846 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a670f-5edf-45ce-914c-41a7d4de1211 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:29.478595 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a670f-5edf-45ce-914c-41a7d4de1211 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:29.497810 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:29.507665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785356b-a13f-4ef2-b4e4-66effc8c3842 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:29.573792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e3011-b713-4a87-84d7-61ff5436c9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:29.574630 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e3011-b713-4a87-84d7-61ff5436c9f5 None admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:29.575000 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e3011-b713-4a87-84d7-61ff5436c9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:29.575377 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e3011-b713-4a87-84d7-61ff5436c9f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:29.576300 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e3011-b713-4a87-84d7-61ff5436c9f5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:29.577803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e3011-b713-4a87-84d7-61ff5436c9f5 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:29.584383 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 414/826] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:19:29 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:19:29.589458 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a670f-5edf-45ce-914c-41a7d4de1211 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:29.595597 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:29.642406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 413/827] 10.222.0.44 () {60 vars in 1144 bytes} [Tue Jul 19 15:19:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:19:29.698866 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a670f-5edf-45ce-914c-41a7d4de1211 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:29.717390 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:29.743982 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f982755-bf36-4198-a427-92cf3531d7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:29.744848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f982755-bf36-4198-a427-92cf3531d7c2 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:29.745327 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f982755-bf36-4198-a427-92cf3531d7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:29.745788 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f982755-bf36-4198-a427-92cf3531d7c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:29.761518 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f982755-bf36-4198-a427-92cf3531d7c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:29.763012 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f982755-bf36-4198-a427-92cf3531d7c2 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:29.782143 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-2f982755-bf36-4198-a427-92cf3531d7c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:29.782143 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:29.782143 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:29.782143 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:29.782143 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:29.782143 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:29.782143 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:29.782143 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:29.782143 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:29.782143 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:29.782143 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:29.782143 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:29.782143 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:29.782143 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:29.782143 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:29.783105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:29.783105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:29.783105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:29.783105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:29.783105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:29.783105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:29.783105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:29.783105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:29.783105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:29.783105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:29.783105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:29.783105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:29.783105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:29.783105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:29.783105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:29.783105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:29.783105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:29.784047 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:29.784047 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:29.784047 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:29.784047 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:29.784047 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 415/828] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:29.791011 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e3011-b713-4a87-84d7-61ff5436c9f5 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:29.935446 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e3011-b713-4a87-84d7-61ff5436c9f5 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:29.973542 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1735d45-524d-4a98-a687-c5ecddb63274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:29.974222 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1735d45-524d-4a98-a687-c5ecddb63274 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:29.974504 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1735d45-524d-4a98-a687-c5ecddb63274 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:29.974781 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1735d45-524d-4a98-a687-c5ecddb63274 None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:29.975565 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1735d45-524d-4a98-a687-c5ecddb63274 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:29.975877 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1735d45-524d-4a98-a687-c5ecddb63274 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:29.977236 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1735d45-524d-4a98-a687-c5ecddb63274 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:29.992082 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 414/829] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:29.997837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f982755-bf36-4198-a427-92cf3531d7c2 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:30.129602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f982755-bf36-4198-a427-92cf3531d7c2 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:30.169027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde50968-626d-4fff-bc29-d64508be0e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:30.169822 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde50968-626d-4fff-bc29-d64508be0e46 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:30.170110 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde50968-626d-4fff-bc29-d64508be0e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:30.170391 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde50968-626d-4fff-bc29-d64508be0e46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:30.178228 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde50968-626d-4fff-bc29-d64508be0e46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:30.179698 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde50968-626d-4fff-bc29-d64508be0e46 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:30.193798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-bde50968-626d-4fff-bc29-d64508be0e46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:30.193798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:30.193798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:30.193798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:30.193798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:30.193798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:30.193798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:30.193798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:30.193798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:30.193798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:30.193798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:30.193798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:30.193798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:19:30.193798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:19:30.193798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:19:30.194806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:19:30.194806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:30.194806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:30.194806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:30.194806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:30.194806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:30.194806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:30.194806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:30.194806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:30.194806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:30.194806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:30.194806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:30.194806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:30.194806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:30.194806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:30.194806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:30.194806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:30.195737 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:19:30.195737 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:19:30.195737 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:19:30.195737 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:19:30.195737 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:19:30.195737 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:19:30.195737 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:30.195737 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:30.195737 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 416/830] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:19:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:30.200847 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1735d45-524d-4a98-a687-c5ecddb63274 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:30.256988 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:30.308645 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1735d45-524d-4a98-a687-c5ecddb63274 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:30.348015 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b45f1-d1f5-44c8-93ea-9885f59770b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:30.348728 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b45f1-d1f5-44c8-93ea-9885f59770b5 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:30.349020 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b45f1-d1f5-44c8-93ea-9885f59770b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:30.349303 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b45f1-d1f5-44c8-93ea-9885f59770b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:30.350096 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b45f1-d1f5-44c8-93ea-9885f59770b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:30.350406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b45f1-d1f5-44c8-93ea-9885f59770b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:30.351847 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b45f1-d1f5-44c8-93ea-9885f59770b5 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:30.363839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 415/831] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:19:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:30.369396 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde50968-626d-4fff-bc29-d64508be0e46 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:30.400081 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:30.478746 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde50968-626d-4fff-bc29-d64508be0e46 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:30.515529 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896cea6-4195-4e37-a114-61b7acaff044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:30.516111 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896cea6-4195-4e37-a114-61b7acaff044 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:30.516394 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896cea6-4195-4e37-a114-61b7acaff044 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:30.516673 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896cea6-4195-4e37-a114-61b7acaff044 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:30.517515 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896cea6-4195-4e37-a114-61b7acaff044 None admin] RBAC: Adding query filter params (role.id=d884ddf33c1440d9b3a3351b85e83e76, scope.project.id=c54934775a86487295bdbc02ed3a0103, user.id=fef0511f56144ca9945b2dddfa2601a2) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:30.517828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896cea6-4195-4e37-a114-61b7acaff044 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:30.522996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896cea6-4195-4e37-a114-61b7acaff044 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:30.531030 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 417/832] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:19:30 2022] GET /identity/v3/role_assignments?user.id=fef0511f56144ca9945b2dddfa2601a2&scope.project.id=c54934775a86487295bdbc02ed3a0103&role.id=d884ddf33c1440d9b3a3351b85e83e76 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:30.984110 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375fdc8-cbc5-407a-b300-c04ffd058c66 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:30.984110 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375fdc8-cbc5-407a-b300-c04ffd058c66 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:30.984110 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375fdc8-cbc5-407a-b300-c04ffd058c66 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:30.985370 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 416/833] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:30.991491 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8837fc-7815-467a-88cc-56e3dcac21cc None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:30.992367 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8837fc-7815-467a-88cc-56e3dcac21cc None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:30.992862 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8837fc-7815-467a-88cc-56e3dcac21cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:31.010694 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-1f8837fc-7815-467a-88cc-56e3dcac21cc None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:31.012238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-1f8837fc-7815-467a-88cc-56e3dcac21cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:31.085913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b8bbd-6ee4-40bb-a54f-8437d9ebe114 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:31.086264 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b8bbd-6ee4-40bb-a54f-8437d9ebe114 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:31.086488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b8bbd-6ee4-40bb-a54f-8437d9ebe114 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:31.088815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 418/835] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:19:31.089392 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 417/835] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:31.093664 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61920738-d043-4c0f-b424-13906a916c9e None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:31.094190 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61920738-d043-4c0f-b424-13906a916c9e None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:31.094649 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61920738-d043-4c0f-b424-13906a916c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:31.111251 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b8bbd-6ee4-40bb-a54f-8437d9ebe114 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:31.113407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-61920738-d043-4c0f-b424-13906a916c9e None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:31.115025 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-61920738-d043-4c0f-b424-13906a916c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:31.134358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:31.230538 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b8bbd-6ee4-40bb-a54f-8437d9ebe114 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:31.251672 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:31.271615 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582324a-be6f-46c0-81bd-3580ae5833c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:31.272759 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582324a-be6f-46c0-81bd-3580ae5833c2 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:31.273313 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582324a-be6f-46c0-81bd-3580ae5833c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:31.273776 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582324a-be6f-46c0-81bd-3580ae5833c2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:31.274703 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582324a-be6f-46c0-81bd-3580ae5833c2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:31.276367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582324a-be6f-46c0-81bd-3580ae5833c2 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:31.291323 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-1582324a-be6f-46c0-81bd-3580ae5833c2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 15:19:31.291323 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:31.291323 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:19:31.291323 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:19:31.291323 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:19:31.291323 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:19:31.291323 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:19:31.291323 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:31.291323 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 15:19:31.291323 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:31.291323 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:19:31.291323 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:31.291323 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:31.291323 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:31.291323 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:31.291323 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:31.291323 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:31.292386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:31.292386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:31.292386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:31.292386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:31.292386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:31.292386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:31.292386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:19:31.292386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:19:31.292386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:19:31.292386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:19:31.292386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:31.292386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:31.292386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:31.292386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:31.292386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:31.292386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:31.293229 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:31.293229 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:31.293229 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:31.293229 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:31.293229 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:31.293229 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:31.293229 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:31.293229 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:31.293229 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:31.293229 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:31.293229 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:19:31.293229 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:31.293229 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 15:19:31.293229 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:31.296524 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 418/836] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 19 15:19:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:31.303136 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582324a-be6f-46c0-81bd-3580ae5833c2 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:31.324816 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 419/837] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:19:31.348704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61920738-d043-4c0f-b424-13906a916c9e None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:31.425240 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582324a-be6f-46c0-81bd-3580ae5833c2 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:31.456502 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61920738-d043-4c0f-b424-13906a916c9e None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:31.462286 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814e7d9-bb79-454f-9f99-117d6be81204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:31.463173 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814e7d9-bb79-454f-9f99-117d6be81204 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:31.463651 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814e7d9-bb79-454f-9f99-117d6be81204 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:31.464475 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814e7d9-bb79-454f-9f99-117d6be81204 None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:31.465345 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814e7d9-bb79-454f-9f99-117d6be81204 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:31.465815 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814e7d9-bb79-454f-9f99-117d6be81204 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:31.468042 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814e7d9-bb79-454f-9f99-117d6be81204 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:31.475330 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 419/838] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 19 15:19:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:31.480307 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814e7d9-bb79-454f-9f99-117d6be81204 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:31.492896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff8cf5-3c40-40c0-8b6c-10855cd3e778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:31.493523 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff8cf5-3c40-40c0-8b6c-10855cd3e778 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:31.493864 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff8cf5-3c40-40c0-8b6c-10855cd3e778 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:31.494193 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff8cf5-3c40-40c0-8b6c-10855cd3e778 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:31.505831 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff8cf5-3c40-40c0-8b6c-10855cd3e778 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:19:31.513815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-4cff8cf5-3c40-40c0-8b6c-10855cd3e778 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:19:31.513815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:31.513815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:31.513815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:31.513815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:31.513815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:31.513815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:31.513815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:31.513815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:31.513815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:31.513815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:31.513815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:31.513815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:19:31.513815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:19:31.513815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:19:31.513815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:19:31.514962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:19:31.514962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:19:31.514962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:19:31.514962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:19:31.514962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:31.514962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:31.514962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:31.514962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:31.514962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:31.514962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:31.514962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:31.514962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:31.514962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:31.514962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:31.514962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:31.514962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:31.515963 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:31.515963 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:31.515963 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:31.515963 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:31.515963 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:19:31.515963 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:19:31.515963 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:19:31.515963 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:19:31.515963 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:19:31.515963 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:19:31.515963 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:19:31.515963 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:31.520032 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 420/839] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 19 15:19:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:31.521291 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff8cf5-3c40-40c0-8b6c-10855cd3e778 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:31.535499 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:31.537360 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:31.601952 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814e7d9-bb79-454f-9f99-117d6be81204 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:31.637941 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9c721-157e-4b80-ae8d-35d76c76d137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:31.638629 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9c721-157e-4b80-ae8d-35d76c76d137 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:31.638967 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9c721-157e-4b80-ae8d-35d76c76d137 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:31.639182 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9c721-157e-4b80-ae8d-35d76c76d137 None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:31.639925 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9c721-157e-4b80-ae8d-35d76c76d137 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:31.640239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9c721-157e-4b80-ae8d-35d76c76d137 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:31.641603 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9c721-157e-4b80-ae8d-35d76c76d137 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:31.646892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 420/840] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 19 15:19:31 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:31.661834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff8cf5-3c40-40c0-8b6c-10855cd3e778 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:31.689832 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e95ae-81e4-4a60-acef-9928a4a5e342 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:31.690025 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e95ae-81e4-4a60-acef-9928a4a5e342 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:31.690314 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e95ae-81e4-4a60-acef-9928a4a5e342 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:31.693323 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 421/841] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:31.698202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f5bc8-b68f-4f9c-a813-7c421e9d062c None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:31.698527 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f5bc8-b68f-4f9c-a813-7c421e9d062c None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:31.698776 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f5bc8-b68f-4f9c-a813-7c421e9d062c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:31.708159 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2796b-cf15-48a9-8bb9-c30d5235fb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:31.709278 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2796b-cf15-48a9-8bb9-c30d5235fb82 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:31.709772 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2796b-cf15-48a9-8bb9-c30d5235fb82 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:31.710282 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2796b-cf15-48a9-8bb9-c30d5235fb82 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:31.711329 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2796b-cf15-48a9-8bb9-c30d5235fb82 None admin] RBAC: Adding query filter params (name=service) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:31.711896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2796b-cf15-48a9-8bb9-c30d5235fb82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:31.714825 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2796b-cf15-48a9-8bb9-c30d5235fb82 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:31.718501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-152f5bc8-b68f-4f9c-a813-7c421e9d062c None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:31.719826 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-152f5bc8-b68f-4f9c-a813-7c421e9d062c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:31.730820 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 421/842] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 19 15:19:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:31.736621 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2796b-cf15-48a9-8bb9-c30d5235fb82 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:31.822647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 422/843] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:19:31.845990 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:31.848095 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f5bc8-b68f-4f9c-a813-7c421e9d062c None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:31.882089 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2796b-cf15-48a9-8bb9-c30d5235fb82 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:31.896026 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:31.918720 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0008a-61de-4240-8ab8-61ae3c73772b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:31.919559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0008a-61de-4240-8ab8-61ae3c73772b None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:31.919845 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0008a-61de-4240-8ab8-61ae3c73772b None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:31.920121 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0008a-61de-4240-8ab8-61ae3c73772b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:31.933875 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0008a-61de-4240-8ab8-61ae3c73772b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:31.935340 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0008a-61de-4240-8ab8-61ae3c73772b None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:31.953658 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-f8b0008a-61de-4240-8ab8-61ae3c73772b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:31.953658 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:31.953658 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:31.953658 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:31.953658 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:31.953658 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:31.953658 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:31.953658 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:31.953658 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:31.953658 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:31.953658 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:31.953658 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:31.953658 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:31.953658 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:31.953658 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:31.955366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:31.955366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:31.955366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:31.955366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:31.955366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:31.955366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:31.955366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:31.955366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:31.955366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:31.955366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:31.955366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:31.955366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:31.955366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:31.955366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:31.955366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:31.955366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:31.955366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:31.956974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:31.956974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:31.956974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:31.956974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:31.956974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 422/844] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:31.961593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0008a-61de-4240-8ab8-61ae3c73772b None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:31.986933 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f5bc8-b68f-4f9c-a813-7c421e9d062c None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:32.030272 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114b51e-926e-4542-8a80-3ac221561513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:32.031130 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114b51e-926e-4542-8a80-3ac221561513 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:32.031449 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114b51e-926e-4542-8a80-3ac221561513 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:32.031773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114b51e-926e-4542-8a80-3ac221561513 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:32.043648 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114b51e-926e-4542-8a80-3ac221561513 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:19:32.051394 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-f114b51e-926e-4542-8a80-3ac221561513 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:19:32.051394 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:32.051394 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:32.051394 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:32.051394 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:32.051394 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:32.051394 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:32.051394 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:32.051394 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:32.051394 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:32.051394 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:32.051394 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:32.051394 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:19:32.051394 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:19:32.051394 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:19:32.051394 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:19:32.052325 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:19:32.052325 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:19:32.052325 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:19:32.052325 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:19:32.052325 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:32.052325 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:32.052325 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:32.052325 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:32.052325 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:32.052325 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:32.052325 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:32.052325 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:32.052325 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:32.052325 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:32.052325 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:32.052325 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:32.053146 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:32.053146 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:32.053146 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:32.053146 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:32.053146 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:19:32.053146 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:19:32.053146 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:19:32.053146 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:19:32.053146 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:19:32.053146 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:19:32.053146 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:19:32.053146 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:32.057950 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 423/845] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:19:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:19:32.058658 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114b51e-926e-4542-8a80-3ac221561513 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:32.098782 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0008a-61de-4240-8ab8-61ae3c73772b None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:32.124954 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:32.138040 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4bcce-9e18-44b0-8eff-f13a396897a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:32.138707 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4bcce-9e18-44b0-8eff-f13a396897a8 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:32.138992 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4bcce-9e18-44b0-8eff-f13a396897a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:32.139305 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4bcce-9e18-44b0-8eff-f13a396897a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:32.140100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4bcce-9e18-44b0-8eff-f13a396897a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:32.140413 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4bcce-9e18-44b0-8eff-f13a396897a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:32.141887 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4bcce-9e18-44b0-8eff-f13a396897a8 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:32.156464 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 423/846] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:32.162215 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4bcce-9e18-44b0-8eff-f13a396897a8 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:32.175644 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:32.183099 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114b51e-926e-4542-8a80-3ac221561513 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:32.219606 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18d232-3de6-406e-8bdb-cc9a92fb2e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:32.220524 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18d232-3de6-406e-8bdb-cc9a92fb2e80 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:32.220951 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18d232-3de6-406e-8bdb-cc9a92fb2e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:32.221382 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18d232-3de6-406e-8bdb-cc9a92fb2e80 None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:32.222937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b18d232-3de6-406e-8bdb-cc9a92fb2e80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:32.223443 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b18d232-3de6-406e-8bdb-cc9a92fb2e80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:32.224982 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b18d232-3de6-406e-8bdb-cc9a92fb2e80 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:32.234582 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 424/847] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:19:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:32.239754 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18d232-3de6-406e-8bdb-cc9a92fb2e80 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:32.280680 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4bcce-9e18-44b0-8eff-f13a396897a8 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:32.327157 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855c4d8-a887-4b41-a0d4-c3438df43fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:32.328046 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855c4d8-a887-4b41-a0d4-c3438df43fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:32.328325 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855c4d8-a887-4b41-a0d4-c3438df43fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:32.328604 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855c4d8-a887-4b41-a0d4-c3438df43fc7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:32.337762 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855c4d8-a887-4b41-a0d4-c3438df43fc7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:32.339332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855c4d8-a887-4b41-a0d4-c3438df43fc7 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:32.355949 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-7855c4d8-a887-4b41-a0d4-c3438df43fc7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 15:19:32.355949 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:32.355949 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:32.355949 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:32.355949 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:32.355949 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:32.355949 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:32.355949 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:32.355949 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:32.355949 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:32.355949 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:32.355949 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:32.355949 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:19:32.355949 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:19:32.355949 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:19:32.355949 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:19:32.356962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:32.356962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:32.356962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:19:32.356962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:32.356962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:19:32.356962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:32.356962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:32.356962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:32.356962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:32.356962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:32.356962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:32.356962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:32.356962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:32.356962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:32.356962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:32.356962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:32.356962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:32.356962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:32.357896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:32.357896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:32.357896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:19:32.357896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:19:32.357896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:19:32.357896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:19:32.357896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:19:32.357896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:19:32.357896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 15:19:32.357896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:32.361842 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 424/848] 10.222.0.44 () {56 vars in 1117 bytes} [Tue Jul 19 15:19:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:32.363792 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855c4d8-a887-4b41-a0d4-c3438df43fc7 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:32.368806 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18d232-3de6-406e-8bdb-cc9a92fb2e80 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:32.412926 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:32.416830 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914127e-314e-4e7d-8fe0-548cd9efc9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:32.418485 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914127e-314e-4e7d-8fe0-548cd9efc9cd None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:32.418978 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914127e-314e-4e7d-8fe0-548cd9efc9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:32.419477 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914127e-314e-4e7d-8fe0-548cd9efc9cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:32.435751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914127e-314e-4e7d-8fe0-548cd9efc9cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:32.438365 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914127e-314e-4e7d-8fe0-548cd9efc9cd None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:32.464736 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-f914127e-314e-4e7d-8fe0-548cd9efc9cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:32.464736 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:32.464736 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:32.464736 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:32.464736 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:32.464736 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:32.464736 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:32.464736 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:32.464736 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:32.464736 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:32.464736 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:32.464736 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:32.464736 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:32.464736 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:32.464736 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:32.465668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:32.465668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:32.465668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:32.465668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:32.465668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:32.465668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:32.465668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:32.465668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:32.465668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:32.465668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:32.465668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:32.465668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:32.465668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:32.465668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:32.465668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:32.465668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:32.465668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:32.466555 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:32.466555 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:32.466555 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:32.466555 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:32.469210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 425/849] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:19:32.475315 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914127e-314e-4e7d-8fe0-548cd9efc9cd None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:32.478101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855c4d8-a887-4b41-a0d4-c3438df43fc7 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:32.489371 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:32.519597 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfa8fc-80cd-4f96-90c4-b011b602eed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:32.520555 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfa8fc-80cd-4f96-90c4-b011b602eed0 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:32.520943 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfa8fc-80cd-4f96-90c4-b011b602eed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:32.521321 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfa8fc-80cd-4f96-90c4-b011b602eed0 None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:32.522439 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dfa8fc-80cd-4f96-90c4-b011b602eed0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:32.522850 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dfa8fc-80cd-4f96-90c4-b011b602eed0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:32.524442 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dfa8fc-80cd-4f96-90c4-b011b602eed0 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:32.548449 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 425/850] 10.222.0.44 () {56 vars in 1149 bytes} [Tue Jul 19 15:19:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:32.550411 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfa8fc-80cd-4f96-90c4-b011b602eed0 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:32.611408 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914127e-314e-4e7d-8fe0-548cd9efc9cd None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:32.649245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d028bda-1c88-4ef6-9f4d-63748e43063e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:32.650068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d028bda-1c88-4ef6-9f4d-63748e43063e None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:32.650456 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d028bda-1c88-4ef6-9f4d-63748e43063e None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:32.650838 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d028bda-1c88-4ef6-9f4d-63748e43063e None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:32.651824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d028bda-1c88-4ef6-9f4d-63748e43063e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:32.652144 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d028bda-1c88-4ef6-9f4d-63748e43063e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:32.653632 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d028bda-1c88-4ef6-9f4d-63748e43063e None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:32.666862 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 426/851] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:32.668477 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114a1e3-3632-43ab-b46d-a7427070f55b None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:32.668873 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114a1e3-3632-43ab-b46d-a7427070f55b None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:32.669259 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114a1e3-3632-43ab-b46d-a7427070f55b None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:32.670865 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 427/852] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:32.673310 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114a1e3-3632-43ab-b46d-a7427070f55b None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:32.675423 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfa8fc-80cd-4f96-90c4-b011b602eed0 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:32.677504 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:32.715248 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44e184-2568-4918-b652-a082d8a7a5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:32.715923 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44e184-2568-4918-b652-a082d8a7a5ff None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:32.716213 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44e184-2568-4918-b652-a082d8a7a5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:32.716495 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44e184-2568-4918-b652-a082d8a7a5ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:32.745547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:32.782624 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114a1e3-3632-43ab-b46d-a7427070f55b None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:32.792853 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44e184-2568-4918-b652-a082d8a7a5ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:32.794304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44e184-2568-4918-b652-a082d8a7a5ff None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:32.819490 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a010bc-f72e-4dcc-a28e-08fb24400414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:32.820313 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a010bc-f72e-4dcc-a28e-08fb24400414 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:32.820600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a010bc-f72e-4dcc-a28e-08fb24400414 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:32.820878 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a010bc-f72e-4dcc-a28e-08fb24400414 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:32.829159 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a010bc-f72e-4dcc-a28e-08fb24400414 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:32.830605 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a010bc-f72e-4dcc-a28e-08fb24400414 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:32.850620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-60a010bc-f72e-4dcc-a28e-08fb24400414 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 15:19:32.850620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:32.850620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:32.850620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:32.850620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:32.850620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:32.850620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:32.850620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:32.850620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:32.850620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:32.850620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:32.850620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:32.850620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:19:32.850620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:19:32.850620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:19:32.850620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:19:32.851793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:32.851793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:32.851793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:19:32.851793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:32.851793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:19:32.851793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:32.851793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:32.851793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:32.851793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:32.851793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:32.851793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:32.851793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:32.851793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:32.851793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:32.851793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:32.851793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:32.851793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:32.851793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:32.853049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:32.853049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:32.853049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:19:32.853049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:19:32.853049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:19:32.853049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:19:32.853049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:19:32.853049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:19:32.853049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 15:19:32.853049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:32.858095 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 428/853] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:19:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:19:32.859691 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5e982-ffe2-4a61-a2c0-4ffbeadd1c82 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:32.859989 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5e982-ffe2-4a61-a2c0-4ffbeadd1c82 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:32.860276 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5e982-ffe2-4a61-a2c0-4ffbeadd1c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:32.878653 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-63f5e982-ffe2-4a61-a2c0-4ffbeadd1c82 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:32.879892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-63f5e982-ffe2-4a61-a2c0-4ffbeadd1c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:32.914688 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 426/854] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:19:32 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:19:32.915872 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44e184-2568-4918-b652-a082d8a7a5ff None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:32.922189 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:32.967378 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 429/855] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:19:32.968306 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5e982-ffe2-4a61-a2c0-4ffbeadd1c82 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:33.023731 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44e184-2568-4918-b652-a082d8a7a5ff None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:33.035648 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:33.067168 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f025d-8a30-4418-a162-ac8052e7a9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:33.067874 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f025d-8a30-4418-a162-ac8052e7a9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:33.068313 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f025d-8a30-4418-a162-ac8052e7a9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:33.068599 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f025d-8a30-4418-a162-ac8052e7a9e1 None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:33.069499 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f025d-8a30-4418-a162-ac8052e7a9e1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:33.069815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f025d-8a30-4418-a162-ac8052e7a9e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:33.071270 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f025d-8a30-4418-a162-ac8052e7a9e1 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:33.079058 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5e982-ffe2-4a61-a2c0-4ffbeadd1c82 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:33.090691 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 427/856] 10.222.0.44 () {56 vars in 1135 bytes} [Tue Jul 19 15:19:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:33.091565 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f025d-8a30-4418-a162-ac8052e7a9e1 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:33.118080 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05340824-718c-4236-8510-e0eb32e949d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:33.119117 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05340824-718c-4236-8510-e0eb32e949d9 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:33.119439 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05340824-718c-4236-8510-e0eb32e949d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:33.119717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05340824-718c-4236-8510-e0eb32e949d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:33.131963 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05340824-718c-4236-8510-e0eb32e949d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:33.133387 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05340824-718c-4236-8510-e0eb32e949d9 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:33.150837 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-05340824-718c-4236-8510-e0eb32e949d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:33.150837 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:33.150837 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:33.150837 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:33.150837 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:33.150837 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:33.150837 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:33.150837 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:33.150837 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:33.150837 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:33.150837 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:33.150837 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:33.150837 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:33.150837 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:33.150837 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:33.151970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:33.151970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:33.151970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:33.151970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:33.151970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:33.151970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:33.151970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:33.151970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:33.151970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:33.151970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:33.151970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:33.151970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:33.151970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:33.151970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:33.151970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:33.151970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:33.151970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:33.152863 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:33.152863 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:33.152863 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:33.152863 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:33.152863 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 430/857] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:33.152863 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05340824-718c-4236-8510-e0eb32e949d9 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:33.160394 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:33.205296 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f025d-8a30-4418-a162-ac8052e7a9e1 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:33.242925 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae4bd6-df83-4e99-bd01-d93bdd6528ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:33.243768 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae4bd6-df83-4e99-bd01-d93bdd6528ed None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:33.244055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae4bd6-df83-4e99-bd01-d93bdd6528ed None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:33.244332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae4bd6-df83-4e99-bd01-d93bdd6528ed None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:33.244991 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae4bd6-df83-4e99-bd01-d93bdd6528ed None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:33.246359 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae4bd6-df83-4e99-bd01-d93bdd6528ed None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:33.258914 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-3bae4bd6-df83-4e99-bd01-d93bdd6528ed None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 15:19:33.258914 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:33.258914 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:19:33.258914 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:19:33.258914 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:19:33.258914 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:19:33.258914 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:19:33.258914 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:33.258914 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 15:19:33.258914 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:33.258914 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:19:33.258914 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:33.258914 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:33.258914 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:33.258914 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:33.258914 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:33.260146 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:33.260146 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:33.260146 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:33.260146 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:33.260146 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:33.260146 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:33.260146 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:33.260146 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:19:33.260146 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:19:33.260146 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:19:33.260146 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:19:33.260146 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:33.260146 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:33.260146 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:33.260146 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:33.260146 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:33.260981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:33.260981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:33.260981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:33.260981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:33.260981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:33.260981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:33.260981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:33.260981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:33.260981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:33.260981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:33.260981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:33.260981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:19:33.260981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:33.260981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 15:19:33.260981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:33.260981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 428/858] 10.222.0.44 () {56 vars in 1132 bytes} [Tue Jul 19 15:19:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:33.261834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae4bd6-df83-4e99-bd01-d93bdd6528ed None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:33.271211 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05340824-718c-4236-8510-e0eb32e949d9 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:33.282155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:33.310007 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb890620-041b-4aea-8b21-fe668cc94fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:33.311202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb890620-041b-4aea-8b21-fe668cc94fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:33.311728 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb890620-041b-4aea-8b21-fe668cc94fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:33.312323 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb890620-041b-4aea-8b21-fe668cc94fb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:33.377041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae4bd6-df83-4e99-bd01-d93bdd6528ed None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:33.389812 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb890620-041b-4aea-8b21-fe668cc94fb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:33.391631 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb890620-041b-4aea-8b21-fe668cc94fb8 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:33.406537 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:33.418464 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943f2cc-6de1-4afb-8afe-b71a1adf4b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:33.419132 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943f2cc-6de1-4afb-8afe-b71a1adf4b10 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:33.419443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943f2cc-6de1-4afb-8afe-b71a1adf4b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:33.419723 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943f2cc-6de1-4afb-8afe-b71a1adf4b10 None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:33.420519 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943f2cc-6de1-4afb-8afe-b71a1adf4b10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:33.420754 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943f2cc-6de1-4afb-8afe-b71a1adf4b10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:33.422213 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943f2cc-6de1-4afb-8afe-b71a1adf4b10 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:33.434939 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 429/859] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:33.435829 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943f2cc-6de1-4afb-8afe-b71a1adf4b10 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:33.506768 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 431/860] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:19:33 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:19:33.507664 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb890620-041b-4aea-8b21-fe668cc94fb8 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:33.525680 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:33.576592 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943f2cc-6de1-4afb-8afe-b71a1adf4b10 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:33.614447 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37c1a1-3a8b-466a-acc7-9a2938d129c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:33.615121 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37c1a1-3a8b-466a-acc7-9a2938d129c6 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:33.615451 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37c1a1-3a8b-466a-acc7-9a2938d129c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:33.615727 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37c1a1-3a8b-466a-acc7-9a2938d129c6 None admin] PATH_INFO: `/v3/services` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:33.616436 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37c1a1-3a8b-466a-acc7-9a2938d129c6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:33.616740 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37c1a1-3a8b-466a-acc7-9a2938d129c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:33.618177 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37c1a1-3a8b-466a-acc7-9a2938d129c6 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:33.623141 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 430/861] 10.222.0.44 () {56 vars in 1126 bytes} [Tue Jul 19 15:19:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:33.629185 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37c1a1-3a8b-466a-acc7-9a2938d129c6 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:33.640000 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb890620-041b-4aea-8b21-fe668cc94fb8 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:33.678972 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411de37-d08d-4218-9440-8467c2f1fb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:33.679813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411de37-d08d-4218-9440-8467c2f1fb37 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:33.680102 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411de37-d08d-4218-9440-8467c2f1fb37 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:33.680482 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411de37-d08d-4218-9440-8467c2f1fb37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:33.688443 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411de37-d08d-4218-9440-8467c2f1fb37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:33.689457 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:33.689941 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411de37-d08d-4218-9440-8467c2f1fb37 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:33.707575 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-8411de37-d08d-4218-9440-8467c2f1fb37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:33.707575 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:33.707575 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:33.707575 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:33.707575 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:33.707575 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:33.707575 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:33.707575 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:33.707575 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:33.707575 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:33.707575 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:33.707575 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:33.707575 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:19:33.707575 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:19:33.707575 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:19:33.709235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:19:33.709235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:33.709235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:33.709235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:33.709235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:33.709235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:33.709235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:33.709235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:33.709235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:33.709235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:33.709235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:33.709235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:33.709235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:33.709235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:33.709235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:33.709235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:33.709235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:33.710600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:19:33.710600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:19:33.710600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:19:33.710600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:19:33.710600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:19:33.710600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:19:33.710600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:33.710600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:33.710600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 432/862] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:19:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:33.710600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411de37-d08d-4218-9440-8467c2f1fb37 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:33.755992 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37c1a1-3a8b-466a-acc7-9a2938d129c6 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:33.792169 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:33.796212 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094f4bf-4ff4-4cd3-a387-60c9a3e50057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:33.797011 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094f4bf-4ff4-4cd3-a387-60c9a3e50057 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:33.797299 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094f4bf-4ff4-4cd3-a387-60c9a3e50057 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:33.797578 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094f4bf-4ff4-4cd3-a387-60c9a3e50057 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:33.808985 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094f4bf-4ff4-4cd3-a387-60c9a3e50057 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:33.810430 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094f4bf-4ff4-4cd3-a387-60c9a3e50057 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:33.825278 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411de37-d08d-4218-9440-8467c2f1fb37 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:33.829714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-1094f4bf-4ff4-4cd3-a387-60c9a3e50057 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:33.829714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:33.829714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:33.829714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:33.829714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:33.829714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:33.829714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:33.829714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:33.829714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:33.829714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:33.829714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:33.829714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:33.829714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:33.829714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:33.829714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:33.830689 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:33.830689 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:33.830689 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:33.830689 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:33.830689 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:33.830689 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:33.830689 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:33.830689 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:33.830689 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:33.830689 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:33.830689 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:33.830689 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:33.830689 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:33.830689 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:33.830689 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:33.830689 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:33.830689 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:33.832553 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:33.832553 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:33.832553 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:33.832553 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:33.832553 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 431/863] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:33.832553 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094f4bf-4ff4-4cd3-a387-60c9a3e50057 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:33.863041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d617ebf-ec3f-4230-9e73-4db34748eca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:33.863751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d617ebf-ec3f-4230-9e73-4db34748eca7 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:33.864041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d617ebf-ec3f-4230-9e73-4db34748eca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:33.864445 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d617ebf-ec3f-4230-9e73-4db34748eca7 None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:33.865191 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d617ebf-ec3f-4230-9e73-4db34748eca7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:33.865499 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d617ebf-ec3f-4230-9e73-4db34748eca7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:33.866862 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d617ebf-ec3f-4230-9e73-4db34748eca7 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:33.871552 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 433/864] 10.222.0.44 () {56 vars in 1126 bytes} [Tue Jul 19 15:19:33 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:33.872799 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590d78d-e090-4973-b178-118132c3f4e8 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:33.873104 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590d78d-e090-4973-b178-118132c3f4e8 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:33.873370 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590d78d-e090-4973-b178-118132c3f4e8 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:33.879686 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 434/865] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:33.880673 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590d78d-e090-4973-b178-118132c3f4e8 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:33.974796 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:33.979648 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094f4bf-4ff4-4cd3-a387-60c9a3e50057 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:34.040132 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321eb6f-01a6-48be-aa8f-cba818e68d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:34.040942 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321eb6f-01a6-48be-aa8f-cba818e68d6b None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:34.041924 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321eb6f-01a6-48be-aa8f-cba818e68d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:34.041924 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321eb6f-01a6-48be-aa8f-cba818e68d6b None admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:34.043325 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321eb6f-01a6-48be-aa8f-cba818e68d6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:34.043857 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321eb6f-01a6-48be-aa8f-cba818e68d6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:34.046178 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321eb6f-01a6-48be-aa8f-cba818e68d6b None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:34.048672 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590d78d-e090-4973-b178-118132c3f4e8 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:34.062182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 432/866] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:19:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:34.063525 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e9420-8e83-4867-b877-264531122bc5 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:34.063868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e9420-8e83-4867-b877-264531122bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:34.064184 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e9420-8e83-4867-b877-264531122bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:34.084355 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-4d7e9420-8e83-4867-b877-264531122bc5 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:34.085666 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-4d7e9420-8e83-4867-b877-264531122bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:34.096259 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40f13f-bb9e-4344-aa12-1caa9ec635cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:34.096981 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40f13f-bb9e-4344-aa12-1caa9ec635cb None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:34.097268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40f13f-bb9e-4344-aa12-1caa9ec635cb None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:34.097543 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40f13f-bb9e-4344-aa12-1caa9ec635cb None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:34.098272 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40f13f-bb9e-4344-aa12-1caa9ec635cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:34.098694 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40f13f-bb9e-4344-aa12-1caa9ec635cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:34.099970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40f13f-bb9e-4344-aa12-1caa9ec635cb None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:34.101817 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:34.119839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 435/867] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:34.119839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40f13f-bb9e-4344-aa12-1caa9ec635cb None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:34.168332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 433/868] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:19:34.169189 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e9420-8e83-4867-b877-264531122bc5 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:34.231773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40f13f-bb9e-4344-aa12-1caa9ec635cb None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:34.266381 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:34.268831 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52573f03-14bc-4890-96fa-e88a88c98943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:34.269420 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52573f03-14bc-4890-96fa-e88a88c98943 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:34.269705 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52573f03-14bc-4890-96fa-e88a88c98943 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:34.269988 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52573f03-14bc-4890-96fa-e88a88c98943 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:34.270838 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52573f03-14bc-4890-96fa-e88a88c98943 None admin] RBAC: Adding query filter params (role.id=1ff62289fb434d09a13001c3ffbab080, scope.project.id=c54934775a86487295bdbc02ed3a0103, user.id=cea1d8409c754ec797d6c694481a3112) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:34.271118 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52573f03-14bc-4890-96fa-e88a88c98943 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:34.272643 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52573f03-14bc-4890-96fa-e88a88c98943 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:34.277304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e9420-8e83-4867-b877-264531122bc5 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:34.287391 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 436/869] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:19:34 2022] GET /identity/v3/role_assignments?user.id=cea1d8409c754ec797d6c694481a3112&scope.project.id=c54934775a86487295bdbc02ed3a0103&role.id=1ff62289fb434d09a13001c3ffbab080 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:34.287391 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52573f03-14bc-4890-96fa-e88a88c98943 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:34.319293 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db9b20-f529-4625-b9b7-0551163d3b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:34.320196 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db9b20-f529-4625-b9b7-0551163d3b8e None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:34.320485 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db9b20-f529-4625-b9b7-0551163d3b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:34.320818 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db9b20-f529-4625-b9b7-0551163d3b8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:34.328772 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db9b20-f529-4625-b9b7-0551163d3b8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:34.330349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db9b20-f529-4625-b9b7-0551163d3b8e None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:34.346420 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-a2db9b20-f529-4625-b9b7-0551163d3b8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:34.346420 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:34.346420 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:34.346420 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:34.346420 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:34.346420 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:34.346420 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:34.346420 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:34.346420 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:34.346420 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:34.346420 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:34.346420 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:34.346420 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:19:34.346420 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:19:34.346420 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:19:34.347414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:19:34.347414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:34.347414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:34.347414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:34.347414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:34.347414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:34.347414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:34.347414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:34.347414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:34.347414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:34.347414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:34.347414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:34.347414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:34.347414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:34.347414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:34.347414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:34.347414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:34.348304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:19:34.348304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:19:34.348304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:19:34.348304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:19:34.348304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:19:34.348304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:19:34.348304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:34.348304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:34.352647 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 434/870] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:19:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:34.353608 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db9b20-f529-4625-b9b7-0551163d3b8e None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:34.365051 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:34.427454 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52573f03-14bc-4890-96fa-e88a88c98943 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:34.473313 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446287e-9fdb-4ecd-9cdc-66b1f9fbd710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:34.473992 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446287e-9fdb-4ecd-9cdc-66b1f9fbd710 None admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:34.474278 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446287e-9fdb-4ecd-9cdc-66b1f9fbd710 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:34.474557 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446287e-9fdb-4ecd-9cdc-66b1f9fbd710 None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:34.475324 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446287e-9fdb-4ecd-9cdc-66b1f9fbd710 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:34.476687 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446287e-9fdb-4ecd-9cdc-66b1f9fbd710 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:34.479167 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db9b20-f529-4625-b9b7-0551163d3b8e None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:34.495648 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 437/871] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jul 19 15:19:34 2022] POST /identity/v3/services => generated 251 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:19:34.524316 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd529b-420a-432f-bc7a-43b7746bfa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:34.525002 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd529b-420a-432f-bc7a-43b7746bfa3c None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:34.525288 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd529b-420a-432f-bc7a-43b7746bfa3c None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:34.525564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd529b-420a-432f-bc7a-43b7746bfa3c None admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:34.526374 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd529b-420a-432f-bc7a-43b7746bfa3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:34.526685 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd529b-420a-432f-bc7a-43b7746bfa3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:34.528191 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd529b-420a-432f-bc7a-43b7746bfa3c None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:34.542991 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 435/872] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:19:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:34.549212 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446287e-9fdb-4ecd-9cdc-66b1f9fbd710 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:34.668409 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446287e-9fdb-4ecd-9cdc-66b1f9fbd710 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:34.688940 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:34.708776 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77c5f2-800a-4836-bcce-48d3d7dae61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:34.709445 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77c5f2-800a-4836-bcce-48d3d7dae61c None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:34.709727 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77c5f2-800a-4836-bcce-48d3d7dae61c None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:34.710005 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77c5f2-800a-4836-bcce-48d3d7dae61c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:34.710850 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77c5f2-800a-4836-bcce-48d3d7dae61c None admin] RBAC: Adding query filter params (role.id=d884ddf33c1440d9b3a3351b85e83e76, scope.project.id=c54934775a86487295bdbc02ed3a0103, user.id=bd1dceaddb6e414faef0e0448cdf1be8) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:34.711163 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77c5f2-800a-4836-bcce-48d3d7dae61c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:34.712616 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77c5f2-800a-4836-bcce-48d3d7dae61c None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:34.720616 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 438/873] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:19:34 2022] GET /identity/v3/role_assignments?user.id=bd1dceaddb6e414faef0e0448cdf1be8&scope.project.id=c54934775a86487295bdbc02ed3a0103&role.id=d884ddf33c1440d9b3a3351b85e83e76 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:36.026521 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77faf4-f33f-4430-9fb7-e3358e609fed None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:36.027075 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77faf4-f33f-4430-9fb7-e3358e609fed None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:36.027075 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77faf4-f33f-4430-9fb7-e3358e609fed None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:36.028738 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 436/874] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:36.034788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae19d1-baf2-4fe4-91ec-6bb53f387f65 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:36.035286 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae19d1-baf2-4fe4-91ec-6bb53f387f65 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:36.035518 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae19d1-baf2-4fe4-91ec-6bb53f387f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:36.052140 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-4aae19d1-baf2-4fe4-91ec-6bb53f387f65 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:36.053339 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-4aae19d1-baf2-4fe4-91ec-6bb53f387f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:36.126153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 439/875] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:36 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:19:36.148817 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77faf4-f33f-4430-9fb7-e3358e609fed None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:36.158279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:36.262735 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77faf4-f33f-4430-9fb7-e3358e609fed None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:36.300775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2092de6-d172-4ccb-8021-7d840112f527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:36.301702 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2092de6-d172-4ccb-8021-7d840112f527 None admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:36.302138 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2092de6-d172-4ccb-8021-7d840112f527 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:36.302592 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2092de6-d172-4ccb-8021-7d840112f527 None admin] PATH_INFO: `/v3/services` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:36.303513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2092de6-d172-4ccb-8021-7d840112f527 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:36.305027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2092de6-d172-4ccb-8021-7d840112f527 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:36.321906 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 437/876] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jul 19 15:19:36 2022] POST /identity/v3/services => generated 269 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:19:36.561584 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6bf43-23d9-4103-bbfa-9daba5c1500d None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:36.562230 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6bf43-23d9-4103-bbfa-9daba5c1500d None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:36.562798 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6bf43-23d9-4103-bbfa-9daba5c1500d None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:36.564729 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 440/877] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:36.570984 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9afdd6-34c7-4cbb-ba3e-77e875db981c None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:36.571586 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9afdd6-34c7-4cbb-ba3e-77e875db981c None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:36.572085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9afdd6-34c7-4cbb-ba3e-77e875db981c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:36.590560 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-ab9afdd6-34c7-4cbb-ba3e-77e875db981c None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:36.592166 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-ab9afdd6-34c7-4cbb-ba3e-77e875db981c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:36.614275 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fa678-4485-436c-82c1-f0fa46e69651 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:36.614583 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fa678-4485-436c-82c1-f0fa46e69651 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:36.614841 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fa678-4485-436c-82c1-f0fa46e69651 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:36.616501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 441/878] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:36.621776 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13804a41-87f9-453c-97ed-dc36dcf1b9f4 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:36.622222 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13804a41-87f9-453c-97ed-dc36dcf1b9f4 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:36.622638 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13804a41-87f9-453c-97ed-dc36dcf1b9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:36.641600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-13804a41-87f9-453c-97ed-dc36dcf1b9f4 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:36.643751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-13804a41-87f9-453c-97ed-dc36dcf1b9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:36.661975 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:36.678582 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 438/879] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:19:36.703035 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9afdd6-34c7-4cbb-ba3e-77e875db981c None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:36.746594 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 442/880] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:19:36.768586 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13804a41-87f9-453c-97ed-dc36dcf1b9f4 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:36.829163 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:36.832044 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9afdd6-34c7-4cbb-ba3e-77e875db981c None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:36.875692 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ec317-6bef-479b-b294-46d0f081fb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:36.876860 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ec317-6bef-479b-b294-46d0f081fb91 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:36.877146 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ec317-6bef-479b-b294-46d0f081fb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:36.877426 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ec317-6bef-479b-b294-46d0f081fb91 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:36.888204 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ec317-6bef-479b-b294-46d0f081fb91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:19:36.896416 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-2d7ec317-6bef-479b-b294-46d0f081fb91 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 15:19:36.896416 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:36.896416 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:36.896416 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:36.896416 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:36.896416 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:36.896416 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:36.896416 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:36.896416 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:36.896416 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:36.896416 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:36.896416 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:36.896416 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:19:36.896416 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:19:36.896416 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:19:36.896416 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:19:36.897379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:19:36.897379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:19:36.897379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:19:36.897379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:19:36.897379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:36.897379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:36.897379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:36.897379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:36.897379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:36.897379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:36.897379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:36.897379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:36.897379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:36.897379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:36.897379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:36.897379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:36.898244 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:36.898244 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:36.898244 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:36.898244 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:36.898244 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:19:36.898244 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:19:36.898244 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:19:36.898244 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:19:36.898244 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:19:36.898244 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:19:36.898244 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 15:19:36.898244 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:36.898244 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 439/881] 10.222.0.44 () {56 vars in 1120 bytes} [Tue Jul 19 15:19:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:36.898939 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a8fbe-32e6-4236-9d37-2328b7721560 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:36.899399 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a8fbe-32e6-4236-9d37-2328b7721560 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:36.899399 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a8fbe-32e6-4236-9d37-2328b7721560 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:36.900814 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 440/882] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:36.904082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a8fbe-32e6-4236-9d37-2328b7721560 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:36.906599 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13804a41-87f9-453c-97ed-dc36dcf1b9f4 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:36.949112 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862d70b-c7d1-4c65-a030-7f02ae5fa419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:36.950539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862d70b-c7d1-4c65-a030-7f02ae5fa419 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:36.950539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862d70b-c7d1-4c65-a030-7f02ae5fa419 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:36.950539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862d70b-c7d1-4c65-a030-7f02ae5fa419 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:36.951106 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862d70b-c7d1-4c65-a030-7f02ae5fa419 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:36.952609 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862d70b-c7d1-4c65-a030-7f02ae5fa419 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:36.965462 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-5862d70b-c7d1-4c65-a030-7f02ae5fa419 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 15:19:36.965462 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:36.965462 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:19:36.965462 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:19:36.965462 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:19:36.965462 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:19:36.965462 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:19:36.965462 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:36.965462 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 15:19:36.965462 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:36.965462 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:19:36.965462 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:36.965462 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:36.965462 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:36.965462 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:36.965462 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:36.965462 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:36.966501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:36.966501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:36.966501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:36.966501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:36.966501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:36.966501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:36.966501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:19:36.966501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:19:36.966501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:19:36.966501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:19:36.966501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:36.966501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:36.966501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:36.966501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:36.966501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:36.966501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:36.967812 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:36.967812 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:36.967812 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:36.967812 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:36.967812 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:36.967812 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:36.967812 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:36.967812 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:36.967812 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:36.967812 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:36.967812 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:19:36.967812 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:36.967812 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 15:19:36.967812 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:36.967812 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 443/883] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 19 15:19:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:36.969186 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5635f-b82c-4c98-8745-c25f7ac11adb None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:36.969186 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5635f-b82c-4c98-8745-c25f7ac11adb None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:36.969186 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5635f-b82c-4c98-8745-c25f7ac11adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:36.976179 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:36.986801 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-55b5635f-b82c-4c98-8745-c25f7ac11adb None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:36.988605 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-55b5635f-b82c-4c98-8745-c25f7ac11adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:37.028511 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a8fbe-32e6-4236-9d37-2328b7721560 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:37.067246 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 444/884] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:19:37.067246 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5635f-b82c-4c98-8745-c25f7ac11adb None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:37.080734 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a66279-9969-4fd9-a736-11d768e47fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:37.081837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a66279-9969-4fd9-a736-11d768e47fcc None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:37.082266 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a66279-9969-4fd9-a736-11d768e47fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:37.082684 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a66279-9969-4fd9-a736-11d768e47fcc None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:37.083536 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a66279-9969-4fd9-a736-11d768e47fcc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:37.084061 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a66279-9969-4fd9-a736-11d768e47fcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:37.086068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a66279-9969-4fd9-a736-11d768e47fcc None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:37.095444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:37.100676 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 441/885] 10.222.0.44 () {56 vars in 1115 bytes} [Tue Jul 19 15:19:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:37.101484 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a66279-9969-4fd9-a736-11d768e47fcc None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:37.168404 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5635f-b82c-4c98-8745-c25f7ac11adb None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:37.204148 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3e8f8-5ee8-4649-983b-8c3d57d5f082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:37.204816 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3e8f8-5ee8-4649-983b-8c3d57d5f082 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:37.205101 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3e8f8-5ee8-4649-983b-8c3d57d5f082 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:37.205378 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3e8f8-5ee8-4649-983b-8c3d57d5f082 None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:37.206618 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3e8f8-5ee8-4649-983b-8c3d57d5f082 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:37.206790 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a66279-9969-4fd9-a736-11d768e47fcc None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:37.206969 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3e8f8-5ee8-4649-983b-8c3d57d5f082 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:37.208450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3e8f8-5ee8-4649-983b-8c3d57d5f082 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:37.214610 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 445/886] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 19 15:19:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:37.216647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3e8f8-5ee8-4649-983b-8c3d57d5f082 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:37.226716 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:37.248473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1d71a-0890-4a0f-8666-3197d45cec84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:37.249274 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1d71a-0890-4a0f-8666-3197d45cec84 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:37.249558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1d71a-0890-4a0f-8666-3197d45cec84 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:37.249833 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1d71a-0890-4a0f-8666-3197d45cec84 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:37.250482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1d71a-0890-4a0f-8666-3197d45cec84 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:37.251896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1d71a-0890-4a0f-8666-3197d45cec84 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:37.268200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-18e1d71a-0890-4a0f-8666-3197d45cec84 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 15:19:37.268200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:37.268200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:19:37.268200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:19:37.268200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:19:37.268200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:19:37.268200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:19:37.268200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:37.268200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 15:19:37.268200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:37.268200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:19:37.268200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:37.268200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:37.268200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:37.268200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:37.268200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:37.268200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:37.269433 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:37.269433 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:37.269433 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:37.269433 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:37.269433 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:37.269433 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:37.269433 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:19:37.269433 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:19:37.269433 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:19:37.269433 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:19:37.269433 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:37.269433 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:37.269433 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:37.269433 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:37.269433 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:37.269433 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:37.270531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:37.270531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:37.270531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:37.270531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:37.270531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:37.270531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:37.270531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:37.270531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:37.270531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:37.270531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:37.270531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:19:37.270531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:37.270531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 15:19:37.270531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:37.271893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 442/887] 10.222.0.44 () {56 vars in 1126 bytes} [Tue Jul 19 15:19:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:37.272566 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1d71a-0890-4a0f-8666-3197d45cec84 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:37.330097 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:37.333714 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3e8f8-5ee8-4649-983b-8c3d57d5f082 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:37.371817 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d90feb-858f-4dc3-959b-776be84418aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:37.372913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d90feb-858f-4dc3-959b-776be84418aa None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:37.373302 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d90feb-858f-4dc3-959b-776be84418aa None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:37.373457 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d90feb-858f-4dc3-959b-776be84418aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:37.383624 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1d71a-0890-4a0f-8666-3197d45cec84 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:37.384376 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d90feb-858f-4dc3-959b-776be84418aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:37.385839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d90feb-858f-4dc3-959b-776be84418aa None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:37.404155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-85d90feb-858f-4dc3-959b-776be84418aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:37.404155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:37.404155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:37.404155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:37.404155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:37.404155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:37.404155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:37.404155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:37.404155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:37.404155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:37.404155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:37.404155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:37.404155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:37.404155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:37.404155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:37.405378 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:37.405378 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:37.405378 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:37.405378 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:37.405378 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:37.405378 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:37.405378 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:37.405378 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:37.405378 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:37.405378 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:37.405378 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:37.405378 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:37.405378 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:37.405378 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:37.405378 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:37.405378 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:37.405378 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:37.406275 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:37.406275 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:37.406275 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:37.406275 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:37.406275 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 446/888] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:37.406585 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d90feb-858f-4dc3-959b-776be84418aa None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:37.425028 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fee40f-b6af-4d33-be5e-6793e9f0d26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:37.425690 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fee40f-b6af-4d33-be5e-6793e9f0d26a None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:37.425986 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fee40f-b6af-4d33-be5e-6793e9f0d26a None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:37.426265 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fee40f-b6af-4d33-be5e-6793e9f0d26a None admin] PATH_INFO: `/v3/services` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:37.427187 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fee40f-b6af-4d33-be5e-6793e9f0d26a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:37.427314 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fee40f-b6af-4d33-be5e-6793e9f0d26a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:37.428678 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fee40f-b6af-4d33-be5e-6793e9f0d26a None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:37.434478 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 443/889] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 19 15:19:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:37.435153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fee40f-b6af-4d33-be5e-6793e9f0d26a None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:37.485968 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:37.523975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d90feb-858f-4dc3-959b-776be84418aa None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:37.549259 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fee40f-b6af-4d33-be5e-6793e9f0d26a None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:37.562213 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a48412-7d46-4bc1-b318-4668e9661c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:37.563454 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a48412-7d46-4bc1-b318-4668e9661c64 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:37.563818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a48412-7d46-4bc1-b318-4668e9661c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:37.564104 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a48412-7d46-4bc1-b318-4668e9661c64 None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:37.564821 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a48412-7d46-4bc1-b318-4668e9661c64 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:37.565136 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a48412-7d46-4bc1-b318-4668e9661c64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:37.567294 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a48412-7d46-4bc1-b318-4668e9661c64 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:37.572425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 447/890] 10.222.0.44 () {56 vars in 1122 bytes} [Tue Jul 19 15:19:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:37.573108 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a48412-7d46-4bc1-b318-4668e9661c64 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:37.590111 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdc7dd-4d69-4634-bbaf-440f31ac2316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:37.590758 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdc7dd-4d69-4634-bbaf-440f31ac2316 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:37.591044 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdc7dd-4d69-4634-bbaf-440f31ac2316 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:37.591396 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdc7dd-4d69-4634-bbaf-440f31ac2316 None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:37.592107 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:37.592234 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fdc7dd-4d69-4634-bbaf-440f31ac2316 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:37.592430 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fdc7dd-4d69-4634-bbaf-440f31ac2316 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:37.593853 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fdc7dd-4d69-4634-bbaf-440f31ac2316 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:37.607097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 444/891] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:37.608046 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdc7dd-4d69-4634-bbaf-440f31ac2316 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:37.683922 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a48412-7d46-4bc1-b318-4668e9661c64 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:37.711558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdc7dd-4d69-4634-bbaf-440f31ac2316 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:37.713160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:37.720199 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb3aed-b78f-4560-9456-56b12c7e2025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:37.720886 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb3aed-b78f-4560-9456-56b12c7e2025 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:37.721174 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb3aed-b78f-4560-9456-56b12c7e2025 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:37.721454 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb3aed-b78f-4560-9456-56b12c7e2025 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:37.722314 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb3aed-b78f-4560-9456-56b12c7e2025 None admin] RBAC: Adding query filter params (interface=public, service_id=a3df2e02ef2b4cf1903c97c2a4e7a31b, region_id=RegionOne) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:37.722631 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb3aed-b78f-4560-9456-56b12c7e2025 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:37.724047 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb3aed-b78f-4560-9456-56b12c7e2025 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:37.731592 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 448/892] 10.222.0.44 () {56 vars in 1251 bytes} [Tue Jul 19 15:19:37 2022] GET /identity/v3/endpoints?service_id=a3df2e02ef2b4cf1903c97c2a4e7a31b&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:37.732380 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb3aed-b78f-4560-9456-56b12c7e2025 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:37.755004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c64ec-60bd-4d4d-99d6-924eb443c850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:37.755993 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c64ec-60bd-4d4d-99d6-924eb443c850 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:37.756430 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c64ec-60bd-4d4d-99d6-924eb443c850 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:37.756859 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c64ec-60bd-4d4d-99d6-924eb443c850 None admin] PATH_INFO: `/v3/services` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:37.757845 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c64ec-60bd-4d4d-99d6-924eb443c850 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:37.758357 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c64ec-60bd-4d4d-99d6-924eb443c850 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:37.759953 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c64ec-60bd-4d4d-99d6-924eb443c850 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:37.775427 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 445/893] 10.222.0.44 () {56 vars in 1122 bytes} [Tue Jul 19 15:19:37 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:37.776403 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c64ec-60bd-4d4d-99d6-924eb443c850 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:37.828174 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:37.852524 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb3aed-b78f-4560-9456-56b12c7e2025 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:37.894402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30b613-cdb8-4ed7-b469-a30a60e0e8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:37.895405 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30b613-cdb8-4ed7-b469-a30a60e0e8ac None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:37.895693 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30b613-cdb8-4ed7-b469-a30a60e0e8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:37.895972 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30b613-cdb8-4ed7-b469-a30a60e0e8ac None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:37.900819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c64ec-60bd-4d4d-99d6-924eb443c850 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:37.905512 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30b613-cdb8-4ed7-b469-a30a60e0e8ac None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:37.906981 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30b613-cdb8-4ed7-b469-a30a60e0e8ac None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:37.924108 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-0c30b613-cdb8-4ed7-b469-a30a60e0e8ac None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 15:19:37.924108 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:37.924108 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:37.924108 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:37.924108 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:37.924108 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:37.924108 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:37.924108 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:37.924108 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:37.924108 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:37.924108 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:37.924108 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:37.924108 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:19:37.924108 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:19:37.924108 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:19:37.924108 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:19:37.925721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:37.925721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:37.925721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:19:37.925721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:37.925721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:19:37.925721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:37.925721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:37.925721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:37.925721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:37.925721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:37.925721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:37.925721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:37.925721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:37.925721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:37.925721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:37.925721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:37.925721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:37.925721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:37.926653 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:37.926653 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:37.926653 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:19:37.926653 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:19:37.926653 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:19:37.926653 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:19:37.926653 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:19:37.926653 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:19:37.926653 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 15:19:37.926653 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:37.930913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 449/894] 10.222.0.44 () {56 vars in 1117 bytes} [Tue Jul 19 15:19:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:37.931883 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30b613-cdb8-4ed7-b469-a30a60e0e8ac None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:37.945857 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715e144-0be3-40f6-a723-3896b4bf5315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:37.946522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715e144-0be3-40f6-a723-3896b4bf5315 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:37.947961 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715e144-0be3-40f6-a723-3896b4bf5315 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:37.947961 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715e144-0be3-40f6-a723-3896b4bf5315 None admin] PATH_INFO: `/v3/services` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:37.948158 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715e144-0be3-40f6-a723-3896b4bf5315 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:37.949724 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715e144-0be3-40f6-a723-3896b4bf5315 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:37.963257 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 446/895] 10.222.0.44 () {56 vars in 1087 bytes} [Tue Jul 19 15:19:37 2022] GET /identity/v3/services => generated 1268 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:19:38.051194 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30b613-cdb8-4ed7-b469-a30a60e0e8ac None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:38.091031 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c336b-7d89-412b-9bf0-cd415a5ce1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:38.092639 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c336b-7d89-412b-9bf0-cd415a5ce1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:38.093152 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c336b-7d89-412b-9bf0-cd415a5ce1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:38.093638 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c336b-7d89-412b-9bf0-cd415a5ce1d3 None admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:38.094736 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c336b-7d89-412b-9bf0-cd415a5ce1d3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:38.095344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c336b-7d89-412b-9bf0-cd415a5ce1d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:38.097739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c336b-7d89-412b-9bf0-cd415a5ce1d3 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:38.109156 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:38.120639 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 450/896] 10.222.0.44 () {56 vars in 1149 bytes} [Tue Jul 19 15:19:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:38.125927 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715e144-0be3-40f6-a723-3896b4bf5315 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:38.160016 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:38.232524 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715e144-0be3-40f6-a723-3896b4bf5315 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:38.269578 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53ad8d-1d30-43d9-91bb-1644482f9432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:38.270589 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53ad8d-1d30-43d9-91bb-1644482f9432 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:38.271101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53ad8d-1d30-43d9-91bb-1644482f9432 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:38.271614 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53ad8d-1d30-43d9-91bb-1644482f9432 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:38.345763 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53ad8d-1d30-43d9-91bb-1644482f9432 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:38.348149 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53ad8d-1d30-43d9-91bb-1644482f9432 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:38.380824 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:38.420263 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e01451-0b10-44b4-940f-7e86ec26e666 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:38.420618 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e01451-0b10-44b4-940f-7e86ec26e666 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:38.420979 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e01451-0b10-44b4-940f-7e86ec26e666 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:38.422915 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 451/897] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:38.431847 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67fd09-3c1f-4a91-a4e7-473f85853bd4 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:38.432249 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67fd09-3c1f-4a91-a4e7-473f85853bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:38.432531 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67fd09-3c1f-4a91-a4e7-473f85853bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:38.449232 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-ad67fd09-3c1f-4a91-a4e7-473f85853bd4 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:38.450420 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-ad67fd09-3c1f-4a91-a4e7-473f85853bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:38.462596 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 447/898] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:19:38 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:19:38.467888 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53ad8d-1d30-43d9-91bb-1644482f9432 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:38.554893 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 452/899] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:19:38.580115 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67fd09-3c1f-4a91-a4e7-473f85853bd4 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:38.580350 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53ad8d-1d30-43d9-91bb-1644482f9432 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:38.618254 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:38.627866 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664a3b8-465f-42c8-a08f-6acaa52f50ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:38.629366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664a3b8-465f-42c8-a08f-6acaa52f50ae None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:38.629832 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664a3b8-465f-42c8-a08f-6acaa52f50ae None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:38.630309 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664a3b8-465f-42c8-a08f-6acaa52f50ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:38.646457 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664a3b8-465f-42c8-a08f-6acaa52f50ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:38.652859 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664a3b8-465f-42c8-a08f-6acaa52f50ae None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:38.677348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-b664a3b8-465f-42c8-a08f-6acaa52f50ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:38.677348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:38.677348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:38.677348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:38.677348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:38.677348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:38.677348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:38.677348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:38.677348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:38.677348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:38.677348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:38.677348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:38.677348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:38.677348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:38.677348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:38.678446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:38.678446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:38.678446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:38.678446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:38.678446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:38.678446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:38.678446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:38.678446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:38.678446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:38.678446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:38.678446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:38.678446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:38.678446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:38.678446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:38.678446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:38.678446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:38.678446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:38.679445 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:38.679445 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:38.679445 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:38.679445 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:38.681795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 448/900] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:19:38.687008 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664a3b8-465f-42c8-a08f-6acaa52f50ae None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:38.709562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67fd09-3c1f-4a91-a4e7-473f85853bd4 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:38.740463 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:38.751455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4ce14-264c-4e2a-a1f0-02c39c8ec5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:38.752375 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4ce14-264c-4e2a-a1f0-02c39c8ec5af None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:38.752822 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4ce14-264c-4e2a-a1f0-02c39c8ec5af None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:38.753660 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4ce14-264c-4e2a-a1f0-02c39c8ec5af None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:38.754398 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4ce14-264c-4e2a-a1f0-02c39c8ec5af None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:38.755884 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4ce14-264c-4e2a-a1f0-02c39c8ec5af None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:38.769068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-cbb4ce14-264c-4e2a-a1f0-02c39c8ec5af None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 15:19:38.769068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:38.769068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:19:38.769068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:19:38.769068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:19:38.769068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:19:38.769068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:19:38.769068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:38.769068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 15:19:38.769068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:38.769068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:19:38.769068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:38.769068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:38.769068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:38.769068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:38.769068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:38.770119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:38.770119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:38.770119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:38.770119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:38.770119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:38.770119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:38.770119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:38.770119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:19:38.770119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:19:38.770119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:19:38.770119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:19:38.770119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:38.770119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:38.770119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:38.770119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:38.770119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:38.770975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:38.770975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:38.770975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:38.770975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:38.770975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:38.770975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:38.770975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:38.770975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:38.770975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:38.770975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:38.770975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:38.770975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:19:38.770975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:38.770975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 15:19:38.770975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:38.775690 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 453/901] 10.222.0.44 () {56 vars in 1132 bytes} [Tue Jul 19 15:19:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:19:38.776698 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4ce14-264c-4e2a-a1f0-02c39c8ec5af None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:38.831784 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664a3b8-465f-42c8-a08f-6acaa52f50ae None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:38.879182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77f3be-7029-4b6d-9002-6ab249cad7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:38.880689 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77f3be-7029-4b6d-9002-6ab249cad7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:38.881180 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77f3be-7029-4b6d-9002-6ab249cad7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:38.881642 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77f3be-7029-4b6d-9002-6ab249cad7b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:38.883278 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77f3be-7029-4b6d-9002-6ab249cad7b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:38.883791 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77f3be-7029-4b6d-9002-6ab249cad7b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:38.886057 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77f3be-7029-4b6d-9002-6ab249cad7b3 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:38.907081 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4ce14-264c-4e2a-a1f0-02c39c8ec5af None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:38.907644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 449/902] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:38.908716 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77f3be-7029-4b6d-9002-6ab249cad7b3 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:38.943592 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfefe7-c59f-44ac-a847-244cff385adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:38.944275 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfefe7-c59f-44ac-a847-244cff385adb None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:38.944614 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfefe7-c59f-44ac-a847-244cff385adb None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:38.944910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfefe7-c59f-44ac-a847-244cff385adb None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:38.945856 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfefe7-c59f-44ac-a847-244cff385adb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:38.946179 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfefe7-c59f-44ac-a847-244cff385adb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:38.948254 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfefe7-c59f-44ac-a847-244cff385adb None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:38.961609 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 454/903] 10.222.0.44 () {56 vars in 1126 bytes} [Tue Jul 19 15:19:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:38.962913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfefe7-c59f-44ac-a847-244cff385adb None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:38.963204 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:39.030451 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77f3be-7029-4b6d-9002-6ab249cad7b3 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:39.043634 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:39.070417 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73bd35-a588-43cd-8fcf-9be3e071e058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:39.071283 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73bd35-a588-43cd-8fcf-9be3e071e058 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:39.071571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73bd35-a588-43cd-8fcf-9be3e071e058 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:39.071847 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73bd35-a588-43cd-8fcf-9be3e071e058 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:39.079447 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b73bd35-a588-43cd-8fcf-9be3e071e058 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:39.080966 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b73bd35-a588-43cd-8fcf-9be3e071e058 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:39.097627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-2b73bd35-a588-43cd-8fcf-9be3e071e058 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:39.097627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:39.097627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:39.097627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:39.097627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:39.097627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:39.097627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:39.097627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:39.097627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:39.097627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:39.097627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:39.097627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:39.097627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:19:39.097627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:19:39.097627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:19:39.098627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:19:39.098627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:39.098627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:39.098627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:39.098627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:39.098627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:39.098627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:39.098627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:39.098627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:39.098627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:39.098627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:39.098627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:39.098627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:39.098627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:39.098627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:39.098627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:39.098627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:39.099588 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:19:39.099588 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:19:39.099588 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:19:39.099588 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:19:39.099588 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:19:39.099588 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:19:39.099588 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:39.099588 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:39.103510 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 450/904] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:19:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:39.104895 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73bd35-a588-43cd-8fcf-9be3e071e058 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:39.106006 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfefe7-c59f-44ac-a847-244cff385adb None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:39.146417 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e8031-3151-4bb5-be76-7d3de7eba1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:39.147689 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e8031-3151-4bb5-be76-7d3de7eba1ba None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:39.148395 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e8031-3151-4bb5-be76-7d3de7eba1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:39.148881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e8031-3151-4bb5-be76-7d3de7eba1ba None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:39.150166 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e8031-3151-4bb5-be76-7d3de7eba1ba None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:39.150699 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e8031-3151-4bb5-be76-7d3de7eba1ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:39.152333 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e8031-3151-4bb5-be76-7d3de7eba1ba None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:39.163443 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 455/905] 10.222.0.44 () {56 vars in 1126 bytes} [Tue Jul 19 15:19:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:39.165362 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e8031-3151-4bb5-be76-7d3de7eba1ba None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:39.219770 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73bd35-a588-43cd-8fcf-9be3e071e058 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:39.221359 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:39.259602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f74404-063c-46d2-a523-91e182c4d46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:39.260264 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f74404-063c-46d2-a523-91e182c4d46a None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:39.260545 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f74404-063c-46d2-a523-91e182c4d46a None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:39.260820 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f74404-063c-46d2-a523-91e182c4d46a None admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:39.261707 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f74404-063c-46d2-a523-91e182c4d46a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:39.262025 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f74404-063c-46d2-a523-91e182c4d46a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:39.263571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f74404-063c-46d2-a523-91e182c4d46a None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:39.272433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e8031-3151-4bb5-be76-7d3de7eba1ba None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:39.282611 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 451/906] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:19:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:39.283624 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f74404-063c-46d2-a523-91e182c4d46a None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:39.294440 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:39.309770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e6bd8-b9e1-443c-9b93-6843bcc65178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:39.310569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e6bd8-b9e1-443c-9b93-6843bcc65178 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:39.310979 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e6bd8-b9e1-443c-9b93-6843bcc65178 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:39.311401 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e6bd8-b9e1-443c-9b93-6843bcc65178 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:39.312297 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e6bd8-b9e1-443c-9b93-6843bcc65178 None admin] RBAC: Adding query filter params (interface=public, service_id=562e20564ec54228afef75be0a810c94, region_id=RegionOne) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:39.312715 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e6bd8-b9e1-443c-9b93-6843bcc65178 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:39.314188 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e6bd8-b9e1-443c-9b93-6843bcc65178 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:39.324709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 456/907] 10.222.0.44 () {56 vars in 1251 bytes} [Tue Jul 19 15:19:39 2022] GET /identity/v3/endpoints?service_id=562e20564ec54228afef75be0a810c94&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:39.325863 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e6bd8-b9e1-443c-9b93-6843bcc65178 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:39.400210 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f74404-063c-46d2-a523-91e182c4d46a None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:39.431973 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e6bd8-b9e1-443c-9b93-6843bcc65178 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:39.439405 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6fc032-701b-433a-9047-bc6f70584412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:39.441009 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fc032-701b-433a-9047-bc6f70584412 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:39.441453 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fc032-701b-433a-9047-bc6f70584412 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:39.441886 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fc032-701b-433a-9047-bc6f70584412 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:39.442982 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6fc032-701b-433a-9047-bc6f70584412 None admin] RBAC: Adding query filter params (role.id=acfcbbe4bd7247258d939ba45bb097b7, scope.project.id=c54934775a86487295bdbc02ed3a0103, user.id=cea1d8409c754ec797d6c694481a3112) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:39.443481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6fc032-701b-433a-9047-bc6f70584412 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:39.445176 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6fc032-701b-433a-9047-bc6f70584412 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:39.457425 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 452/908] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:19:39 2022] GET /identity/v3/role_assignments?user.id=cea1d8409c754ec797d6c694481a3112&scope.project.id=c54934775a86487295bdbc02ed3a0103&role.id=acfcbbe4bd7247258d939ba45bb097b7 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:39.470712 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1777a7f-b26c-417d-bd69-0e4aa9eda419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:39.471860 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1777a7f-b26c-417d-bd69-0e4aa9eda419 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:39.471985 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1777a7f-b26c-417d-bd69-0e4aa9eda419 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:39.472513 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1777a7f-b26c-417d-bd69-0e4aa9eda419 None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:39.473970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1777a7f-b26c-417d-bd69-0e4aa9eda419 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:39.476091 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1777a7f-b26c-417d-bd69-0e4aa9eda419 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:39.484085 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 457/909] 10.222.0.44 () {56 vars in 1087 bytes} [Tue Jul 19 15:19:39 2022] GET /identity/v3/services => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:19:39.916601 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37230746-de03-492a-85ca-2adadc9407ca None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:39.916933 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37230746-de03-492a-85ca-2adadc9407ca None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:39.917167 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37230746-de03-492a-85ca-2adadc9407ca None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:39.918758 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 453/910] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:39.924391 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57287aed-d07e-49e6-a589-bc9cfed703d5 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:39.924826 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57287aed-d07e-49e6-a589-bc9cfed703d5 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:39.925059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57287aed-d07e-49e6-a589-bc9cfed703d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:39.942234 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-57287aed-d07e-49e6-a589-bc9cfed703d5 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:39.943472 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-57287aed-d07e-49e6-a589-bc9cfed703d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:39.990026 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:40.014974 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 458/911] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:19:40.037165 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37230746-de03-492a-85ca-2adadc9407ca None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:40.067099 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:40.078285 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b7307-377a-42e9-a619-0551157a3497 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:40.078503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b7307-377a-42e9-a619-0551157a3497 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:40.078669 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b7307-377a-42e9-a619-0551157a3497 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:40.080349 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 459/912] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:40.085410 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79c8cf-427c-463c-9de6-ffc6e8395570 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:40.085697 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79c8cf-427c-463c-9de6-ffc6e8395570 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:40.085974 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79c8cf-427c-463c-9de6-ffc6e8395570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:40.103835 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-3f79c8cf-427c-463c-9de6-ffc6e8395570 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:40.105247 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-3f79c8cf-427c-463c-9de6-ffc6e8395570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:40.152900 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37230746-de03-492a-85ca-2adadc9407ca None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:40.183567 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 460/913] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:40 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:19:40.194048 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf43d6-3b04-4304-87f6-31f4aeb6f722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:40.194726 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf43d6-3b04-4304-87f6-31f4aeb6f722 None admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:40.195014 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf43d6-3b04-4304-87f6-31f4aeb6f722 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:40.195366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf43d6-3b04-4304-87f6-31f4aeb6f722 None admin] PATH_INFO: `/v3/services` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:40.196118 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf43d6-3b04-4304-87f6-31f4aeb6f722 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:40.197589 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf43d6-3b04-4304-87f6-31f4aeb6f722 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:40.207297 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79c8cf-427c-463c-9de6-ffc6e8395570 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:40.218986 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 454/914] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jul 19 15:19:40 2022] POST /identity/v3/services => generated 241 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:19:40.328192 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79c8cf-427c-463c-9de6-ffc6e8395570 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:40.339150 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:40.372630 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889646ee-9bb9-43e5-b580-af851c892afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:40.373800 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889646ee-9bb9-43e5-b580-af851c892afe None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:40.374318 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889646ee-9bb9-43e5-b580-af851c892afe None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:40.374804 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889646ee-9bb9-43e5-b580-af851c892afe None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:40.375703 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889646ee-9bb9-43e5-b580-af851c892afe None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:40.377266 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889646ee-9bb9-43e5-b580-af851c892afe None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:40.390153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-889646ee-9bb9-43e5-b580-af851c892afe None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 15:19:40.390153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:40.390153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:19:40.390153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:19:40.390153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:19:40.390153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:19:40.390153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:19:40.390153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:40.390153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 15:19:40.390153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:40.390153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:19:40.390153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:40.390153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:40.390153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:40.390153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:40.390153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:40.390153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:40.391201 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:40.391201 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:40.391201 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:40.391201 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:40.391201 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:40.391201 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:40.391201 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:19:40.391201 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:19:40.391201 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:19:40.391201 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:19:40.391201 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:40.391201 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:40.391201 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:40.391201 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:40.391201 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:40.391201 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:40.392116 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:40.392116 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:40.392116 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:40.392116 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:40.392116 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:40.392116 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:40.392116 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:40.392116 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:40.392116 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:40.392116 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:40.392116 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:19:40.392116 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:40.392116 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 15:19:40.392116 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:40.392116 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 461/915] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 19 15:19:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:40.399884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf43d6-3b04-4304-87f6-31f4aeb6f722 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:40.492352 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:40.512598 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf43d6-3b04-4304-87f6-31f4aeb6f722 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:40.549295 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec508b0a-72f1-4119-a77f-f2b20e328505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:40.550473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec508b0a-72f1-4119-a77f-f2b20e328505 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:40.550986 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec508b0a-72f1-4119-a77f-f2b20e328505 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:40.551514 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec508b0a-72f1-4119-a77f-f2b20e328505 None admin] PATH_INFO: `/v3/services` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:40.552465 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec508b0a-72f1-4119-a77f-f2b20e328505 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:40.552981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec508b0a-72f1-4119-a77f-f2b20e328505 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:40.554594 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec508b0a-72f1-4119-a77f-f2b20e328505 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:40.560488 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 455/916] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 19 15:19:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:40.568202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889646ee-9bb9-43e5-b580-af851c892afe None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:40.684969 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889646ee-9bb9-43e5-b580-af851c892afe None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:40.719615 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964cb49-1d7a-48a7-a0e9-fb88fd9e3160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:40.720289 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964cb49-1d7a-48a7-a0e9-fb88fd9e3160 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:40.720574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964cb49-1d7a-48a7-a0e9-fb88fd9e3160 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:40.720855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964cb49-1d7a-48a7-a0e9-fb88fd9e3160 None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:40.721854 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964cb49-1d7a-48a7-a0e9-fb88fd9e3160 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:40.722213 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964cb49-1d7a-48a7-a0e9-fb88fd9e3160 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:40.723651 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964cb49-1d7a-48a7-a0e9-fb88fd9e3160 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:40.729175 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 462/917] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jul 19 15:19:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:40.734548 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec508b0a-72f1-4119-a77f-f2b20e328505 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:40.842814 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec508b0a-72f1-4119-a77f-f2b20e328505 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:40.879556 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e1076-0909-4959-91bd-785cc8c68f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:40.880561 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e1076-0909-4959-91bd-785cc8c68f20 None admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:40.881068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e1076-0909-4959-91bd-785cc8c68f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:40.881565 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e1076-0909-4959-91bd-785cc8c68f20 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:40.882519 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e1076-0909-4959-91bd-785cc8c68f20 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:40.884112 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e1076-0909-4959-91bd-785cc8c68f20 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:40.904944 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 456/918] 10.222.0.44 () {60 vars in 1144 bytes} [Tue Jul 19 15:19:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:19:41.576120 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8ace3-fe86-4f81-b7b7-fbbf390750b8 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:41.576935 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8ace3-fe86-4f81-b7b7-fbbf390750b8 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:41.576935 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8ace3-fe86-4f81-b7b7-fbbf390750b8 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:41.578289 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 463/919] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:41.584328 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617e3ec-26c1-46f8-8134-56f84811ed6f None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:41.585015 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617e3ec-26c1-46f8-8134-56f84811ed6f None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:41.585015 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617e3ec-26c1-46f8-8134-56f84811ed6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:41.598528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:41.605247 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-a617e3ec-26c1-46f8-8134-56f84811ed6f None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:41.606769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-a617e3ec-26c1-46f8-8134-56f84811ed6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:41.690869 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 457/920] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:19:41.713433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8ace3-fe86-4f81-b7b7-fbbf390750b8 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:41.750224 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:41.809773 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f91685-c8da-42f9-baf2-d21a803de1b4 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:41.810110 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f91685-c8da-42f9-baf2-d21a803de1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:41.810345 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f91685-c8da-42f9-baf2-d21a803de1b4 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:41.812093 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 458/921] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:19:41.817573 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c641f-9e7b-4d18-8172-9ee5f250d7a8 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:41.817867 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c641f-9e7b-4d18-8172-9ee5f250d7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:41.818149 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c641f-9e7b-4d18-8172-9ee5f250d7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:41.827745 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8ace3-fe86-4f81-b7b7-fbbf390750b8 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:41.840877 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-537c641f-9e7b-4d18-8172-9ee5f250d7a8 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:41.842115 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-537c641f-9e7b-4d18-8172-9ee5f250d7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:41.868655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee925a6-e70d-4ac3-9b11-1d33b6bac9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:41.869656 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee925a6-e70d-4ac3-9b11-1d33b6bac9ca None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:41.870083 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee925a6-e70d-4ac3-9b11-1d33b6bac9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:41.870463 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee925a6-e70d-4ac3-9b11-1d33b6bac9ca None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:41.884717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee925a6-e70d-4ac3-9b11-1d33b6bac9ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:19:41.894902 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-9ee925a6-e70d-4ac3-9b11-1d33b6bac9ca None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 15:19:41.894902 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:41.894902 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:41.894902 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:41.894902 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:41.894902 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:41.894902 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:41.894902 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:41.894902 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:41.894902 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:41.894902 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:41.894902 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:41.894902 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:19:41.894902 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:19:41.894902 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:19:41.894902 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:19:41.895997 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:19:41.895997 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:19:41.895997 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:19:41.895997 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:19:41.895997 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:41.895997 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:41.895997 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:41.895997 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:41.895997 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:41.895997 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:41.895997 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:41.895997 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:41.895997 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:41.895997 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:41.895997 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:41.895997 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:41.896852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:41.896852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:41.896852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:41.896852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:41.896852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:19:41.896852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:19:41.896852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:19:41.896852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:19:41.896852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:19:41.896852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:19:41.896852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 15:19:41.896852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:41.896852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 464/922] 10.222.0.44 () {56 vars in 1120 bytes} [Tue Jul 19 15:19:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:41.902287 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee925a6-e70d-4ac3-9b11-1d33b6bac9ca None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:41.929712 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 459/923] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:19:41.957384 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c641f-9e7b-4d18-8172-9ee5f250d7a8 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:42.018669 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:42.032440 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee925a6-e70d-4ac3-9b11-1d33b6bac9ca None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:42.044056 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:42.075387 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552091dd-06f5-4a9c-b897-2ccf302e901b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:42.076067 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552091dd-06f5-4a9c-b897-2ccf302e901b None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:42.076394 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552091dd-06f5-4a9c-b897-2ccf302e901b None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:42.076621 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552091dd-06f5-4a9c-b897-2ccf302e901b None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:42.077379 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552091dd-06f5-4a9c-b897-2ccf302e901b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:42.077739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552091dd-06f5-4a9c-b897-2ccf302e901b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:42.079289 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552091dd-06f5-4a9c-b897-2ccf302e901b None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:42.088684 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 465/924] 10.222.0.44 () {56 vars in 1115 bytes} [Tue Jul 19 15:19:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:42.093788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552091dd-06f5-4a9c-b897-2ccf302e901b None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:42.107661 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c641f-9e7b-4d18-8172-9ee5f250d7a8 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:42.156166 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237e4f8-0231-4ff9-b7f7-b4854546cd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:42.156934 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237e4f8-0231-4ff9-b7f7-b4854546cd5b None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:42.157220 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237e4f8-0231-4ff9-b7f7-b4854546cd5b None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:42.157495 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237e4f8-0231-4ff9-b7f7-b4854546cd5b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:42.158152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237e4f8-0231-4ff9-b7f7-b4854546cd5b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:42.160092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237e4f8-0231-4ff9-b7f7-b4854546cd5b None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:42.172832 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-3237e4f8-0231-4ff9-b7f7-b4854546cd5b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 15:19:42.172832 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:42.172832 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:19:42.172832 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:19:42.172832 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:19:42.172832 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:19:42.172832 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:19:42.172832 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:42.172832 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 15:19:42.172832 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:42.172832 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:19:42.172832 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:42.172832 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:42.172832 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:42.172832 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:42.172832 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:42.173797 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:42.173797 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:42.173797 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:42.173797 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:42.173797 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:42.173797 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:42.173797 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:42.173797 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:19:42.173797 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:19:42.173797 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:19:42.173797 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:19:42.173797 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:42.173797 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:42.173797 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:42.173797 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:42.173797 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:42.174691 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:42.174691 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:42.174691 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:42.174691 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:42.174691 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:42.174691 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:42.174691 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:42.174691 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:42.174691 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:42.174691 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:42.174691 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:42.174691 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:19:42.174691 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:42.174691 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 15:19:42.174691 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:42.179297 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 460/925] 10.222.0.44 () {56 vars in 1132 bytes} [Tue Jul 19 15:19:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:19:42.180165 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237e4f8-0231-4ff9-b7f7-b4854546cd5b None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:42.219009 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552091dd-06f5-4a9c-b897-2ccf302e901b None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:42.265396 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f00d88-ab43-45ab-a27e-fea42fed7aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:42.267259 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f00d88-ab43-45ab-a27e-fea42fed7aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:42.267782 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f00d88-ab43-45ab-a27e-fea42fed7aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:42.269002 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f00d88-ab43-45ab-a27e-fea42fed7aa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:42.282125 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f00d88-ab43-45ab-a27e-fea42fed7aa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:42.283717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f00d88-ab43-45ab-a27e-fea42fed7aa6 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:42.292357 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237e4f8-0231-4ff9-b7f7-b4854546cd5b None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:42.302204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-d4f00d88-ab43-45ab-a27e-fea42fed7aa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:42.302204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:42.302204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:42.302204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:42.302204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:42.302204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:42.302204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:42.302204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:42.302204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:42.302204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:42.302204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:42.302204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:42.302204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:42.302204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:42.302204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:42.303133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:42.303133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:42.303133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:42.303133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:42.303133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:42.303133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:42.303133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:42.303133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:42.303133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:42.303133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:42.303133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:42.303133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:42.303133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:42.303133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:42.303133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:42.303133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:42.303133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:42.304059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:42.304059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:42.304059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:42.304059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:42.308447 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 466/926] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:42.309394 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f00d88-ab43-45ab-a27e-fea42fed7aa6 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:42.319477 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:42.328795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:42.342906 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595b18a-7437-4947-8a64-05be192dd0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:42.343663 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595b18a-7437-4947-8a64-05be192dd0de None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:42.343952 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595b18a-7437-4947-8a64-05be192dd0de None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:42.344232 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595b18a-7437-4947-8a64-05be192dd0de None admin] PATH_INFO: `/v3/services` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:42.345047 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595b18a-7437-4947-8a64-05be192dd0de None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:42.345364 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595b18a-7437-4947-8a64-05be192dd0de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:42.347294 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595b18a-7437-4947-8a64-05be192dd0de None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:42.357877 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 461/927] 10.222.0.44 () {56 vars in 1126 bytes} [Tue Jul 19 15:19:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:42.358767 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595b18a-7437-4947-8a64-05be192dd0de None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:42.439536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f00d88-ab43-45ab-a27e-fea42fed7aa6 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:42.474213 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595b18a-7437-4947-8a64-05be192dd0de None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:42.480458 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f9a9a-2118-4d2a-a795-d92875a9c82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:42.481142 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f9a9a-2118-4d2a-a795-d92875a9c82b None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:42.481433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f9a9a-2118-4d2a-a795-d92875a9c82b None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:42.481715 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f9a9a-2118-4d2a-a795-d92875a9c82b None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:42.482465 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f9a9a-2118-4d2a-a795-d92875a9c82b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:42.482781 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f9a9a-2118-4d2a-a795-d92875a9c82b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:42.484193 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f9a9a-2118-4d2a-a795-d92875a9c82b None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:42.501185 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 467/928] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:42.507372 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f9a9a-2118-4d2a-a795-d92875a9c82b None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:42.522258 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fad97-109b-4198-be50-c5fde6651520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:42.523165 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fad97-109b-4198-be50-c5fde6651520 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:42.523446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fad97-109b-4198-be50-c5fde6651520 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:42.523875 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fad97-109b-4198-be50-c5fde6651520 None admin] PATH_INFO: `/v3/services` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:42.524714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463fad97-109b-4198-be50-c5fde6651520 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:42.525092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463fad97-109b-4198-be50-c5fde6651520 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:42.526641 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463fad97-109b-4198-be50-c5fde6651520 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:42.537789 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 462/929] 10.222.0.44 () {56 vars in 1126 bytes} [Tue Jul 19 15:19:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:42.538773 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fad97-109b-4198-be50-c5fde6651520 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:42.586347 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:42.616715 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:42.627169 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f9a9a-2118-4d2a-a795-d92875a9c82b None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:42.665193 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addda63-b066-4edb-86f9-8f75eb46ba6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:42.666108 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fad97-109b-4198-be50-c5fde6651520 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:42.666426 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addda63-b066-4edb-86f9-8f75eb46ba6b None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:42.666879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addda63-b066-4edb-86f9-8f75eb46ba6b None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:42.667370 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addda63-b066-4edb-86f9-8f75eb46ba6b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:42.675695 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3addda63-b066-4edb-86f9-8f75eb46ba6b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:42.677509 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3addda63-b066-4edb-86f9-8f75eb46ba6b None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:42.693907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-3addda63-b066-4edb-86f9-8f75eb46ba6b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 15:19:42.693907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:42.693907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:42.693907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:42.693907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:42.693907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:42.693907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:42.693907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:42.693907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:42.693907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:42.693907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:42.693907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:42.693907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:19:42.693907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:19:42.693907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:19:42.693907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:19:42.694917 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:42.694917 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:42.694917 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:19:42.694917 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:42.694917 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:19:42.694917 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:42.694917 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:42.694917 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:42.694917 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:42.694917 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:42.694917 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:42.694917 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:42.694917 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:42.694917 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:42.694917 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:42.694917 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:42.694917 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:42.694917 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:42.695932 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:42.695932 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:42.695932 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:19:42.695932 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:19:42.695932 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:19:42.695932 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:19:42.695932 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:19:42.695932 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:19:42.695932 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 15:19:42.695932 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:42.695932 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 468/930] 10.222.0.44 () {56 vars in 1117 bytes} [Tue Jul 19 15:19:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:42.696549 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f089c86-9f0f-46a7-a927-d5ad0523fabf None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:42.697322 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f089c86-9f0f-46a7-a927-d5ad0523fabf None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:42.697322 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f089c86-9f0f-46a7-a927-d5ad0523fabf None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:42.702566 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 469/931] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:42.704674 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f089c86-9f0f-46a7-a927-d5ad0523fabf None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:42.708169 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1eece-e617-4563-8e05-efe339f7946c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:42.708826 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1eece-e617-4563-8e05-efe339f7946c None admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:42.709108 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1eece-e617-4563-8e05-efe339f7946c None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:42.709380 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1eece-e617-4563-8e05-efe339f7946c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:42.710116 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1eece-e617-4563-8e05-efe339f7946c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:42.711499 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1eece-e617-4563-8e05-efe339f7946c None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:42.732862 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 463/932] 10.222.0.44 () {60 vars in 1144 bytes} [Tue Jul 19 15:19:42 2022] POST /identity/v3/endpoints => generated 347 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:19:42.744879 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d6525-0b21-4897-921e-49dbc275ce64 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:42.745221 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d6525-0b21-4897-921e-49dbc275ce64 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:42.745462 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d6525-0b21-4897-921e-49dbc275ce64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:42.780850 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-017d6525-0b21-4897-921e-49dbc275ce64 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:42.785452 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-017d6525-0b21-4897-921e-49dbc275ce64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:42.868998 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f089c86-9f0f-46a7-a927-d5ad0523fabf None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:42.895254 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 464/933] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:19:42.907651 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:42.915800 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d6525-0b21-4897-921e-49dbc275ce64 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:42.919212 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c09a7-7dbf-4521-82ba-4447b420b6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:42.919964 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c09a7-7dbf-4521-82ba-4447b420b6ce None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:42.920315 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c09a7-7dbf-4521-82ba-4447b420b6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:42.920549 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c09a7-7dbf-4521-82ba-4447b420b6ce None admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:42.921481 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c09a7-7dbf-4521-82ba-4447b420b6ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:42.921800 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c09a7-7dbf-4521-82ba-4447b420b6ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:42.923364 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c09a7-7dbf-4521-82ba-4447b420b6ce None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:42.949620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 470/934] 10.222.0.44 () {56 vars in 1149 bytes} [Tue Jul 19 15:19:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:42.951368 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c09a7-7dbf-4521-82ba-4447b420b6ce None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:42.968350 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:43.040524 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d6525-0b21-4897-921e-49dbc275ce64 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:43.068540 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c09a7-7dbf-4521-82ba-4447b420b6ce None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:43.077307 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9826618-d524-4eb1-89af-6e5ee52847f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:43.078174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9826618-d524-4eb1-89af-6e5ee52847f1 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:43.078407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9826618-d524-4eb1-89af-6e5ee52847f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:43.078683 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9826618-d524-4eb1-89af-6e5ee52847f1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:43.079370 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9826618-d524-4eb1-89af-6e5ee52847f1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:43.081281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9826618-d524-4eb1-89af-6e5ee52847f1 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:43.095473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-b9826618-d524-4eb1-89af-6e5ee52847f1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 15:19:43.095473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:43.095473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:19:43.095473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:19:43.095473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:19:43.095473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:19:43.095473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:19:43.095473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:43.095473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 15:19:43.095473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:43.095473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:19:43.095473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:43.095473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:43.095473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:43.095473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:43.095473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:43.095473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:43.097152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:43.097152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:43.097152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:43.097152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:43.097152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:43.097152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:43.097152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:19:43.097152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:19:43.097152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:19:43.097152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:19:43.097152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:43.097152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:43.097152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:43.097152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:43.097152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:43.097152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:43.098006 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:43.098006 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:43.098006 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:43.098006 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:43.098006 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:43.098006 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:43.098006 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:43.098006 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:43.098006 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:43.098006 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:43.098006 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:19:43.098006 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:43.098006 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 15:19:43.098006 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:43.098006 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 465/935] 10.222.0.44 () {56 vars in 1126 bytes} [Tue Jul 19 15:19:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:19:43.098832 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c764b50-0751-4965-9204-b853e8365d82 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:43.098903 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c764b50-0751-4965-9204-b853e8365d82 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:43.099778 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c764b50-0751-4965-9204-b853e8365d82 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:43.100626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 466/936] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:43.104124 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c764b50-0751-4965-9204-b853e8365d82 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:43.116246 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c41ea-c3b8-4972-9762-16b92a3a353e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:43.117047 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c41ea-c3b8-4972-9762-16b92a3a353e None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:43.117337 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c41ea-c3b8-4972-9762-16b92a3a353e None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:43.117615 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c41ea-c3b8-4972-9762-16b92a3a353e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:43.129690 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c41ea-c3b8-4972-9762-16b92a3a353e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:43.131265 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c41ea-c3b8-4972-9762-16b92a3a353e None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:43.150592 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-977c41ea-c3b8-4972-9762-16b92a3a353e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:43.150592 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:43.150592 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:43.150592 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:43.150592 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:43.150592 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:43.150592 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:43.150592 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:43.150592 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:43.150592 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:43.150592 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:43.150592 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:43.150592 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:43.150592 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:43.150592 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:43.151618 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:43.151618 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:43.151618 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:43.151618 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:43.151618 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:43.151618 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:43.151618 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:43.151618 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:43.151618 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:43.151618 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:43.151618 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:43.151618 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:43.151618 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:43.151618 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:43.151618 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:43.151618 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:43.151618 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:43.152613 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:43.152613 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:43.152613 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:43.152613 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:43.155934 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 471/937] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:19:43.158143 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bd880-59f4-4946-b332-af81b3b72d89 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:43.158753 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bd880-59f4-4946-b332-af81b3b72d89 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:43.159692 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bd880-59f4-4946-b332-af81b3b72d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:43.181552 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-3c3bd880-59f4-4946-b332-af81b3b72d89 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:43.182733 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-3c3bd880-59f4-4946-b332-af81b3b72d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:43.214836 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:43.224807 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c764b50-0751-4965-9204-b853e8365d82 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:43.228438 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:43.260931 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 472/938] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:19:43.261465 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bd880-59f4-4946-b332-af81b3b72d89 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:43.272483 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34da3e-1466-4083-be7c-9a1f74562887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:43.273327 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34da3e-1466-4083-be7c-9a1f74562887 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:43.273682 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34da3e-1466-4083-be7c-9a1f74562887 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:43.274031 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34da3e-1466-4083-be7c-9a1f74562887 None admin] PATH_INFO: `/v3/services` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:43.274869 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34da3e-1466-4083-be7c-9a1f74562887 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:43.275282 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34da3e-1466-4083-be7c-9a1f74562887 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:43.276737 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34da3e-1466-4083-be7c-9a1f74562887 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:43.283258 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 467/939] 10.222.0.44 () {56 vars in 1122 bytes} [Tue Jul 19 15:19:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:43.288279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34da3e-1466-4083-be7c-9a1f74562887 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:43.390040 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bd880-59f4-4946-b332-af81b3b72d89 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:43.413546 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34da3e-1466-4083-be7c-9a1f74562887 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:43.432883 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99b1d2-9143-4532-bfbd-1d3af9d7bc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:43.433860 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99b1d2-9143-4532-bfbd-1d3af9d7bc51 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:43.434165 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99b1d2-9143-4532-bfbd-1d3af9d7bc51 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:43.434444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99b1d2-9143-4532-bfbd-1d3af9d7bc51 None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:43.435460 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99b1d2-9143-4532-bfbd-1d3af9d7bc51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:43.435921 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99b1d2-9143-4532-bfbd-1d3af9d7bc51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:43.437750 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99b1d2-9143-4532-bfbd-1d3af9d7bc51 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:43.449929 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 473/940] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:43.450768 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99b1d2-9143-4532-bfbd-1d3af9d7bc51 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:43.454774 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f6e3d-430a-4b76-98f8-d8f035d0d5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:43.455736 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f6e3d-430a-4b76-98f8-d8f035d0d5e4 None admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:43.456568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f6e3d-430a-4b76-98f8-d8f035d0d5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:43.456852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f6e3d-430a-4b76-98f8-d8f035d0d5e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:43.457694 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f6e3d-430a-4b76-98f8-d8f035d0d5e4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:43.459440 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f6e3d-430a-4b76-98f8-d8f035d0d5e4 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:43.460932 dv-cinder-849846-2-smb devstack@keystone.service[80305]: WARNING keystone.server.flask.common [None req-049f6e3d-430a-4b76-98f8-d8f035d0d5e4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 19 15:19:43.479575 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.sql.core [None req-049f6e3d-430a-4b76-98f8-d8f035d0d5e4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 19 15:19:43.479575 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 19 15:19:43.479575 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [parameters: {'id': 'a90cbeb7dd2b4da2954b278df13dd16e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 19 15:19:43.479575 dv-cinder-849846-2-smb devstack@keystone.service[80305]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80305) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 19 15:19:43.480615 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:43.505848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-049f6e3d-430a-4b76-98f8-d8f035d0d5e4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a90cbeb7dd2b4da2954b278df13dd16e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a90cbeb7dd2b4da2954b278df13dd16e. Jul 19 15:19:43.505848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:43.505848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 15:19:43.505848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 15:19:43.505848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 15:19:43.505848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 15:19:43.505848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 15:19:43.505848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 15:19:43.505848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 15:19:43.505848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application conn.query(q) Jul 19 15:19:43.505848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 15:19:43.505848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 15:19:43.505848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 15:19:43.506915 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application result.read() Jul 19 15:19:43.506915 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 15:19:43.506915 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 15:19:43.506915 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 15:19:43.506915 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 15:19:43.506915 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 15:19:43.506915 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 15:19:43.506915 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 15:19:43.506915 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 15:19:43.506915 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 19 15:19:43.506915 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:43.506915 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 19 15:19:43.506915 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:43.506915 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:43.506915 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 19 15:19:43.506915 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 19 15:19:43.506915 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 19 15:19:43.506915 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 19 15:19:43.508074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 15:19:43.508074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application next(self.gen) Jul 19 15:19:43.508074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 19 15:19:43.508074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application yield resource Jul 19 15:19:43.508074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 15:19:43.508074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application next(self.gen) Jul 19 15:19:43.508074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 19 15:19:43.508074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application self.session.rollback() Jul 19 15:19:43.508074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 15:19:43.508074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application self.force_reraise() Jul 19 15:19:43.508074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 15:19:43.508074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise self.value Jul 19 15:19:43.508074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 19 15:19:43.508074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 19 15:19:43.508074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 19 15:19:43.508074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application session.commit() Jul 19 15:19:43.508074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 19 15:19:43.509103 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 19 15:19:43.509103 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 19 15:19:43.509103 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application self._prepare_impl() Jul 19 15:19:43.509103 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 19 15:19:43.509103 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application self.session.flush() Jul 19 15:19:43.509103 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 15:19:43.509103 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application self._flush(objects) Jul 19 15:19:43.509103 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 15:19:43.509103 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 19 15:19:43.509103 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 15:19:43.509103 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application compat.raise_( Jul 19 15:19:43.509103 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 15:19:43.509103 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception Jul 19 15:19:43.509103 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 15:19:43.509103 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application flush_context.execute() Jul 19 15:19:43.509103 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 15:19:43.509103 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rec.execute(self) Jul 19 15:19:43.510155 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 15:19:43.510155 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 19 15:19:43.510155 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 15:19:43.510155 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 19 15:19:43.510155 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 19 15:19:43.510155 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 19 15:19:43.510155 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 15:19:43.510155 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 15:19:43.510155 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 15:19:43.510155 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 19 15:19:43.510155 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 15:19:43.510155 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 19 15:19:43.510155 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 15:19:43.510155 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 19 15:19:43.510155 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 15:19:43.511097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 15:19:43.511097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 15:19:43.511097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception Jul 19 15:19:43.511097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 15:19:43.511097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 15:19:43.511097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 15:19:43.511097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 15:19:43.511097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 15:19:43.511097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 15:19:43.511097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 15:19:43.511097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application conn.query(q) Jul 19 15:19:43.511097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 15:19:43.511097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 15:19:43.511097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 15:19:43.511097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application result.read() Jul 19 15:19:43.511097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 15:19:43.511097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 15:19:43.512334 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 15:19:43.512334 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 15:19:43.512334 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 15:19:43.512334 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 15:19:43.512334 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 15:19:43.512334 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 15:19:43.512334 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 19 15:19:43.512334 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 19 15:19:43.512334 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [parameters: {'id': 'a90cbeb7dd2b4da2954b278df13dd16e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 19 15:19:43.512334 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 15:19:43.512334 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:43.512334 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:19:43.512334 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:43.512334 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:43.512334 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 19 15:19:43.513474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 19 15:19:43.513474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 19 15:19:43.513474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 19 15:19:43.513474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 19 15:19:43.513474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:43.513474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:19:43.513474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:43.513474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:43.513474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:43.513474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:43.513474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:43.513474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:43.513474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:43.513474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:43.513474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:43.513474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:43.513474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:43.514590 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:43.514590 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 19 15:19:43.514590 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 19 15:19:43.514590 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:43.514590 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:43.514590 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 19 15:19:43.514590 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 19 15:19:43.514590 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a90cbeb7dd2b4da2954b278df13dd16e. Jul 19 15:19:43.514590 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:43.515403 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 468/941] 10.222.0.44 () {60 vars in 1140 bytes} [Tue Jul 19 15:19:43 2022] POST /identity/v3/projects => generated 262 bytes in 227 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:19:43.516469 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f6e3d-430a-4b76-98f8-d8f035d0d5e4 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:43.547698 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:43.575772 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99b1d2-9143-4532-bfbd-1d3af9d7bc51 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:43.613215 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bcbb2-2f7b-42e0-ac30-5d45bd3a4233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:43.613872 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bcbb2-2f7b-42e0-ac30-5d45bd3a4233 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:43.614195 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bcbb2-2f7b-42e0-ac30-5d45bd3a4233 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:43.614473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bcbb2-2f7b-42e0-ac30-5d45bd3a4233 None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:43.615199 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3bcbb2-2f7b-42e0-ac30-5d45bd3a4233 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:43.615536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3bcbb2-2f7b-42e0-ac30-5d45bd3a4233 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:43.616941 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3bcbb2-2f7b-42e0-ac30-5d45bd3a4233 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:43.626622 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 474/942] 10.222.0.44 () {56 vars in 1122 bytes} [Tue Jul 19 15:19:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:43.626622 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bcbb2-2f7b-42e0-ac30-5d45bd3a4233 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:43.643041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f6e3d-430a-4b76-98f8-d8f035d0d5e4 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:43.679046 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6edb4-5641-4aa7-856e-d45669c40729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:43.679882 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6edb4-5641-4aa7-856e-d45669c40729 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:43.680168 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6edb4-5641-4aa7-856e-d45669c40729 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:43.680444 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6edb4-5641-4aa7-856e-d45669c40729 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:43.687728 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6edb4-5641-4aa7-856e-d45669c40729 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:43.689290 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6edb4-5641-4aa7-856e-d45669c40729 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:43.709055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-79f6edb4-5641-4aa7-856e-d45669c40729 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:43.709055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:43.709055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:43.709055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:43.709055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:43.709055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:43.709055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:43.709055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:43.709055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:43.709055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:43.709055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:43.709055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:43.709055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:19:43.709055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:19:43.709055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:19:43.710317 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:19:43.710317 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:43.710317 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:43.710317 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:43.710317 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:43.710317 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:43.710317 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:43.710317 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:43.710317 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:43.710317 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:43.710317 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:43.710317 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:43.710317 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:43.710317 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:43.710317 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:43.710317 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:43.710317 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:43.716446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:19:43.716446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:19:43.716446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:19:43.716446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:19:43.716446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:19:43.716446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:19:43.716446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:43.716446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:43.716446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 469/943] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:19:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:43.716446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6edb4-5641-4aa7-856e-d45669c40729 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:43.729158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:43.748526 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bcbb2-2f7b-42e0-ac30-5d45bd3a4233 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:43.789259 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0ffba-39ea-4581-8597-9859c1d54ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:43.796365 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0ffba-39ea-4581-8597-9859c1d54ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:43.796695 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0ffba-39ea-4581-8597-9859c1d54ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:43.796964 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0ffba-39ea-4581-8597-9859c1d54ee1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:43.805803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0ffba-39ea-4581-8597-9859c1d54ee1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:43.808298 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0ffba-39ea-4581-8597-9859c1d54ee1 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:43.810407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:43.825659 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-f0e0ffba-39ea-4581-8597-9859c1d54ee1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:43.825659 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:43.825659 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:43.825659 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:43.825659 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:43.825659 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:43.825659 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:43.825659 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:43.825659 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:43.825659 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:43.825659 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:43.825659 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:43.825659 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:19:43.825659 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:19:43.825659 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:19:43.826627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:19:43.826627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:43.826627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:43.826627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:43.826627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:43.826627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:43.826627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:43.826627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:43.826627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:43.826627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:43.826627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:43.826627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:43.826627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:43.826627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:43.826627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:43.826627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:43.826627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:43.827534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:19:43.827534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:19:43.827534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:19:43.827534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:19:43.827534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:19:43.827534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:19:43.827534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:43.827534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:43.827534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 475/944] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:19:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:43.828023 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0ffba-39ea-4581-8597-9859c1d54ee1 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:43.843461 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6edb4-5641-4aa7-856e-d45669c40729 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:43.892363 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd68b8e-6f2b-421e-948c-4dbe56e26644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:43.893299 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd68b8e-6f2b-421e-948c-4dbe56e26644 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:43.893532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd68b8e-6f2b-421e-948c-4dbe56e26644 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:43.893817 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd68b8e-6f2b-421e-948c-4dbe56e26644 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:43.895048 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd68b8e-6f2b-421e-948c-4dbe56e26644 None admin] RBAC: Adding query filter params (interface=public, service_id=e3a9b059c69d42f59a983dcaec9dd229, region_id=RegionOne) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:43.895423 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd68b8e-6f2b-421e-948c-4dbe56e26644 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:43.896773 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd68b8e-6f2b-421e-948c-4dbe56e26644 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:43.905559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 470/945] 10.222.0.44 () {56 vars in 1251 bytes} [Tue Jul 19 15:19:43 2022] GET /identity/v3/endpoints?service_id=e3a9b059c69d42f59a983dcaec9dd229&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:43.906385 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd68b8e-6f2b-421e-948c-4dbe56e26644 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:43.982550 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0ffba-39ea-4581-8597-9859c1d54ee1 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:44.037098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355148e2-7e0d-4f67-a2ed-39c43fd237eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:44.038107 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355148e2-7e0d-4f67-a2ed-39c43fd237eb None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:44.038530 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355148e2-7e0d-4f67-a2ed-39c43fd237eb None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:44.038994 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355148e2-7e0d-4f67-a2ed-39c43fd237eb None admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:44.040431 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355148e2-7e0d-4f67-a2ed-39c43fd237eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:44.040962 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355148e2-7e0d-4f67-a2ed-39c43fd237eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:44.043324 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355148e2-7e0d-4f67-a2ed-39c43fd237eb None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:44.057823 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 476/946] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:19:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:44.058085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd68b8e-6f2b-421e-948c-4dbe56e26644 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:44.059085 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355148e2-7e0d-4f67-a2ed-39c43fd237eb None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:44.074245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:44.101049 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de3551-7d29-4fc3-aa0d-ace912038e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:44.101683 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de3551-7d29-4fc3-aa0d-ace912038e62 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:44.101975 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de3551-7d29-4fc3-aa0d-ace912038e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:44.102856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de3551-7d29-4fc3-aa0d-ace912038e62 None admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:44.103015 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de3551-7d29-4fc3-aa0d-ace912038e62 None admin] RBAC: Adding query filter params (name=service) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:44.103342 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de3551-7d29-4fc3-aa0d-ace912038e62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:44.104760 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de3551-7d29-4fc3-aa0d-ace912038e62 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:44.123873 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 471/947] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jul 19 15:19:43 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:44.132209 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de3551-7d29-4fc3-aa0d-ace912038e62 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:44.150674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:44.183926 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355148e2-7e0d-4f67-a2ed-39c43fd237eb None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:44.224987 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5503a417-adae-4c22-a79a-6044d5301dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:44.225701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503a417-adae-4c22-a79a-6044d5301dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:44.225991 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503a417-adae-4c22-a79a-6044d5301dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:44.226317 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503a417-adae-4c22-a79a-6044d5301dd9 None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:44.227018 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5503a417-adae-4c22-a79a-6044d5301dd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:44.228526 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5503a417-adae-4c22-a79a-6044d5301dd9 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:44.239713 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 477/948] 10.222.0.44 () {56 vars in 1087 bytes} [Tue Jul 19 15:19:44 2022] GET /identity/v3/services => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:19:44.277601 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de3551-7d29-4fc3-aa0d-ace912038e62 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:44.321627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca45f2-34b7-4a2a-ad60-6c5d00c4298a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:44.322716 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca45f2-34b7-4a2a-ad60-6c5d00c4298a None admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:44.323156 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca45f2-34b7-4a2a-ad60-6c5d00c4298a None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:44.323525 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca45f2-34b7-4a2a-ad60-6c5d00c4298a None admin] PATH_INFO: `/v3/projects/c54934775a86487295bdbc02ed3a0103/users/cea1d8409c754ec797d6c694481a3112/roles/acfcbbe4bd7247258d939ba45bb097b7` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:44.326155 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca45f2-34b7-4a2a-ad60-6c5d00c4298a None admin] RBAC: Authorizing `identity:create_grant(project_id=c54934775a86487295bdbc02ed3a0103, user_id=cea1d8409c754ec797d6c694481a3112, role_id=acfcbbe4bd7247258d939ba45bb097b7)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:44.327848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca45f2-34b7-4a2a-ad60-6c5d00c4298a None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:44.346457 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 472/949] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 19 15:19:44 2022] PUT /identity/v3/projects/c54934775a86487295bdbc02ed3a0103/users/cea1d8409c754ec797d6c694481a3112/roles/acfcbbe4bd7247258d939ba45bb097b7 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:19:44.905977 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b7c49-1808-463e-b873-55393f522676 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:44.906531 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b7c49-1808-463e-b873-55393f522676 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:44.906531 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b7c49-1808-463e-b873-55393f522676 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:44.908197 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 478/950] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:44.914275 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a315c-82d0-4367-acc5-3b547088ee0e None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:44.914743 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a315c-82d0-4367-acc5-3b547088ee0e None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:44.914856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a315c-82d0-4367-acc5-3b547088ee0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:44.935093 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-a30a315c-82d0-4367-acc5-3b547088ee0e None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:44.936630 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-a30a315c-82d0-4367-acc5-3b547088ee0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:45.001175 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:45.015595 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 473/951] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:19:45.030660 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b7c49-1808-463e-b873-55393f522676 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:45.103175 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:45.136537 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b7c49-1808-463e-b873-55393f522676 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:45.171892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ff631-6572-4427-bb67-9530dd72af3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:45.173042 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ff631-6572-4427-bb67-9530dd72af3c None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:45.173537 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ff631-6572-4427-bb67-9530dd72af3c None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:45.174035 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ff631-6572-4427-bb67-9530dd72af3c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:45.175536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ff631-6572-4427-bb67-9530dd72af3c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:45.177118 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ff631-6572-4427-bb67-9530dd72af3c None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:45.189474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-f54ff631-6572-4427-bb67-9530dd72af3c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 15:19:45.189474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:45.189474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:19:45.189474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:19:45.189474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:19:45.189474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:19:45.189474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:19:45.189474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:45.189474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 15:19:45.189474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:45.189474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:19:45.189474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:45.189474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:45.189474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:45.189474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:45.189474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:45.189474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:45.190517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:45.190517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:45.190517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:45.190517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:45.190517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:45.190517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:45.190517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:19:45.190517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:19:45.190517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:19:45.190517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:19:45.190517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:45.190517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:45.190517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:45.190517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:45.190517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:45.190517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:45.191390 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:45.191390 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:45.191390 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:45.191390 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:45.191390 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:45.191390 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:45.191390 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:45.191390 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:45.191390 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:45.191390 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:45.191390 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:19:45.191390 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:45.191390 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 15:19:45.191390 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:45.194009 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 479/952] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:19:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:45.199869 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a315c-82d0-4367-acc5-3b547088ee0e None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:45.300955 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a315c-82d0-4367-acc5-3b547088ee0e None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:45.335661 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891027f-efc4-4280-805e-e4724669bb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:45.336334 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891027f-efc4-4280-805e-e4724669bb3d None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:45.336617 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891027f-efc4-4280-805e-e4724669bb3d None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:45.336895 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891027f-efc4-4280-805e-e4724669bb3d None admin] PATH_INFO: `/v3/services` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:45.337606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891027f-efc4-4280-805e-e4724669bb3d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:45.337915 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891027f-efc4-4280-805e-e4724669bb3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:45.339300 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891027f-efc4-4280-805e-e4724669bb3d None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:45.344525 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 474/953] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jul 19 15:19:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:45.350114 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ff631-6572-4427-bb67-9530dd72af3c None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:45.466441 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ff631-6572-4427-bb67-9530dd72af3c None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:45.501468 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0c9d8-e422-416b-b43e-f460efa9ac86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:45.502578 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0c9d8-e422-416b-b43e-f460efa9ac86 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:45.503076 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0c9d8-e422-416b-b43e-f460efa9ac86 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:45.503589 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0c9d8-e422-416b-b43e-f460efa9ac86 None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:45.504521 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0c9d8-e422-416b-b43e-f460efa9ac86 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:45.505045 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0c9d8-e422-416b-b43e-f460efa9ac86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:45.506604 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0c9d8-e422-416b-b43e-f460efa9ac86 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:45.508083 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:45.512594 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 480/954] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jul 19 15:19:45 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:46.323428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81babb92-f588-4282-9d60-89093c017cb5 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:46.323931 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81babb92-f588-4282-9d60-89093c017cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:46.323931 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81babb92-f588-4282-9d60-89093c017cb5 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:46.325568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 475/955] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:46.330847 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02e725-073c-41ed-9fb6-6ca04389f875 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:46.331281 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02e725-073c-41ed-9fb6-6ca04389f875 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:46.331473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02e725-073c-41ed-9fb6-6ca04389f875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:46.349216 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-6d02e725-073c-41ed-9fb6-6ca04389f875 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:46.350388 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f24e05-9827-48fa-8259-92d9a8ccf883 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:46.350504 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-6d02e725-073c-41ed-9fb6-6ca04389f875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:46.350684 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f24e05-9827-48fa-8259-92d9a8ccf883 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:46.350973 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f24e05-9827-48fa-8259-92d9a8ccf883 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:46.352452 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 476/956] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:46.357437 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe44c65-676e-48fb-b939-cfd1a94734dc None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:46.357728 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe44c65-676e-48fb-b939-cfd1a94734dc None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:46.358014 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe44c65-676e-48fb-b939-cfd1a94734dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:46.376972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-1fe44c65-676e-48fb-b939-cfd1a94734dc None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:46.378748 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-1fe44c65-676e-48fb-b939-cfd1a94734dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:46.426580 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 481/957] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:19:46.449449 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:46.452532 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02e725-073c-41ed-9fb6-6ca04389f875 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:46.465142 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 477/958] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:19:46.487610 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe44c65-676e-48fb-b939-cfd1a94734dc None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:46.576373 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02e725-073c-41ed-9fb6-6ca04389f875 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:46.595272 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe44c65-676e-48fb-b939-cfd1a94734dc None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:46.616482 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:46.625470 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54bfd7-0dc8-4144-8e9e-50c499f981fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:46.626153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54bfd7-0dc8-4144-8e9e-50c499f981fb None admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:46.626439 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54bfd7-0dc8-4144-8e9e-50c499f981fb None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:46.626722 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54bfd7-0dc8-4144-8e9e-50c499f981fb None admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:46.628119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54bfd7-0dc8-4144-8e9e-50c499f981fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:46.629416 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54bfd7-0dc8-4144-8e9e-50c499f981fb None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:46.630732 dv-cinder-849846-2-smb devstack@keystone.service[80304]: WARNING keystone.server.flask.common [None req-cf54bfd7-0dc8-4144-8e9e-50c499f981fb None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 19 15:19:46.637835 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a5a9e-9898-478f-aa9b-060964a4f999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:46.638650 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a5a9e-9898-478f-aa9b-060964a4f999 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:46.638935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a5a9e-9898-478f-aa9b-060964a4f999 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:46.639242 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a5a9e-9898-478f-aa9b-060964a4f999 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:46.639911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a5a9e-9898-478f-aa9b-060964a4f999 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:46.641287 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a5a9e-9898-478f-aa9b-060964a4f999 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:46.645000 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.sql.core [None req-cf54bfd7-0dc8-4144-8e9e-50c499f981fb None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 19 15:19:46.645000 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 19 15:19:46.645000 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [parameters: {'user_id': 'bafc4dfded964dde9eb2ea78966ed7a0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 19 15:19:46.645000 dv-cinder-849846-2-smb devstack@keystone.service[80304]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80304) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 19 15:19:46.653387 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-cf54bfd7-0dc8-4144-8e9e-50c499f981fb None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 19 15:19:46.653387 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:46.653387 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 15:19:46.653387 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 15:19:46.653387 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 15:19:46.653387 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 15:19:46.653387 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 15:19:46.653387 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 15:19:46.653387 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 15:19:46.653387 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application conn.query(q) Jul 19 15:19:46.653387 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 15:19:46.653387 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 15:19:46.653387 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 15:19:46.653387 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application result.read() Jul 19 15:19:46.653387 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 15:19:46.654536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 15:19:46.654536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 15:19:46.654536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 15:19:46.654536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 15:19:46.654536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 15:19:46.654536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 15:19:46.654536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 15:19:46.654536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 19 15:19:46.654536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:46.654536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 19 15:19:46.654536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:46.654536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:46.654536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 19 15:19:46.654536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 19 15:19:46.654536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 19 15:19:46.654536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 19 15:19:46.654536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 15:19:46.654536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application next(self.gen) Jul 19 15:19:46.656088 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 19 15:19:46.656088 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application yield resource Jul 19 15:19:46.656088 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 15:19:46.656088 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application next(self.gen) Jul 19 15:19:46.656088 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 19 15:19:46.656088 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self.session.rollback() Jul 19 15:19:46.656088 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 15:19:46.656088 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self.force_reraise() Jul 19 15:19:46.656088 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 15:19:46.656088 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise self.value Jul 19 15:19:46.656088 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 19 15:19:46.656088 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 19 15:19:46.656088 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 19 15:19:46.656088 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application session.commit() Jul 19 15:19:46.656088 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 19 15:19:46.656088 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 19 15:19:46.656088 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 19 15:19:46.657125 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._prepare_impl() Jul 19 15:19:46.657125 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 19 15:19:46.657125 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self.session.flush() Jul 19 15:19:46.657125 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 15:19:46.657125 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._flush(objects) Jul 19 15:19:46.657125 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 15:19:46.657125 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 19 15:19:46.657125 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 15:19:46.657125 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application compat.raise_( Jul 19 15:19:46.657125 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 15:19:46.657125 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception Jul 19 15:19:46.657125 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 15:19:46.657125 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application flush_context.execute() Jul 19 15:19:46.657125 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 15:19:46.657125 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rec.execute(self) Jul 19 15:19:46.657125 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 15:19:46.657125 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 19 15:19:46.658406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 15:19:46.658406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 19 15:19:46.658406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 19 15:19:46.658406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 19 15:19:46.658406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 15:19:46.658406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 15:19:46.658406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 15:19:46.658406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 19 15:19:46.658406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 15:19:46.658406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 19 15:19:46.658406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 15:19:46.658406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 19 15:19:46.658406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 15:19:46.658406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 15:19:46.658406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 15:19:46.658406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception Jul 19 15:19:46.663912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 15:19:46.663912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 15:19:46.663912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 15:19:46.663912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 15:19:46.663912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 15:19:46.663912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 15:19:46.663912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 15:19:46.663912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application conn.query(q) Jul 19 15:19:46.663912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 15:19:46.663912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 15:19:46.663912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 15:19:46.663912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application result.read() Jul 19 15:19:46.663912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 15:19:46.663912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 15:19:46.663912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 15:19:46.663912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 15:19:46.664999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 15:19:46.664999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 15:19:46.664999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 15:19:46.664999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 15:19:46.664999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 19 15:19:46.664999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 19 15:19:46.664999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [parameters: {'user_id': 'bafc4dfded964dde9eb2ea78966ed7a0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 19 15:19:46.664999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 15:19:46.664999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:46.664999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:19:46.664999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:46.664999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:46.664999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:46.664999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:46.664999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:46.667455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:46.667455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:46.667455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:46.667455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:46.667455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:46.667455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:46.667455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:46.667455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 19 15:19:46.667455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 19 15:19:46.667455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:46.667455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:46.667455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:19:46.667455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:46.667455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:19:46.667455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:46.667455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 19 15:19:46.667455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 19 15:19:46.668454 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 19 15:19:46.668454 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 19 15:19:46.668454 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 19 15:19:46.668454 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 19 15:19:46.668454 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 19 15:19:46.668454 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:46.668793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-fe0a5a9e-9898-478f-aa9b-060964a4f999 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 15:19:46.668793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:46.668793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:19:46.668793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:19:46.668793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:19:46.668793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:19:46.668793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:19:46.668793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:46.668793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 15:19:46.668793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:46.668793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:19:46.668793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:46.668793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:46.668793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:46.668793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:46.668793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:46.668793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:46.669775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:46.669775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:46.669775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:46.669775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:46.669775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:46.669775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:46.669775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:19:46.669775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:19:46.669775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:19:46.669775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:19:46.669775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:46.669775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:46.669775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:46.669775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:46.669775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:46.669775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:46.670645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:46.670645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:46.670645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:46.670645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:46.670645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:46.670645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:46.670645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:46.670645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:46.670645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:46.670645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:46.670645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:19:46.670645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:46.670645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 15:19:46.670645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:46.670645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 478/959] 10.222.0.44 () {56 vars in 1126 bytes} [Tue Jul 19 15:19:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:19:46.671537 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebecf3-ef8a-4f81-a724-1252909993af None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:46.671537 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebecf3-ef8a-4f81-a724-1252909993af None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:46.671537 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebecf3-ef8a-4f81-a724-1252909993af None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:46.671537 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 479/960] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:46.671537 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebecf3-ef8a-4f81-a724-1252909993af None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:46.672439 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 482/961] 10.222.0.44 () {60 vars in 1131 bytes} [Tue Jul 19 15:19:46 2022] POST /identity/v3/users => generated 160 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:19:46.674108 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4c73b-eb21-4d1a-a2ad-762c981b65e3 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:46.674959 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4c73b-eb21-4d1a-a2ad-762c981b65e3 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:46.675307 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4c73b-eb21-4d1a-a2ad-762c981b65e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:46.693510 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-9ea4c73b-eb21-4d1a-a2ad-762c981b65e3 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:46.695042 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-9ea4c73b-eb21-4d1a-a2ad-762c981b65e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:46.732282 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:46.764669 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 483/962] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:19:46.765410 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4c73b-eb21-4d1a-a2ad-762c981b65e3 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:46.799415 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebecf3-ef8a-4f81-a724-1252909993af None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:46.840644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cdcddf-60d2-4fbf-9451-ba4e288ea53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:46.841318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cdcddf-60d2-4fbf-9451-ba4e288ea53f None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:46.841644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cdcddf-60d2-4fbf-9451-ba4e288ea53f None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:46.841888 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cdcddf-60d2-4fbf-9451-ba4e288ea53f None admin] PATH_INFO: `/v3/services` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:46.842603 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cdcddf-60d2-4fbf-9451-ba4e288ea53f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:46.842916 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cdcddf-60d2-4fbf-9451-ba4e288ea53f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:46.844319 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cdcddf-60d2-4fbf-9451-ba4e288ea53f None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:46.850126 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 480/963] 10.222.0.44 () {56 vars in 1122 bytes} [Tue Jul 19 15:19:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:46.850803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cdcddf-60d2-4fbf-9451-ba4e288ea53f None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:46.890812 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4c73b-eb21-4d1a-a2ad-762c981b65e3 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:46.912621 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:46.930422 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670a8a8-cd32-4db8-8b23-0cbe933a5b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:46.931242 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670a8a8-cd32-4db8-8b23-0cbe933a5b44 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:46.931536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670a8a8-cd32-4db8-8b23-0cbe933a5b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:46.931814 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670a8a8-cd32-4db8-8b23-0cbe933a5b44 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:46.939057 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670a8a8-cd32-4db8-8b23-0cbe933a5b44 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:46.940785 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670a8a8-cd32-4db8-8b23-0cbe933a5b44 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:46.957497 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-4670a8a8-cd32-4db8-8b23-0cbe933a5b44 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 15:19:46.957497 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:46.957497 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:46.957497 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:46.957497 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:46.957497 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:46.957497 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:46.957497 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:46.957497 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:46.957497 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:46.957497 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:46.957497 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:46.957497 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:19:46.957497 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:19:46.957497 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:19:46.957497 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:19:46.958679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:46.958679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:46.958679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:19:46.958679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:46.958679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:19:46.958679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:46.958679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:46.958679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:46.958679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:46.958679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:46.958679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:46.958679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:46.958679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:46.958679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:46.958679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:46.958679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:46.958679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:46.958679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:46.959769 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:46.959769 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:46.959769 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:19:46.959769 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:19:46.959769 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:19:46.959769 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:19:46.959769 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:19:46.959769 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:19:46.959769 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 15:19:46.959769 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:46.959769 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 484/964] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:19:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:46.959769 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670a8a8-cd32-4db8-8b23-0cbe933a5b44 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:46.966028 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cdcddf-60d2-4fbf-9451-ba4e288ea53f None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:46.986790 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:47.002050 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04714b09-fb51-4064-8fee-19b083e21172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:47.002972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04714b09-fb51-4064-8fee-19b083e21172 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:47.003280 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04714b09-fb51-4064-8fee-19b083e21172 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:47.003558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04714b09-fb51-4064-8fee-19b083e21172 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:47.015341 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04714b09-fb51-4064-8fee-19b083e21172 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:19:47.024119 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-04714b09-fb51-4064-8fee-19b083e21172 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 15:19:47.024119 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:47.024119 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:47.024119 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:47.024119 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:47.024119 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:47.024119 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:47.024119 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:47.024119 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:47.024119 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:47.024119 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:47.024119 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:47.024119 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:19:47.024119 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:19:47.024119 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:19:47.024119 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:19:47.025095 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:19:47.025095 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:19:47.025095 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:19:47.025095 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:19:47.025095 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:47.025095 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:47.025095 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:47.025095 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:47.025095 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:47.025095 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:47.025095 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:47.025095 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:47.025095 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:47.025095 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:47.025095 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:47.025095 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:47.025992 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:47.025992 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:47.025992 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:47.025992 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:47.025992 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:19:47.025992 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:19:47.025992 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:19:47.025992 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:19:47.025992 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:19:47.025992 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:19:47.025992 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 15:19:47.025992 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:47.025992 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 481/965] 10.222.0.44 () {56 vars in 1120 bytes} [Tue Jul 19 15:19:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:47.026683 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04714b09-fb51-4064-8fee-19b083e21172 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:47.070719 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670a8a8-cd32-4db8-8b23-0cbe933a5b44 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:47.107340 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82ba24-633b-4c83-b191-2bbbd466572c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:47.108434 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82ba24-633b-4c83-b191-2bbbd466572c None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:47.108896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82ba24-633b-4c83-b191-2bbbd466572c None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:47.109401 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82ba24-633b-4c83-b191-2bbbd466572c None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:47.110390 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82ba24-633b-4c83-b191-2bbbd466572c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:47.110873 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82ba24-633b-4c83-b191-2bbbd466572c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:47.112563 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82ba24-633b-4c83-b191-2bbbd466572c None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:47.121471 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 485/966] 10.222.0.44 () {56 vars in 1122 bytes} [Tue Jul 19 15:19:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:47.122519 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82ba24-633b-4c83-b191-2bbbd466572c None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:47.136265 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04714b09-fb51-4064-8fee-19b083e21172 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:47.171193 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ab1da-161f-4818-ba3c-e22a629cee80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:47.172243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ab1da-161f-4818-ba3c-e22a629cee80 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:47.172631 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:47.172774 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ab1da-161f-4818-ba3c-e22a629cee80 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:47.172983 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ab1da-161f-4818-ba3c-e22a629cee80 None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:47.174160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ab1da-161f-4818-ba3c-e22a629cee80 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:47.174753 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ab1da-161f-4818-ba3c-e22a629cee80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:47.176480 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ab1da-161f-4818-ba3c-e22a629cee80 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:47.223256 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 482/967] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jul 19 15:19:47 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:47.223256 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ab1da-161f-4818-ba3c-e22a629cee80 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:47.251465 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82ba24-633b-4c83-b191-2bbbd466572c None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:47.273910 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:47.299812 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9b3a1-9f29-4615-9792-4aee03fde1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:47.301911 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9b3a1-9f29-4615-9792-4aee03fde1fb None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:47.302491 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9b3a1-9f29-4615-9792-4aee03fde1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:47.302927 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9b3a1-9f29-4615-9792-4aee03fde1fb None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:47.304035 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9b3a1-9f29-4615-9792-4aee03fde1fb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:47.304512 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9b3a1-9f29-4615-9792-4aee03fde1fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:47.306156 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9b3a1-9f29-4615-9792-4aee03fde1fb None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:47.317827 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 486/968] 10.222.0.44 () {56 vars in 1115 bytes} [Tue Jul 19 15:19:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:47.323685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9b3a1-9f29-4615-9792-4aee03fde1fb None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:47.354294 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ab1da-161f-4818-ba3c-e22a629cee80 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:47.398694 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7fdb8a-9557-4e88-aa9e-eb29c4fd5f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:47.399679 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fdb8a-9557-4e88-aa9e-eb29c4fd5f2b None admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:47.400174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fdb8a-9557-4e88-aa9e-eb29c4fd5f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:47.400634 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fdb8a-9557-4e88-aa9e-eb29c4fd5f2b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:47.401565 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7fdb8a-9557-4e88-aa9e-eb29c4fd5f2b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:47.403127 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7fdb8a-9557-4e88-aa9e-eb29c4fd5f2b None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:47.429457 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 483/969] 10.222.0.44 () {60 vars in 1144 bytes} [Tue Jul 19 15:19:47 2022] POST /identity/v3/endpoints => generated 349 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:19:47.452215 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9b3a1-9f29-4615-9792-4aee03fde1fb None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:47.463282 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:47.507828 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568a2f8-74a2-474f-bf35-e50e477c878a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:47.509011 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568a2f8-74a2-474f-bf35-e50e477c878a None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:47.509507 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568a2f8-74a2-474f-bf35-e50e477c878a None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:47.509967 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568a2f8-74a2-474f-bf35-e50e477c878a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:47.522563 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568a2f8-74a2-474f-bf35-e50e477c878a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:47.524484 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568a2f8-74a2-474f-bf35-e50e477c878a None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:47.545976 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-3568a2f8-74a2-474f-bf35-e50e477c878a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:47.545976 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:47.545976 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:47.545976 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:47.545976 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:47.545976 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:47.545976 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:47.545976 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:47.545976 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:47.545976 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:47.545976 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:47.545976 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:47.545976 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:47.545976 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:47.545976 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:47.547062 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:47.547062 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:47.547062 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:47.547062 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:47.547062 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:47.547062 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:47.547062 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:47.547062 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:47.547062 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:47.547062 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:47.547062 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:47.547062 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:47.547062 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:47.547062 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:47.547062 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:47.547062 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:47.547062 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:47.548010 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:47.548010 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:47.548010 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:47.548010 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:47.550769 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 487/970] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:47.556132 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7fdb8a-9557-4e88-aa9e-eb29c4fd5f2b None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:47.619796 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182cdcd-7730-42de-b4c6-a0d12fb0d595 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:47.620062 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182cdcd-7730-42de-b4c6-a0d12fb0d595 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:47.620310 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182cdcd-7730-42de-b4c6-a0d12fb0d595 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:47.622074 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 488/971] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:19:47.626738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4230797-922d-496a-802a-21756c33b5e4 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:47.627036 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4230797-922d-496a-802a-21756c33b5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:47.627433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4230797-922d-496a-802a-21756c33b5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:47.644706 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-d4230797-922d-496a-802a-21756c33b5e4 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:47.646841 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-d4230797-922d-496a-802a-21756c33b5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:47.666746 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:47.678899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7fdb8a-9557-4e88-aa9e-eb29c4fd5f2b None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:47.721616 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1e7e3-cff2-4b1c-b41e-bbaa448b6a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:47.721850 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 489/972] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:19:47.722137 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1e7e3-cff2-4b1c-b41e-bbaa448b6a32 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:47.722432 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1e7e3-cff2-4b1c-b41e-bbaa448b6a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:47.722805 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1e7e3-cff2-4b1c-b41e-bbaa448b6a32 None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:47.723568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1e7e3-cff2-4b1c-b41e-bbaa448b6a32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:47.723875 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1e7e3-cff2-4b1c-b41e-bbaa448b6a32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:47.725344 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1e7e3-cff2-4b1c-b41e-bbaa448b6a32 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:47.739144 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 484/973] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:47.747175 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1e7e3-cff2-4b1c-b41e-bbaa448b6a32 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:47.747468 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4230797-922d-496a-802a-21756c33b5e4 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:47.848560 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:47.861376 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1e7e3-cff2-4b1c-b41e-bbaa448b6a32 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:47.867746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4230797-922d-496a-802a-21756c33b5e4 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:47.900108 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df687aff-8e68-46b3-a554-6786baf129af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:47.900782 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df687aff-8e68-46b3-a554-6786baf129af None admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:47.901115 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df687aff-8e68-46b3-a554-6786baf129af None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:47.901452 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df687aff-8e68-46b3-a554-6786baf129af None admin] PATH_INFO: `/v3/services` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:47.902180 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df687aff-8e68-46b3-a554-6786baf129af None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:47.903017 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7f367-2575-40d2-b918-b8a954e4c253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:47.903591 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df687aff-8e68-46b3-a554-6786baf129af None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:47.903864 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7f367-2575-40d2-b918-b8a954e4c253 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:47.904154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7f367-2575-40d2-b918-b8a954e4c253 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:47.904433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7f367-2575-40d2-b918-b8a954e4c253 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:47.913408 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f7f367-2575-40d2-b918-b8a954e4c253 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:47.914857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f7f367-2575-40d2-b918-b8a954e4c253 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:47.918812 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 485/974] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jul 19 15:19:47 2022] POST /identity/v3/services => generated 242 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:19:47.930709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-e3f7f367-2575-40d2-b918-b8a954e4c253 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 15:19:47.930709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:47.930709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:47.930709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:47.930709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:47.930709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:47.930709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:47.930709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:47.930709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:47.930709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:47.930709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:47.930709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:47.930709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:19:47.930709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:19:47.930709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:19:47.930709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:19:47.931942 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:47.931942 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:47.931942 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:19:47.931942 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:47.931942 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:19:47.931942 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:47.931942 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:47.931942 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:47.931942 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:47.931942 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:47.931942 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:47.931942 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:47.931942 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:47.931942 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:47.931942 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:47.931942 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:47.931942 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:47.931942 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:47.933065 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:47.933065 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:47.933065 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:19:47.933065 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:19:47.933065 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:19:47.933065 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:19:47.933065 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:19:47.933065 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:19:47.933065 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 15:19:47.933065 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:47.933065 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 490/975] 10.222.0.44 () {56 vars in 1117 bytes} [Tue Jul 19 15:19:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:47.941389 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df687aff-8e68-46b3-a554-6786baf129af None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:47.963006 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:48.068134 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df687aff-8e68-46b3-a554-6786baf129af None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:48.106248 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfdbdd8-bae2-4c53-b332-0813db402e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:48.106889 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdbdd8-bae2-4c53-b332-0813db402e01 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:48.107177 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdbdd8-bae2-4c53-b332-0813db402e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:48.107490 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdbdd8-bae2-4c53-b332-0813db402e01 None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:48.108357 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfdbdd8-bae2-4c53-b332-0813db402e01 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:48.108672 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfdbdd8-bae2-4c53-b332-0813db402e01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:48.111358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfdbdd8-bae2-4c53-b332-0813db402e01 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:48.131191 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 486/976] 10.222.0.44 () {56 vars in 1149 bytes} [Tue Jul 19 15:19:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:48.136787 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7f367-2575-40d2-b918-b8a954e4c253 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:48.241175 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7f367-2575-40d2-b918-b8a954e4c253 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:48.275422 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9295d9-1a23-456a-a46f-3dfd1f479c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:48.276104 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9295d9-1a23-456a-a46f-3dfd1f479c5a None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:48.276394 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9295d9-1a23-456a-a46f-3dfd1f479c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:48.276677 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9295d9-1a23-456a-a46f-3dfd1f479c5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:48.291392 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:48.345192 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9295d9-1a23-456a-a46f-3dfd1f479c5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:48.346751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9295d9-1a23-456a-a46f-3dfd1f479c5a None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:48.449928 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 491/977] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:19:48 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:19:48.456143 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfdbdd8-bae2-4c53-b332-0813db402e01 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:48.529888 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:48.564780 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfdbdd8-bae2-4c53-b332-0813db402e01 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:48.599857 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720bcfd-272c-4868-946f-fb340333aa0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:48.600672 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720bcfd-272c-4868-946f-fb340333aa0d None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:48.600958 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720bcfd-272c-4868-946f-fb340333aa0d None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:48.601237 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720bcfd-272c-4868-946f-fb340333aa0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:48.612825 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720bcfd-272c-4868-946f-fb340333aa0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:48.614296 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720bcfd-272c-4868-946f-fb340333aa0d None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:48.633258 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-d720bcfd-272c-4868-946f-fb340333aa0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:48.633258 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:48.633258 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:48.633258 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:48.633258 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:48.633258 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:48.633258 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:48.633258 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:48.633258 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:48.633258 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:48.633258 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:48.633258 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:48.633258 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:48.633258 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:48.633258 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:48.634245 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:48.634245 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:48.634245 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:48.634245 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:48.634245 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:48.634245 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:48.634245 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:48.634245 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:48.634245 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:48.634245 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:48.634245 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:48.634245 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:48.634245 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:48.634245 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:48.634245 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:48.634245 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:48.634245 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:48.635119 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:48.635119 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:48.635119 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:48.635119 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:48.639140 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 487/978] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:48.640168 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9295d9-1a23-456a-a46f-3dfd1f479c5a None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:48.692240 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:48.747082 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9295d9-1a23-456a-a46f-3dfd1f479c5a None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:48.783182 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb7618-efbe-4f36-86f5-989e2ed0abbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:48.783817 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb7618-efbe-4f36-86f5-989e2ed0abbe None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:48.784105 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb7618-efbe-4f36-86f5-989e2ed0abbe None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:48.784381 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb7618-efbe-4f36-86f5-989e2ed0abbe None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:48.785101 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb7618-efbe-4f36-86f5-989e2ed0abbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:48.785413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb7618-efbe-4f36-86f5-989e2ed0abbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:48.786763 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb7618-efbe-4f36-86f5-989e2ed0abbe None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:48.798106 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 492/979] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:48.803439 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720bcfd-272c-4868-946f-fb340333aa0d None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:48.912196 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720bcfd-272c-4868-946f-fb340333aa0d None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:48.933090 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:48.955171 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa04a4f-829c-4856-a27b-bc648b3cacbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:48.956076 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa04a4f-829c-4856-a27b-bc648b3cacbe None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:48.956366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa04a4f-829c-4856-a27b-bc648b3cacbe None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:48.956647 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa04a4f-829c-4856-a27b-bc648b3cacbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:48.963734 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa04a4f-829c-4856-a27b-bc648b3cacbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:48.965187 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa04a4f-829c-4856-a27b-bc648b3cacbe None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:48.978942 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-bfa04a4f-829c-4856-a27b-bc648b3cacbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:48.978942 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:48.978942 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:48.978942 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:48.978942 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:48.978942 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:48.978942 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:48.978942 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:48.978942 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:48.978942 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:48.978942 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:48.978942 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:48.978942 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:19:48.978942 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:19:48.978942 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:19:48.979884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:19:48.979884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:48.979884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:48.979884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:48.979884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:48.979884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:48.979884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:48.979884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:48.979884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:48.979884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:48.979884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:48.979884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:48.979884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:48.979884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:48.979884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:48.979884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:48.979884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:48.980828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:19:48.980828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:19:48.980828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:19:48.980828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:19:48.980828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:19:48.980828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:19:48.980828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:48.980828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:48.982031 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 488/980] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:19:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:48.985910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb7618-efbe-4f36-86f5-989e2ed0abbe None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:49.094227 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb7618-efbe-4f36-86f5-989e2ed0abbe None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:49.097146 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:49.129773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56fde4-295f-4fb2-84eb-10a2127712d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:49.130437 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56fde4-295f-4fb2-84eb-10a2127712d2 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:49.130720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56fde4-295f-4fb2-84eb-10a2127712d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:49.131009 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56fde4-295f-4fb2-84eb-10a2127712d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:49.131813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56fde4-295f-4fb2-84eb-10a2127712d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:49.132126 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56fde4-295f-4fb2-84eb-10a2127712d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:49.133531 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56fde4-295f-4fb2-84eb-10a2127712d2 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:49.150475 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 493/981] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:19:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:49.151567 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa04a4f-829c-4856-a27b-bc648b3cacbe None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:49.252602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa04a4f-829c-4856-a27b-bc648b3cacbe None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:49.287938 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7653b1a-8737-4eef-b10d-b0615edb17b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:49.288595 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7653b1a-8737-4eef-b10d-b0615edb17b6 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:49.288878 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7653b1a-8737-4eef-b10d-b0615edb17b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:49.289153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7653b1a-8737-4eef-b10d-b0615edb17b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:49.289986 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7653b1a-8737-4eef-b10d-b0615edb17b6 None admin] RBAC: Adding query filter params (role.id=acfcbbe4bd7247258d939ba45bb097b7, scope.project.id=c54934775a86487295bdbc02ed3a0103, user.id=cea1d8409c754ec797d6c694481a3112) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:49.290302 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7653b1a-8737-4eef-b10d-b0615edb17b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:49.291766 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7653b1a-8737-4eef-b10d-b0615edb17b6 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:49.297947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 489/982] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:19:49 2022] GET /identity/v3/role_assignments?user.id=cea1d8409c754ec797d6c694481a3112&scope.project.id=c54934775a86487295bdbc02ed3a0103&role.id=acfcbbe4bd7247258d939ba45bb097b7 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:49.541137 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44a0bc-a960-40a5-bb5d-d64885718439 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:49.541433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44a0bc-a960-40a5-bb5d-d64885718439 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:49.541625 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44a0bc-a960-40a5-bb5d-d64885718439 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:49.543252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 494/983] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:49.548413 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d39b9-ef5f-496f-bfc8-aab7663373d1 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:49.548850 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d39b9-ef5f-496f-bfc8-aab7663373d1 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:49.549032 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d39b9-ef5f-496f-bfc8-aab7663373d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:49.567494 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-578d39b9-ef5f-496f-bfc8-aab7663373d1 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:49.568691 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-578d39b9-ef5f-496f-bfc8-aab7663373d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:49.610596 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:49.640025 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 490/984] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:19:49.663977 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44a0bc-a960-40a5-bb5d-d64885718439 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:49.774562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44a0bc-a960-40a5-bb5d-d64885718439 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:49.822120 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac5e37-0c76-40af-9bb7-ceadcaf04efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:49.822905 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac5e37-0c76-40af-9bb7-ceadcaf04efb None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:49.823207 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac5e37-0c76-40af-9bb7-ceadcaf04efb None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:49.823533 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac5e37-0c76-40af-9bb7-ceadcaf04efb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:49.824190 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac5e37-0c76-40af-9bb7-ceadcaf04efb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:49.825539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac5e37-0c76-40af-9bb7-ceadcaf04efb None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:49.839268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-9fac5e37-0c76-40af-9bb7-ceadcaf04efb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 15:19:49.839268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:49.839268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:19:49.839268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:19:49.839268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:19:49.839268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:19:49.839268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:19:49.839268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:49.839268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 15:19:49.839268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:49.839268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:19:49.839268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:49.839268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:49.839268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:49.839268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:49.839268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:49.839268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:49.840337 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:49.840337 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:49.840337 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:49.840337 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:49.840337 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:49.840337 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:49.840337 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:19:49.840337 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:19:49.840337 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:19:49.840337 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:19:49.840337 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:49.840337 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:49.840337 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:49.840337 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:49.840337 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:49.840337 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:49.841200 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:49.841200 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:49.841200 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:49.841200 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:49.841200 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:49.841200 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:49.841200 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:49.841200 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:49.841200 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:49.841200 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:49.841200 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:19:49.841200 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:49.841200 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 15:19:49.841200 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:49.843579 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 495/985] 10.222.0.44 () {56 vars in 1126 bytes} [Tue Jul 19 15:19:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:49.846873 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d39b9-ef5f-496f-bfc8-aab7663373d1 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:49.954412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d39b9-ef5f-496f-bfc8-aab7663373d1 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:49.983631 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d996b3-83c6-475a-af2c-04b8117797c0 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:49.983992 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d996b3-83c6-475a-af2c-04b8117797c0 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:49.984279 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d996b3-83c6-475a-af2c-04b8117797c0 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:49.985653 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 496/986] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:49.990640 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb3829-b316-42e2-a1e4-9ed9f00e37b0 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:49.990757 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a308c47-18ca-4b58-a6cd-dc58014afd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:49.990946 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb3829-b316-42e2-a1e4-9ed9f00e37b0 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:49.991235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb3829-b316-42e2-a1e4-9ed9f00e37b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:49.991435 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a308c47-18ca-4b58-a6cd-dc58014afd4f None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:49.991724 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a308c47-18ca-4b58-a6cd-dc58014afd4f None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:49.992002 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a308c47-18ca-4b58-a6cd-dc58014afd4f None admin] PATH_INFO: `/v3/services` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:49.992720 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a308c47-18ca-4b58-a6cd-dc58014afd4f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:49.993034 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a308c47-18ca-4b58-a6cd-dc58014afd4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:49.994397 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a308c47-18ca-4b58-a6cd-dc58014afd4f None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:49.999622 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 491/987] 10.222.0.44 () {56 vars in 1122 bytes} [Tue Jul 19 15:19:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:50.005343 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a308c47-18ca-4b58-a6cd-dc58014afd4f None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:50.008590 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-f3bb3829-b316-42e2-a1e4-9ed9f00e37b0 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:50.009792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-f3bb3829-b316-42e2-a1e4-9ed9f00e37b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:50.036097 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:50.048412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:50.087565 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 497/988] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:19:50.110031 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb3829-b316-42e2-a1e4-9ed9f00e37b0 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:50.114790 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a308c47-18ca-4b58-a6cd-dc58014afd4f None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:50.152867 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046f2b5-6e34-4cb9-9d1d-a0f94264a532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:50.153539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046f2b5-6e34-4cb9-9d1d-a0f94264a532 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:50.153827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046f2b5-6e34-4cb9-9d1d-a0f94264a532 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:50.154119 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046f2b5-6e34-4cb9-9d1d-a0f94264a532 None admin] PATH_INFO: `/v3/services` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:50.155074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046f2b5-6e34-4cb9-9d1d-a0f94264a532 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:50.155425 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046f2b5-6e34-4cb9-9d1d-a0f94264a532 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:50.156782 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046f2b5-6e34-4cb9-9d1d-a0f94264a532 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:50.161938 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 492/989] 10.222.0.44 () {56 vars in 1122 bytes} [Tue Jul 19 15:19:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:50.167676 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046f2b5-6e34-4cb9-9d1d-a0f94264a532 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:50.230630 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb3829-b316-42e2-a1e4-9ed9f00e37b0 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:50.267192 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18301d-96eb-477b-8111-07ddc41e1a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:50.268053 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18301d-96eb-477b-8111-07ddc41e1a53 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:50.268336 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18301d-96eb-477b-8111-07ddc41e1a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:50.268618 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18301d-96eb-477b-8111-07ddc41e1a53 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:50.269271 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18301d-96eb-477b-8111-07ddc41e1a53 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:50.270650 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18301d-96eb-477b-8111-07ddc41e1a53 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:50.275929 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046f2b5-6e34-4cb9-9d1d-a0f94264a532 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:50.277742 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:50.284602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-0b18301d-96eb-477b-8111-07ddc41e1a53 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 15:19:50.284602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:50.284602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:19:50.284602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:19:50.284602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:19:50.284602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:19:50.284602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:19:50.284602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:50.284602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 15:19:50.284602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:50.284602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:19:50.284602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:50.284602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:50.284602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:50.284602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:50.284602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:50.284602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:50.285623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:50.285623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:50.285623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:50.285623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:50.285623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:50.285623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:50.285623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:19:50.285623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:19:50.285623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:19:50.285623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:19:50.285623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:50.285623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:50.285623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:50.285623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:50.285623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:50.285623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:50.286474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:50.286474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:50.286474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:50.286474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:50.286474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:50.286474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:50.286474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:50.286474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:50.286474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:50.286474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:50.286474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:19:50.286474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:50.286474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 15:19:50.286474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:50.291298 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 498/990] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:19:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:50.292901 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18301d-96eb-477b-8111-07ddc41e1a53 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:50.329087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30575e22-6985-418f-bf68-d5aedfe59dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:50.331156 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30575e22-6985-418f-bf68-d5aedfe59dcb None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:50.331689 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30575e22-6985-418f-bf68-d5aedfe59dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:50.332124 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30575e22-6985-418f-bf68-d5aedfe59dcb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:50.333538 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30575e22-6985-418f-bf68-d5aedfe59dcb None admin] RBAC: Adding query filter params (interface=admin, service_id=e3a9b059c69d42f59a983dcaec9dd229, region_id=RegionOne) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:50.334058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30575e22-6985-418f-bf68-d5aedfe59dcb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:50.334374 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:50.336671 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30575e22-6985-418f-bf68-d5aedfe59dcb None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:50.349361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 493/991] 10.222.0.44 () {56 vars in 1249 bytes} [Tue Jul 19 15:19:50 2022] GET /identity/v3/endpoints?service_id=e3a9b059c69d42f59a983dcaec9dd229&interface=admin®ion_id=RegionOne => generated 193 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:50.351213 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30575e22-6985-418f-bf68-d5aedfe59dcb None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:50.422070 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18301d-96eb-477b-8111-07ddc41e1a53 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:50.461368 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa91d3-9db3-4377-9398-c7bffd62b83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:50.462040 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa91d3-9db3-4377-9398-c7bffd62b83f None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:50.462328 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa91d3-9db3-4377-9398-c7bffd62b83f None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:50.462607 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa91d3-9db3-4377-9398-c7bffd62b83f None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:50.463349 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa91d3-9db3-4377-9398-c7bffd62b83f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:50.463665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa91d3-9db3-4377-9398-c7bffd62b83f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:50.465022 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa91d3-9db3-4377-9398-c7bffd62b83f None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:50.466580 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30575e22-6985-418f-bf68-d5aedfe59dcb None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:50.469995 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 499/992] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jul 19 15:19:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:50.475592 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa91d3-9db3-4377-9398-c7bffd62b83f None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:50.505392 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f54be1-7d1d-4036-b336-40d316c047f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:50.506168 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f54be1-7d1d-4036-b336-40d316c047f3 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:50.506402 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f54be1-7d1d-4036-b336-40d316c047f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:50.506682 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f54be1-7d1d-4036-b336-40d316c047f3 None admin] PATH_INFO: `/v3/services` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:50.507426 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f54be1-7d1d-4036-b336-40d316c047f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:50.508796 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f54be1-7d1d-4036-b336-40d316c047f3 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:50.515591 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 494/993] 10.222.0.44 () {56 vars in 1087 bytes} [Tue Jul 19 15:19:50 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:19:50.572691 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:50.593463 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa91d3-9db3-4377-9398-c7bffd62b83f None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:50.631282 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd289b-30a1-45fc-9d62-443b2f3d2189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:50.631885 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd289b-30a1-45fc-9d62-443b2f3d2189 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:50.632173 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd289b-30a1-45fc-9d62-443b2f3d2189 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:50.632454 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd289b-30a1-45fc-9d62-443b2f3d2189 None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:50.633188 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd289b-30a1-45fc-9d62-443b2f3d2189 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:50.633507 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd289b-30a1-45fc-9d62-443b2f3d2189 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:50.634901 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd289b-30a1-45fc-9d62-443b2f3d2189 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:50.640969 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 500/994] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jul 19 15:19:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:50.647468 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f54be1-7d1d-4036-b336-40d316c047f3 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:50.680457 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:50.753138 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f54be1-7d1d-4036-b336-40d316c047f3 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:50.788259 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb21649-e6aa-4f25-9af7-022e4331f453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:50.788915 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb21649-e6aa-4f25-9af7-022e4331f453 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:50.789195 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb21649-e6aa-4f25-9af7-022e4331f453 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:50.789466 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb21649-e6aa-4f25-9af7-022e4331f453 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:50.790246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb21649-e6aa-4f25-9af7-022e4331f453 None admin] RBAC: Adding query filter params (interface=public, service_id=5c1bbf2b97d34d6595c6ceed831e52dc, region_id=RegionOne) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:50.790560 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb21649-e6aa-4f25-9af7-022e4331f453 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:50.792011 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb21649-e6aa-4f25-9af7-022e4331f453 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:50.801830 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 495/995] 10.222.0.44 () {56 vars in 1251 bytes} [Tue Jul 19 15:19:50 2022] GET /identity/v3/endpoints?service_id=5c1bbf2b97d34d6595c6ceed831e52dc&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:50.803457 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd289b-30a1-45fc-9d62-443b2f3d2189 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:50.917699 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd289b-30a1-45fc-9d62-443b2f3d2189 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:50.951949 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de48365-b993-488c-8adb-992593ed353f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:50.952628 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de48365-b993-488c-8adb-992593ed353f None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:50.952910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de48365-b993-488c-8adb-992593ed353f None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:50.953183 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de48365-b993-488c-8adb-992593ed353f None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:50.953870 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de48365-b993-488c-8adb-992593ed353f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:50.955235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de48365-b993-488c-8adb-992593ed353f None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:50.962551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 501/996] 10.222.0.44 () {56 vars in 1087 bytes} [Tue Jul 19 15:19:50 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:19:51.394742 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58625081-4d69-41c1-acc7-f187f441f220 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:51.395141 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58625081-4d69-41c1-acc7-f187f441f220 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:51.395355 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58625081-4d69-41c1-acc7-f187f441f220 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:51.396870 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 496/997] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:51.401823 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6900b-c64c-4277-8051-63f2324a7412 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:51.402118 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6900b-c64c-4277-8051-63f2324a7412 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:51.402402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6900b-c64c-4277-8051-63f2324a7412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:51.420524 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-b1f6900b-c64c-4277-8051-63f2324a7412 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:51.421724 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-b1f6900b-c64c-4277-8051-63f2324a7412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:51.431400 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:51.499297 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 502/998] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:19:51.521387 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58625081-4d69-41c1-acc7-f187f441f220 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:51.627936 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:51.637294 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58625081-4d69-41c1-acc7-f187f441f220 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:51.673384 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6f1f6-c6ca-4012-b791-783d45424ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:51.674203 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6f1f6-c6ca-4012-b791-783d45424ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:51.674404 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6f1f6-c6ca-4012-b791-783d45424ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:51.674687 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6f1f6-c6ca-4012-b791-783d45424ab2 None admin] PATH_INFO: `/v3/services/image` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:51.675369 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6f1f6-c6ca-4012-b791-783d45424ab2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:51.676738 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6f1f6-c6ca-4012-b791-783d45424ab2 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:51.688686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-e6e6f1f6-c6ca-4012-b791-783d45424ab2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 15:19:51.688686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:51.688686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:19:51.688686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:19:51.688686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:19:51.688686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:19:51.688686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:19:51.688686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:51.688686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 15:19:51.688686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:51.688686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:19:51.688686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:51.688686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:51.688686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:51.688686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:51.688686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:51.688686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:51.690443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:51.690443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:51.690443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:51.690443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:51.690443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:51.690443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:51.690443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:19:51.690443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:19:51.690443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:19:51.690443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:19:51.690443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:51.690443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:51.690443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:51.690443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:51.690443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:51.690443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:51.691911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:51.691911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:51.691911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:51.691911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:51.691911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:51.691911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:51.691911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:51.691911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:51.691911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:51.691911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:51.691911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:19:51.691911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:51.691911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 15:19:51.691911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:51.691911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 497/999] 10.222.0.44 () {56 vars in 1105 bytes} [Tue Jul 19 15:19:51 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:51.696572 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6900b-c64c-4277-8051-63f2324a7412 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:51.796496 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6900b-c64c-4277-8051-63f2324a7412 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:51.830001 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cc528-59b1-4a7d-a4fc-303f0b17034c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:51.831337 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cc528-59b1-4a7d-a4fc-303f0b17034c None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:51.831634 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cc528-59b1-4a7d-a4fc-303f0b17034c None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:51.832008 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cc528-59b1-4a7d-a4fc-303f0b17034c None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:51.832611 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7cc528-59b1-4a7d-a4fc-303f0b17034c None admin] RBAC: Adding query filter params (name=image) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:51.832926 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7cc528-59b1-4a7d-a4fc-303f0b17034c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:51.834279 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7cc528-59b1-4a7d-a4fc-303f0b17034c None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:51.848060 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 503/1000] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:51.849598 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6f1f6-c6ca-4012-b791-783d45424ab2 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:51.958518 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6f1f6-c6ca-4012-b791-783d45424ab2 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:51.992060 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e00196-27bc-4cfa-afc9-ec017c216fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:51.992725 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e00196-27bc-4cfa-afc9-ec017c216fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:51.993010 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e00196-27bc-4cfa-afc9-ec017c216fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:51.993288 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e00196-27bc-4cfa-afc9-ec017c216fe3 None admin] PATH_INFO: `/v3/services` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:51.994003 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e00196-27bc-4cfa-afc9-ec017c216fe3 None admin] RBAC: Adding query filter params (type=image) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:51.994309 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e00196-27bc-4cfa-afc9-ec017c216fe3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:51.995699 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e00196-27bc-4cfa-afc9-ec017c216fe3 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:52.007313 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 498/1001] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:51 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:52.579855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b8ae4-906a-452f-be08-3b76a8f2f5e6 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:52.580242 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b8ae4-906a-452f-be08-3b76a8f2f5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:52.580446 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b8ae4-906a-452f-be08-3b76a8f2f5e6 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:52.582046 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 504/1002] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:52.587018 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d4c37-4e7a-48cd-86e5-dee452bb9ca3 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:52.587338 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d4c37-4e7a-48cd-86e5-dee452bb9ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:52.587627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d4c37-4e7a-48cd-86e5-dee452bb9ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:52.604825 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-d07d4c37-4e7a-48cd-86e5-dee452bb9ca3 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:52.606008 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-d07d4c37-4e7a-48cd-86e5-dee452bb9ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:52.623338 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:52.678930 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 499/1003] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:19:52.701304 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b8ae4-906a-452f-be08-3b76a8f2f5e6 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:52.712934 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:52.806100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b8ae4-906a-452f-be08-3b76a8f2f5e6 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:52.844044 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04937f-4d87-4671-adc8-8fa1bf49f111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:52.845666 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04937f-4d87-4671-adc8-8fa1bf49f111 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:52.846240 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04937f-4d87-4671-adc8-8fa1bf49f111 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:52.846718 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04937f-4d87-4671-adc8-8fa1bf49f111 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:52.847661 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04937f-4d87-4671-adc8-8fa1bf49f111 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:52.849333 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04937f-4d87-4671-adc8-8fa1bf49f111 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:52.863239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-ae04937f-4d87-4671-adc8-8fa1bf49f111 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 15:19:52.863239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:52.863239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:19:52.863239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:19:52.863239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:19:52.863239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:19:52.863239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:19:52.863239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:52.863239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 15:19:52.863239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:52.863239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:19:52.863239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:52.863239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:52.863239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:52.863239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:52.863239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:52.863239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:52.864235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:52.864235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:52.864235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:52.864235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:52.864235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:52.864235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:52.864235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:19:52.864235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:19:52.864235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:19:52.864235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:19:52.864235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:52.864235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:52.864235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:52.864235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:52.864235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:52.864235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:52.870343 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:52.870343 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:52.870343 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:52.870343 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:52.870343 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:52.870343 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:52.870343 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:52.870343 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:52.870343 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:52.870343 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:52.870343 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:19:52.870343 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:52.870343 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 15:19:52.870343 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:52.870343 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 505/1004] 10.222.0.44 () {56 vars in 1126 bytes} [Tue Jul 19 15:19:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:52.872624 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d4c37-4e7a-48cd-86e5-dee452bb9ca3 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:52.981008 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d4c37-4e7a-48cd-86e5-dee452bb9ca3 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:53.007755 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf18ad6-d7a4-4c19-93f1-d3cb9c6e3c1a None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:53.008044 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf18ad6-d7a4-4c19-93f1-d3cb9c6e3c1a None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:53.008321 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf18ad6-d7a4-4c19-93f1-d3cb9c6e3c1a None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:53.011545 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 506/1005] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:53.014679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40764665-156a-43d1-a8ae-e290d2416a6d None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:53.014969 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40764665-156a-43d1-a8ae-e290d2416a6d None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:53.015272 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40764665-156a-43d1-a8ae-e290d2416a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:53.016109 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c11f84-cf00-4b04-a326-d56bf1fb0b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:53.016885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c11f84-cf00-4b04-a326-d56bf1fb0b45 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:53.017253 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c11f84-cf00-4b04-a326-d56bf1fb0b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:53.017543 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c11f84-cf00-4b04-a326-d56bf1fb0b45 None admin] PATH_INFO: `/v3/services` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:53.018888 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c11f84-cf00-4b04-a326-d56bf1fb0b45 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:53.019212 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c11f84-cf00-4b04-a326-d56bf1fb0b45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:53.020703 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c11f84-cf00-4b04-a326-d56bf1fb0b45 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:53.026812 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 500/1006] 10.222.0.44 () {56 vars in 1122 bytes} [Tue Jul 19 15:19:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:53.031754 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c11f84-cf00-4b04-a326-d56bf1fb0b45 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:53.034655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-40764665-156a-43d1-a8ae-e290d2416a6d None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:53.035966 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-40764665-156a-43d1-a8ae-e290d2416a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:53.052162 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:53.112989 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 507/1007] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:53 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:19:53.135995 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40764665-156a-43d1-a8ae-e290d2416a6d None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:53.138153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:53.142391 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c11f84-cf00-4b04-a326-d56bf1fb0b45 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:53.179775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022a07f-f529-4e84-a338-14d80d58dc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:53.180447 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022a07f-f529-4e84-a338-14d80d58dc3b None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:53.180724 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022a07f-f529-4e84-a338-14d80d58dc3b None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:53.181004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022a07f-f529-4e84-a338-14d80d58dc3b None admin] PATH_INFO: `/v3/services` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:53.181716 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022a07f-f529-4e84-a338-14d80d58dc3b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:53.182142 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022a07f-f529-4e84-a338-14d80d58dc3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:53.183415 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022a07f-f529-4e84-a338-14d80d58dc3b None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:53.193770 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 501/1008] 10.222.0.44 () {56 vars in 1122 bytes} [Tue Jul 19 15:19:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:53.194430 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022a07f-f529-4e84-a338-14d80d58dc3b None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:53.240176 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40764665-156a-43d1-a8ae-e290d2416a6d None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:53.275265 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b8715-7f3c-410c-8ab3-0c0c8cc46875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:53.276063 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b8715-7f3c-410c-8ab3-0c0c8cc46875 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:53.276350 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b8715-7f3c-410c-8ab3-0c0c8cc46875 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:53.276635 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b8715-7f3c-410c-8ab3-0c0c8cc46875 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:53.277293 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b8715-7f3c-410c-8ab3-0c0c8cc46875 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:53.278642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b8715-7f3c-410c-8ab3-0c0c8cc46875 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:53.284833 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:53.291777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-ed1b8715-7f3c-410c-8ab3-0c0c8cc46875 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 15:19:53.291777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:53.291777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:19:53.291777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:19:53.291777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:19:53.291777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:19:53.291777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:19:53.291777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:53.291777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 15:19:53.291777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:53.291777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:19:53.291777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:53.291777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:53.291777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:53.291777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:53.291777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:53.291777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:53.292766 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:53.292766 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:53.292766 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:53.292766 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:53.292766 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:53.292766 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:53.292766 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:19:53.292766 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:19:53.292766 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:19:53.292766 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:19:53.292766 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:53.292766 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:53.292766 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:53.292766 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:53.292766 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:53.292766 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:53.293610 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:53.293610 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:53.293610 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:53.293610 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:53.293610 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:53.293610 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:53.293610 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:53.293610 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:53.293610 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:53.293610 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:53.293610 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:19:53.293610 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:53.293610 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 15:19:53.293610 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:53.293610 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 508/1009] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:19:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:19:53.298807 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b8715-7f3c-410c-8ab3-0c0c8cc46875 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:53.313104 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022a07f-f529-4e84-a338-14d80d58dc3b None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:53.350964 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33325a-6bd1-4eb1-931e-6ee0c5618505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:53.351653 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33325a-6bd1-4eb1-931e-6ee0c5618505 None admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:53.351943 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33325a-6bd1-4eb1-931e-6ee0c5618505 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:53.352225 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33325a-6bd1-4eb1-931e-6ee0c5618505 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:53.352966 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33325a-6bd1-4eb1-931e-6ee0c5618505 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:53.354369 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33325a-6bd1-4eb1-931e-6ee0c5618505 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:53.368468 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:53.376238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 502/1010] 10.222.0.44 () {60 vars in 1144 bytes} [Tue Jul 19 15:19:53 2022] POST /identity/v3/endpoints => generated 325 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:19:53.412611 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b8715-7f3c-410c-8ab3-0c0c8cc46875 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:53.458399 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d884b-fc5b-4eb3-a158-5278303f4526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:53.459078 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d884b-fc5b-4eb3-a158-5278303f4526 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:53.459395 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d884b-fc5b-4eb3-a158-5278303f4526 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:53.459672 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d884b-fc5b-4eb3-a158-5278303f4526 None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:53.460401 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d884b-fc5b-4eb3-a158-5278303f4526 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:53.460713 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d884b-fc5b-4eb3-a158-5278303f4526 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:53.462088 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d884b-fc5b-4eb3-a158-5278303f4526 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:53.472283 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 509/1011] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jul 19 15:19:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:53.473666 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33325a-6bd1-4eb1-931e-6ee0c5618505 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:53.585806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33325a-6bd1-4eb1-931e-6ee0c5618505 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:53.621631 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8791d-55ff-4253-99d1-6980877fd9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:53.622321 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8791d-55ff-4253-99d1-6980877fd9de None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:53.622608 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8791d-55ff-4253-99d1-6980877fd9de None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:53.622887 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8791d-55ff-4253-99d1-6980877fd9de None admin] PATH_INFO: `/v3/services` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:53.623757 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d8791d-55ff-4253-99d1-6980877fd9de None admin] RBAC: Adding query filter params (type=compute) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:53.624067 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d8791d-55ff-4253-99d1-6980877fd9de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:53.625492 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d8791d-55ff-4253-99d1-6980877fd9de None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:53.635740 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 503/1012] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jul 19 15:19:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:53.636924 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d884b-fc5b-4eb3-a158-5278303f4526 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:53.747636 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d884b-fc5b-4eb3-a158-5278303f4526 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:53.774324 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:53.785824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18e3db-564f-4c98-87bb-c011e542d116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:53.786551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18e3db-564f-4c98-87bb-c011e542d116 None admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:53.786818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18e3db-564f-4c98-87bb-c011e542d116 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:53.787055 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18e3db-564f-4c98-87bb-c011e542d116 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:53.787997 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c18e3db-564f-4c98-87bb-c011e542d116 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:53.789361 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c18e3db-564f-4c98-87bb-c011e542d116 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:53.815258 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 510/1013] 10.222.0.44 () {60 vars in 1144 bytes} [Tue Jul 19 15:19:53 2022] POST /identity/v3/endpoints => generated 334 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:19:54.057050 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd135c-5846-4fac-81d9-1ad92221cf32 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:54.057556 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd135c-5846-4fac-81d9-1ad92221cf32 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:54.057556 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd135c-5846-4fac-81d9-1ad92221cf32 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:54.059185 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 504/1014] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:54.064755 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d35ad-4235-403f-a943-ec7ee319d32b None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:54.065221 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d35ad-4235-403f-a943-ec7ee319d32b None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:54.065321 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d35ad-4235-403f-a943-ec7ee319d32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:54.082483 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-864d35ad-4235-403f-a943-ec7ee319d32b None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:54.083711 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-864d35ad-4235-403f-a943-ec7ee319d32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:54.163252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 511/1015] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:54 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:19:54.184044 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd135c-5846-4fac-81d9-1ad92221cf32 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:54.188278 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:54.293361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd135c-5846-4fac-81d9-1ad92221cf32 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:54.330305 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771d8eb-cccf-4187-aadb-820ba7328086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:54.330912 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771d8eb-cccf-4187-aadb-820ba7328086 None admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:54.331199 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771d8eb-cccf-4187-aadb-820ba7328086 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:54.331506 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771d8eb-cccf-4187-aadb-820ba7328086 None admin] PATH_INFO: `/v3/services` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:54.332238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1771d8eb-cccf-4187-aadb-820ba7328086 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:54.333646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1771d8eb-cccf-4187-aadb-820ba7328086 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:54.348029 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 505/1016] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jul 19 15:19:54 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:19:55.476996 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7553b6-72ca-4867-a551-d0c913ad1ebb None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:55.477569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7553b6-72ca-4867-a551-d0c913ad1ebb None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:55.477569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7553b6-72ca-4867-a551-d0c913ad1ebb None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:55.479080 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 512/1017] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:55.484187 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0dace-e4c4-4157-97bc-61bccd6b1dda None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:55.484576 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0dace-e4c4-4157-97bc-61bccd6b1dda None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:55.484752 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0dace-e4c4-4157-97bc-61bccd6b1dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:55.501673 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-88a0dace-e4c4-4157-97bc-61bccd6b1dda None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:55.503425 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-88a0dace-e4c4-4157-97bc-61bccd6b1dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:55.563681 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:55.582735 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 506/1018] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:19:55.605205 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7553b6-72ca-4867-a551-d0c913ad1ebb None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:55.710685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7553b6-72ca-4867-a551-d0c913ad1ebb None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:55.719982 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:55.751681 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b0d3a-f45d-40ae-a251-334ad267caa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:55.753352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b0d3a-f45d-40ae-a251-334ad267caa7 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:55.753637 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b0d3a-f45d-40ae-a251-334ad267caa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:55.753952 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b0d3a-f45d-40ae-a251-334ad267caa7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:55.755136 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b0d3a-f45d-40ae-a251-334ad267caa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:55.756626 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b0d3a-f45d-40ae-a251-334ad267caa7 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:55.763054 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 513/1019] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:55.764158 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0dace-e4c4-4157-97bc-61bccd6b1dda None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:55.873573 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0dace-e4c4-4157-97bc-61bccd6b1dda None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:55.908357 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb8a84-5b7b-4dfa-84f3-1129cfa75256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:55.909021 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb8a84-5b7b-4dfa-84f3-1129cfa75256 None admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:55.909301 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb8a84-5b7b-4dfa-84f3-1129cfa75256 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:55.909574 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb8a84-5b7b-4dfa-84f3-1129cfa75256 None admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:55.910276 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb8a84-5b7b-4dfa-84f3-1129cfa75256 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:55.911724 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb8a84-5b7b-4dfa-84f3-1129cfa75256 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:55.928788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e42e94-49b4-433e-a7c7-359433747da8 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:55.929092 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e42e94-49b4-433e-a7c7-359433747da8 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:55.929378 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e42e94-49b4-433e-a7c7-359433747da8 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:55.934580 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 514/1020] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:19:55.936272 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453157fc-833e-4e0a-b3e1-4610b7664b37 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:55.936572 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453157fc-833e-4e0a-b3e1-4610b7664b37 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:55.936857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453157fc-833e-4e0a-b3e1-4610b7664b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:55.939130 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 507/1021] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jul 19 15:19:55 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:19:55.960890 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-453157fc-833e-4e0a-b3e1-4610b7664b37 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:55.962132 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-453157fc-833e-4e0a-b3e1-4610b7664b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:56.040469 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 515/1022] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:19:56.063563 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb8a84-5b7b-4dfa-84f3-1129cfa75256 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:56.113682 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:56.176065 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb8a84-5b7b-4dfa-84f3-1129cfa75256 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:56.211369 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85e11e-8309-4c38-8485-44c9f7a690b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:56.212177 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85e11e-8309-4c38-8485-44c9f7a690b0 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:56.212457 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85e11e-8309-4c38-8485-44c9f7a690b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:56.212730 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85e11e-8309-4c38-8485-44c9f7a690b0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:56.223152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a85e11e-8309-4c38-8485-44c9f7a690b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:19:56.231365 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-3a85e11e-8309-4c38-8485-44c9f7a690b0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 15:19:56.231365 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:56.231365 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:56.231365 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:56.231365 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:56.231365 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:56.231365 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:56.231365 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:56.231365 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:56.231365 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:56.231365 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:56.231365 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:56.231365 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:19:56.231365 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:19:56.231365 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:19:56.231365 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:19:56.232304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:19:56.232304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:19:56.232304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:19:56.232304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:19:56.232304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:56.232304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:56.232304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:56.232304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:56.232304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:56.232304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:56.232304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:56.232304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:56.232304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:56.232304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:56.232304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:56.232304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:56.238280 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:56.238280 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:56.238280 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:56.238280 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:56.238280 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:19:56.238280 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:19:56.238280 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:19:56.238280 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:19:56.238280 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:19:56.238280 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:19:56.238280 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 15:19:56.238280 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:56.238280 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 508/1023] 10.222.0.44 () {56 vars in 1120 bytes} [Tue Jul 19 15:19:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:56.240499 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453157fc-833e-4e0a-b3e1-4610b7664b37 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:56.347757 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453157fc-833e-4e0a-b3e1-4610b7664b37 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:56.355894 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:56.384785 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ece936-2b56-4675-bfd7-c31e6d0b130e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:56.385477 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ece936-2b56-4675-bfd7-c31e6d0b130e None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:56.385773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ece936-2b56-4675-bfd7-c31e6d0b130e None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:56.386039 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ece936-2b56-4675-bfd7-c31e6d0b130e None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:56.386821 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ece936-2b56-4675-bfd7-c31e6d0b130e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:56.387067 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ece936-2b56-4675-bfd7-c31e6d0b130e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:56.388462 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ece936-2b56-4675-bfd7-c31e6d0b130e None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:56.402361 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 516/1024] 10.222.0.44 () {56 vars in 1115 bytes} [Tue Jul 19 15:19:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:56.403823 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85e11e-8309-4c38-8485-44c9f7a690b0 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:56.404295 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ea6f3-608d-4f37-86d2-c5d8df5c784f None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:56.404935 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ea6f3-608d-4f37-86d2-c5d8df5c784f None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:56.405143 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ea6f3-608d-4f37-86d2-c5d8df5c784f None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:56.406590 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 517/1025] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:19:56.412739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a3742-730b-4e17-90d0-82d7199d0aae None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:56.413231 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a3742-730b-4e17-90d0-82d7199d0aae None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:56.413525 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a3742-730b-4e17-90d0-82d7199d0aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:56.432314 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-6b6a3742-730b-4e17-90d0-82d7199d0aae None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:56.433499 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-6b6a3742-730b-4e17-90d0-82d7199d0aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:56.509723 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 518/1026] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:19:56.517868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85e11e-8309-4c38-8485-44c9f7a690b0 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:56.519455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:56.532088 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a3742-730b-4e17-90d0-82d7199d0aae None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:56.555411 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992620a-7221-4aef-90d7-491dcfb70b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:56.556441 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992620a-7221-4aef-90d7-491dcfb70b5f None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:56.556964 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992620a-7221-4aef-90d7-491dcfb70b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:56.557378 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992620a-7221-4aef-90d7-491dcfb70b5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:56.569067 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992620a-7221-4aef-90d7-491dcfb70b5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:56.570513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992620a-7221-4aef-90d7-491dcfb70b5f None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:56.588369 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-9992620a-7221-4aef-90d7-491dcfb70b5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:56.588369 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:56.588369 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:56.588369 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:56.588369 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:56.588369 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:56.588369 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:56.588369 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:56.588369 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:56.588369 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:56.588369 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:56.588369 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:56.588369 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:56.588369 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:56.588369 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:56.589476 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:56.589476 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:56.589476 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:56.589476 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:56.589476 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:56.589476 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:56.589476 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:56.589476 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:56.589476 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:56.589476 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:56.589476 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:56.589476 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:56.589476 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:56.589476 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:56.589476 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:56.589476 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:56.589476 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:56.590457 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:56.590457 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:56.590457 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:56.590457 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:56.590457 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 509/1027] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:19:56.595039 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992620a-7221-4aef-90d7-491dcfb70b5f None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:56.637210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:56.641837 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a3742-730b-4e17-90d0-82d7199d0aae None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:56.679388 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084992d-7dfa-4c46-94fd-e80156cc94ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:56.680927 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084992d-7dfa-4c46-94fd-e80156cc94ef None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:56.681224 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084992d-7dfa-4c46-94fd-e80156cc94ef None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:56.681509 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084992d-7dfa-4c46-94fd-e80156cc94ef None admin] PATH_INFO: `/v3/services/image` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:56.682331 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084992d-7dfa-4c46-94fd-e80156cc94ef None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:56.684026 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084992d-7dfa-4c46-94fd-e80156cc94ef None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:56.697706 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992620a-7221-4aef-90d7-491dcfb70b5f None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:56.698758 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-b084992d-7dfa-4c46-94fd-e80156cc94ef None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 15:19:56.698758 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:56.698758 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:19:56.698758 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:19:56.698758 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:19:56.698758 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:19:56.698758 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:19:56.698758 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:56.698758 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 15:19:56.698758 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:56.698758 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:19:56.698758 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:56.698758 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:56.698758 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:56.698758 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:56.698758 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:56.698758 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:56.699849 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:56.699849 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:56.699849 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:56.699849 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:56.699849 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:56.699849 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:56.699849 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:19:56.699849 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:19:56.699849 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:19:56.699849 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:19:56.699849 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:56.699849 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:56.699849 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:56.699849 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:56.699849 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:56.699849 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:56.700703 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:56.700703 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:56.700703 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:56.700703 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:56.700703 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:56.700703 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:56.700703 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:56.700703 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:56.700703 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:56.700703 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:56.700703 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:19:56.700703 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:56.700703 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 15:19:56.700703 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:56.703575 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 519/1028] 10.222.0.44 () {56 vars in 1105 bytes} [Tue Jul 19 15:19:56 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:19:56.707420 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084992d-7dfa-4c46-94fd-e80156cc94ef None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:56.737608 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1fc57-6d7f-467f-b141-a8d45615f68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:56.738275 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1fc57-6d7f-467f-b141-a8d45615f68b None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:56.738559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1fc57-6d7f-467f-b141-a8d45615f68b None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:56.738830 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1fc57-6d7f-467f-b141-a8d45615f68b None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:56.739594 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1fc57-6d7f-467f-b141-a8d45615f68b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:56.739904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1fc57-6d7f-467f-b141-a8d45615f68b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:56.741412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1fc57-6d7f-467f-b141-a8d45615f68b None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:56.754217 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 510/1029] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:56.759521 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1fc57-6d7f-467f-b141-a8d45615f68b None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:56.775594 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:56.820480 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084992d-7dfa-4c46-94fd-e80156cc94ef None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:56.866479 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde7653-c1c5-4a64-95ed-9617d35dc80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:56.867155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde7653-c1c5-4a64-95ed-9617d35dc80b None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:56.867477 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde7653-c1c5-4a64-95ed-9617d35dc80b None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:56.867760 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde7653-c1c5-4a64-95ed-9617d35dc80b None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:56.868488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde7653-c1c5-4a64-95ed-9617d35dc80b None admin] RBAC: Adding query filter params (name=image) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:56.868811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde7653-c1c5-4a64-95ed-9617d35dc80b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:56.870170 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde7653-c1c5-4a64-95ed-9617d35dc80b None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:56.876158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 520/1030] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:56.877740 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1fc57-6d7f-467f-b141-a8d45615f68b None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:56.882033 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde7653-c1c5-4a64-95ed-9617d35dc80b None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:56.911920 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:56.915199 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc82892-bf0e-4b10-b378-8f89695703bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:56.916045 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc82892-bf0e-4b10-b378-8f89695703bb None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:56.916334 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc82892-bf0e-4b10-b378-8f89695703bb None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:56.916610 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc82892-bf0e-4b10-b378-8f89695703bb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:56.924037 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc82892-bf0e-4b10-b378-8f89695703bb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:56.925476 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc82892-bf0e-4b10-b378-8f89695703bb None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:56.941068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-dcc82892-bf0e-4b10-b378-8f89695703bb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:19:56.941068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:56.941068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:56.941068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:56.941068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:56.941068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:56.941068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:56.941068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:56.941068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:56.941068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:56.941068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:56.941068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:56.941068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:19:56.941068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:19:56.941068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:19:56.941068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:19:56.942041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:56.942041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:56.942041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:19:56.942041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:56.942041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:19:56.942041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:19:56.942041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:56.942041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:56.942041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:56.942041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:56.942041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:56.942041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:56.942041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:56.942041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:56.942041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:56.942041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:56.942041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:56.942041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:56.942976 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:56.942976 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:56.942976 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:19:56.942976 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:19:56.942976 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:19:56.942976 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:19:56.942976 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:19:56.942976 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:19:56.942976 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:19:56.942976 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:56.947210 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 511/1031] 10.222.0.44 () {56 vars in 1093 bytes} [Tue Jul 19 15:19:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:19:56.947978 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc82892-bf0e-4b10-b378-8f89695703bb None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:56.997209 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde7653-c1c5-4a64-95ed-9617d35dc80b None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:57.029204 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:57.032411 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10e35a-a28c-4bba-b4e9-e8d9e4af9b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:57.033695 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10e35a-a28c-4bba-b4e9-e8d9e4af9b3d None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:57.034057 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10e35a-a28c-4bba-b4e9-e8d9e4af9b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:57.034410 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10e35a-a28c-4bba-b4e9-e8d9e4af9b3d None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:57.035198 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10e35a-a28c-4bba-b4e9-e8d9e4af9b3d None admin] RBAC: Adding query filter params (type=image) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:57.035607 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10e35a-a28c-4bba-b4e9-e8d9e4af9b3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:57.037039 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10e35a-a28c-4bba-b4e9-e8d9e4af9b3d None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:57.042295 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 521/1032] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:57.047822 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10e35a-a28c-4bba-b4e9-e8d9e4af9b3d None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:57.062142 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc82892-bf0e-4b10-b378-8f89695703bb None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:57.098102 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1187f0-2d88-479b-b9ce-9ea14d788af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:57.098773 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1187f0-2d88-479b-b9ce-9ea14d788af9 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:57.099056 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1187f0-2d88-479b-b9ce-9ea14d788af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:57.099368 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1187f0-2d88-479b-b9ce-9ea14d788af9 None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:57.100220 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1187f0-2d88-479b-b9ce-9ea14d788af9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:57.100534 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1187f0-2d88-479b-b9ce-9ea14d788af9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:57.101941 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1187f0-2d88-479b-b9ce-9ea14d788af9 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:57.122319 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 512/1033] 10.222.0.44 () {56 vars in 1133 bytes} [Tue Jul 19 15:19:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:57.128019 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1187f0-2d88-479b-b9ce-9ea14d788af9 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:57.152166 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:57.166104 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10e35a-a28c-4bba-b4e9-e8d9e4af9b3d None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:57.200904 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fa638-935e-4e3b-9013-d1ee2b57c1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:57.201563 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fa638-935e-4e3b-9013-d1ee2b57c1ac None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:57.201853 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fa638-935e-4e3b-9013-d1ee2b57c1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:57.202136 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fa638-935e-4e3b-9013-d1ee2b57c1ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:57.202929 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20fa638-935e-4e3b-9013-d1ee2b57c1ac None admin] RBAC: Adding query filter params (interface=public, service_id=7ae3237d45e346b1a71cf8b3c04d6a48, region_id=RegionOne) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:57.203271 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20fa638-935e-4e3b-9013-d1ee2b57c1ac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:57.204632 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20fa638-935e-4e3b-9013-d1ee2b57c1ac None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:57.211463 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 522/1034] 10.222.0.44 () {56 vars in 1251 bytes} [Tue Jul 19 15:19:57 2022] GET /identity/v3/endpoints?service_id=7ae3237d45e346b1a71cf8b3c04d6a48&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:57.216895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fa638-935e-4e3b-9013-d1ee2b57c1ac None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:57.240731 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1187f0-2d88-479b-b9ce-9ea14d788af9 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:57.274147 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:57.282806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72453462-6397-43d4-be99-dcc53188915e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:57.283612 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72453462-6397-43d4-be99-dcc53188915e None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:57.283905 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72453462-6397-43d4-be99-dcc53188915e None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:57.284420 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72453462-6397-43d4-be99-dcc53188915e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:57.322779 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fa638-935e-4e3b-9013-d1ee2b57c1ac None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:57.358143 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b8fb7-e0d2-4f40-b173-38ac7d209a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:57.359186 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b8fb7-e0d2-4f40-b173-38ac7d209a1a None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:57.359729 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b8fb7-e0d2-4f40-b173-38ac7d209a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:57.360175 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b8fb7-e0d2-4f40-b173-38ac7d209a1a None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:57.360772 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72453462-6397-43d4-be99-dcc53188915e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:57.361174 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b8fb7-e0d2-4f40-b173-38ac7d209a1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:57.363258 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b8fb7-e0d2-4f40-b173-38ac7d209a1a None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:57.364463 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72453462-6397-43d4-be99-dcc53188915e None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:57.381443 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 523/1035] 10.222.0.44 () {56 vars in 1087 bytes} [Tue Jul 19 15:19:57 2022] GET /identity/v3/services => generated 1957 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:19:57.475469 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 513/1036] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:19:57 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 15:19:57.481512 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b8fb7-e0d2-4f40-b173-38ac7d209a1a None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:57.503818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:57.598499 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b8fb7-e0d2-4f40-b173-38ac7d209a1a None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:57.635645 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69eb5dc-658e-44fa-9632-41d33e92a40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:57.636452 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69eb5dc-658e-44fa-9632-41d33e92a40a None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:57.636739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69eb5dc-658e-44fa-9632-41d33e92a40a None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:57.637061 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69eb5dc-658e-44fa-9632-41d33e92a40a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:57.648662 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69eb5dc-658e-44fa-9632-41d33e92a40a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:57.650094 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69eb5dc-658e-44fa-9632-41d33e92a40a None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:57.668685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-f69eb5dc-658e-44fa-9632-41d33e92a40a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:57.668685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:57.668685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:57.668685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:57.668685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:57.668685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:57.668685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:57.668685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:57.668685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:57.668685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:57.668685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:57.668685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:57.668685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:19:57.668685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:19:57.668685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:19:57.669739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:19:57.669739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:57.669739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:57.669739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:57.669739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:57.669739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:57.669739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:57.669739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:57.669739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:57.669739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:57.669739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:57.669739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:57.669739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:57.669739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:57.669739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:57.669739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:57.669739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:57.670707 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:19:57.670707 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:19:57.670707 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:19:57.670707 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:57.670707 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 524/1037] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:57.676196 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72453462-6397-43d4-be99-dcc53188915e None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:57.707606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:57.779052 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72453462-6397-43d4-be99-dcc53188915e None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:57.813527 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af4d10-8d27-4d3d-9687-6eeedbf9ed41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:57.814189 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af4d10-8d27-4d3d-9687-6eeedbf9ed41 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:57.815078 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af4d10-8d27-4d3d-9687-6eeedbf9ed41 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:57.815393 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af4d10-8d27-4d3d-9687-6eeedbf9ed41 None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:57.816119 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af4d10-8d27-4d3d-9687-6eeedbf9ed41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:57.816427 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af4d10-8d27-4d3d-9687-6eeedbf9ed41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:57.817785 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af4d10-8d27-4d3d-9687-6eeedbf9ed41 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:57.833980 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 514/1038] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:57.836281 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69eb5dc-658e-44fa-9632-41d33e92a40a None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:57.914730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:57.953883 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69eb5dc-658e-44fa-9632-41d33e92a40a None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:57.988233 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba695c48-d235-4304-9a75-07acc1ef107c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:57.989029 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba695c48-d235-4304-9a75-07acc1ef107c None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:57.989317 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba695c48-d235-4304-9a75-07acc1ef107c None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:57.989598 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba695c48-d235-4304-9a75-07acc1ef107c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:57.996574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba695c48-d235-4304-9a75-07acc1ef107c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:57.998278 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba695c48-d235-4304-9a75-07acc1ef107c None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:58.012825 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-ba695c48-d235-4304-9a75-07acc1ef107c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:58.012825 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:58.012825 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:58.012825 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:58.012825 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:58.012825 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:58.012825 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:58.012825 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:58.012825 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:58.012825 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:58.012825 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:58.012825 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:58.012825 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:19:58.012825 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:19:58.012825 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:19:58.013721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:19:58.013721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:58.013721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:58.013721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:58.013721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:58.013721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:58.013721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:58.013721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:58.013721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:58.013721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:58.013721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:58.013721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:58.013721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:58.013721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:58.013721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:58.013721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:58.013721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:58.014607 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:19:58.014607 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:19:58.014607 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:19:58.014607 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:19:58.014607 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:19:58.014607 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:19:58.014607 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:19:58.014607 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:19:58.014607 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 525/1039] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:19:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:58.020427 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af4d10-8d27-4d3d-9687-6eeedbf9ed41 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:58.044068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2da9c4-be6c-494e-ae4c-5064ab1d309e None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:58.044808 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2da9c4-be6c-494e-ae4c-5064ab1d309e None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:58.045109 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2da9c4-be6c-494e-ae4c-5064ab1d309e None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:58.046626 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 526/1040] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:19:58.053351 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadfa24-3ffd-4e89-a995-0d1b87cc4d7f None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:58.054202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadfa24-3ffd-4e89-a995-0d1b87cc4d7f None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:58.054971 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadfa24-3ffd-4e89-a995-0d1b87cc4d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:58.075086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-deadfa24-3ffd-4e89-a995-0d1b87cc4d7f None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:58.076462 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-deadfa24-3ffd-4e89-a995-0d1b87cc4d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:58.119486 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:58.129368 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af4d10-8d27-4d3d-9687-6eeedbf9ed41 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:58.149165 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 527/1041] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:19:58.173413 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc36bba-bf3b-468c-9ea4-1787aa4e1423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:58.173694 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadfa24-3ffd-4e89-a995-0d1b87cc4d7f None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:58.174292 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc36bba-bf3b-468c-9ea4-1787aa4e1423 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:58.174646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc36bba-bf3b-468c-9ea4-1787aa4e1423 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:58.174995 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc36bba-bf3b-468c-9ea4-1787aa4e1423 None admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:58.176079 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc36bba-bf3b-468c-9ea4-1787aa4e1423 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:58.176396 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc36bba-bf3b-468c-9ea4-1787aa4e1423 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:58.178645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc36bba-bf3b-468c-9ea4-1787aa4e1423 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:58.190981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 515/1042] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:19:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:58.197743 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc36bba-bf3b-468c-9ea4-1787aa4e1423 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:58.239565 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:58.280710 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadfa24-3ffd-4e89-a995-0d1b87cc4d7f None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:58.308250 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc36bba-bf3b-468c-9ea4-1787aa4e1423 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:58.316661 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4b96d-88c9-4f2f-9d02-b8c4f5d82256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:58.317521 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4b96d-88c9-4f2f-9d02-b8c4f5d82256 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:58.317748 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4b96d-88c9-4f2f-9d02-b8c4f5d82256 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:58.318039 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4b96d-88c9-4f2f-9d02-b8c4f5d82256 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:58.319252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4b96d-88c9-4f2f-9d02-b8c4f5d82256 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:58.320676 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4b96d-88c9-4f2f-9d02-b8c4f5d82256 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:58.322480 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 528/1043] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:58.327861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4b96d-88c9-4f2f-9d02-b8c4f5d82256 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:58.349753 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd63239-e0cb-4f21-a03d-18b3aadae2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:58.350408 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd63239-e0cb-4f21-a03d-18b3aadae2c1 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:58.350701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd63239-e0cb-4f21-a03d-18b3aadae2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:58.350985 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd63239-e0cb-4f21-a03d-18b3aadae2c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:58.351843 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd63239-e0cb-4f21-a03d-18b3aadae2c1 None admin] RBAC: Adding query filter params (role.id=acfcbbe4bd7247258d939ba45bb097b7, scope.project.id=c54934775a86487295bdbc02ed3a0103, user.id=fef0511f56144ca9945b2dddfa2601a2) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:58.352162 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd63239-e0cb-4f21-a03d-18b3aadae2c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:58.353588 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd63239-e0cb-4f21-a03d-18b3aadae2c1 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:58.371261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 516/1044] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:19:58 2022] GET /identity/v3/role_assignments?user.id=fef0511f56144ca9945b2dddfa2601a2&scope.project.id=c54934775a86487295bdbc02ed3a0103&role.id=acfcbbe4bd7247258d939ba45bb097b7 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:58.434948 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4b96d-88c9-4f2f-9d02-b8c4f5d82256 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:58.464474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:58.474676 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb739a0-8007-4fc5-a74a-a3c673e9fec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:58.475395 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb739a0-8007-4fc5-a74a-a3c673e9fec8 None admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:58.475690 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb739a0-8007-4fc5-a74a-a3c673e9fec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:58.475976 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb739a0-8007-4fc5-a74a-a3c673e9fec8 None admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:58.476713 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb739a0-8007-4fc5-a74a-a3c673e9fec8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:58.478153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb739a0-8007-4fc5-a74a-a3c673e9fec8 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:58.499947 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 529/1045] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jul 19 15:19:58 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:19:59.434298 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26431fe-4167-4cf1-b6f4-166554c69472 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:59.434824 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26431fe-4167-4cf1-b6f4-166554c69472 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:59.434824 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26431fe-4167-4cf1-b6f4-166554c69472 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:59.436280 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 517/1046] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:19:59.441913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d6944-2fb8-415c-a368-b87f00daf605 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:59.442316 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d6944-2fb8-415c-a368-b87f00daf605 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:59.442483 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d6944-2fb8-415c-a368-b87f00daf605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:59.459903 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-a81d6944-2fb8-415c-a368-b87f00daf605 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:59.461101 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-a81d6944-2fb8-415c-a368-b87f00daf605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:59.534578 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 530/1047] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:19:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:19:59.558236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26431fe-4167-4cf1-b6f4-166554c69472 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:59.577071 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:59.665701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26431fe-4167-4cf1-b6f4-166554c69472 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:59.706806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86ea0e-8f93-4063-934f-80201f7786cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:59.707538 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86ea0e-8f93-4063-934f-80201f7786cf None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:59.707823 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86ea0e-8f93-4063-934f-80201f7786cf None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:59.708104 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86ea0e-8f93-4063-934f-80201f7786cf None admin] PATH_INFO: `/v3/services/image` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:59.708759 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86ea0e-8f93-4063-934f-80201f7786cf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:59.710131 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86ea0e-8f93-4063-934f-80201f7786cf None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:59.721911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-aa86ea0e-8f93-4063-934f-80201f7786cf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 15:19:59.721911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:59.721911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:19:59.721911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:19:59.721911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:19:59.721911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:19:59.721911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:19:59.721911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:59.721911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 15:19:59.721911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:59.721911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:19:59.721911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:59.721911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:19:59.721911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:19:59.721911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:19:59.721911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:19:59.721911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:19:59.723092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:19:59.723092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:19:59.723092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:19:59.723092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:19:59.723092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:19:59.723092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:19:59.723092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:19:59.723092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:19:59.723092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:19:59.723092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:19:59.723092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:19:59.723092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:19:59.723092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:19:59.723092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:19:59.723092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:19:59.723092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:19:59.724129 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:19:59.724129 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:19:59.724129 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:19:59.724129 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:19:59.724129 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:19:59.724129 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:19:59.724129 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:19:59.724129 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:19:59.724129 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:19:59.724129 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:19:59.724129 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:19:59.724129 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:19:59.724129 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 15:19:59.724129 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:19:59.724129 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 518/1048] 10.222.0.44 () {56 vars in 1105 bytes} [Tue Jul 19 15:19:59 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:19:59.729570 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d6944-2fb8-415c-a368-b87f00daf605 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:59.859701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d6944-2fb8-415c-a368-b87f00daf605 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:59.875053 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:59.897105 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65334d45-b2cb-4c65-b053-680040c59424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:59.897775 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65334d45-b2cb-4c65-b053-680040c59424 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:59.898064 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65334d45-b2cb-4c65-b053-680040c59424 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:59.898340 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65334d45-b2cb-4c65-b053-680040c59424 None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:59.899043 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65334d45-b2cb-4c65-b053-680040c59424 None admin] RBAC: Adding query filter params (name=image) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:59.899436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65334d45-b2cb-4c65-b053-680040c59424 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:59.900934 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65334d45-b2cb-4c65-b053-680040c59424 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:59.906382 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 531/1049] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:59.912541 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86ea0e-8f93-4063-934f-80201f7786cf None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:59.998331 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:00.018873 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86ea0e-8f93-4063-934f-80201f7786cf None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:00.055074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429ec97-e8c8-447e-83fa-988d0fe911e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:00.055779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429ec97-e8c8-447e-83fa-988d0fe911e9 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:00.056068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429ec97-e8c8-447e-83fa-988d0fe911e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:00.056346 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429ec97-e8c8-447e-83fa-988d0fe911e9 None admin] PATH_INFO: `/v3/services` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:00.057240 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429ec97-e8c8-447e-83fa-988d0fe911e9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:20:00.057560 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429ec97-e8c8-447e-83fa-988d0fe911e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:00.058938 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429ec97-e8c8-447e-83fa-988d0fe911e9 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:00.069160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 519/1050] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:19:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:00.070315 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65334d45-b2cb-4c65-b053-680040c59424 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:00.173638 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65334d45-b2cb-4c65-b053-680040c59424 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:00.209879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220dbd80-8f03-4349-80f3-8e01a0d509e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:00.210543 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220dbd80-8f03-4349-80f3-8e01a0d509e7 None admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:00.210833 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220dbd80-8f03-4349-80f3-8e01a0d509e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:00.211117 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220dbd80-8f03-4349-80f3-8e01a0d509e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:00.211903 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220dbd80-8f03-4349-80f3-8e01a0d509e7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:00.213266 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220dbd80-8f03-4349-80f3-8e01a0d509e7 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:00.232395 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 532/1051] 10.222.0.44 () {60 vars in 1144 bytes} [Tue Jul 19 15:20:00 2022] POST /identity/v3/endpoints => generated 327 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:20:00.410231 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95faaf31-e791-4c7f-b31e-21f54a50333d None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:00.410522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95faaf31-e791-4c7f-b31e-21f54a50333d None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:00.410807 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95faaf31-e791-4c7f-b31e-21f54a50333d None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:00.412293 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 520/1052] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:20:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:20:00.417785 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce148b-0238-4587-9370-0baf3997bf07 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:00.418090 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce148b-0238-4587-9370-0baf3997bf07 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:00.418371 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce148b-0238-4587-9370-0baf3997bf07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:00.435695 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-b5ce148b-0238-4587-9370-0baf3997bf07 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:20:00.436884 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-b5ce148b-0238-4587-9370-0baf3997bf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:20:00.466976 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:00.517883 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 533/1053] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:20:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:20:00.540883 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95faaf31-e791-4c7f-b31e-21f54a50333d None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:00.638838 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e44d70-dff5-4dec-8a8f-4bf9f7de142c None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:00.639266 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e44d70-dff5-4dec-8a8f-4bf9f7de142c None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:00.639465 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e44d70-dff5-4dec-8a8f-4bf9f7de142c None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:00.640951 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 534/1054] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:20:00.645996 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844adadd-ea15-45c4-baa9-500e5d71bc2f None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:00.646289 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844adadd-ea15-45c4-baa9-500e5d71bc2f None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:00.646578 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844adadd-ea15-45c4-baa9-500e5d71bc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:00.651081 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95faaf31-e791-4c7f-b31e-21f54a50333d None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:00.664098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-844adadd-ea15-45c4-baa9-500e5d71bc2f None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:20:00.665224 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-844adadd-ea15-45c4-baa9-500e5d71bc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:20:00.691435 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a11085-109e-40b1-b509-c97bb91bfdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:00.692242 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a11085-109e-40b1-b509-c97bb91bfdcd None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:00.692520 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a11085-109e-40b1-b509-c97bb91bfdcd None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:00.692790 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a11085-109e-40b1-b509-c97bb91bfdcd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:00.704157 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a11085-109e-40b1-b509-c97bb91bfdcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:20:00.712182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-d9a11085-109e-40b1-b509-c97bb91bfdcd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 15:20:00.712182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:20:00.712182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:20:00.712182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:20:00.712182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:20:00.712182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:20:00.712182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:20:00.712182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:20:00.712182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:20:00.712182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:20:00.712182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:20:00.712182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:20:00.712182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:20:00.712182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:20:00.712182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:20:00.712182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:20:00.713358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:20:00.713358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:20:00.713358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:20:00.713358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:20:00.713358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:20:00.713358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:20:00.713358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:20:00.713358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:20:00.713358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:20:00.713358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:20:00.713358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:20:00.713358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:20:00.713358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:20:00.713358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:20:00.713358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:20:00.713358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:20:00.714306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:20:00.714306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:20:00.714306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:20:00.714306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:20:00.714306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:20:00.714306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:20:00.714306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:20:00.714306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:20:00.714306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:20:00.714306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:20:00.714306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 15:20:00.714306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:20:00.714306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 521/1055] 10.222.0.44 () {56 vars in 1120 bytes} [Tue Jul 19 15:20:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:20:00.719173 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a11085-109e-40b1-b509-c97bb91bfdcd None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:00.724349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:00.751691 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 535/1056] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:20:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:20:00.768220 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844adadd-ea15-45c4-baa9-500e5d71bc2f None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:00.826976 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a11085-109e-40b1-b509-c97bb91bfdcd None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:00.866350 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced771eb-0601-4037-bf57-62975cdc5e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:00.867014 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced771eb-0601-4037-bf57-62975cdc5e54 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:00.867323 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced771eb-0601-4037-bf57-62975cdc5e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:00.867597 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced771eb-0601-4037-bf57-62975cdc5e54 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:00.868345 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced771eb-0601-4037-bf57-62975cdc5e54 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:20:00.868649 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced771eb-0601-4037-bf57-62975cdc5e54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:00.870005 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced771eb-0601-4037-bf57-62975cdc5e54 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:00.872168 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:00.878967 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 522/1057] 10.222.0.44 () {56 vars in 1115 bytes} [Tue Jul 19 15:20:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:20:00.884460 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced771eb-0601-4037-bf57-62975cdc5e54 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:00.888468 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844adadd-ea15-45c4-baa9-500e5d71bc2f None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:00.926763 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9198c-0bc2-492b-925a-55e14b0cbc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:00.928032 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9198c-0bc2-492b-925a-55e14b0cbc73 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:00.929008 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9198c-0bc2-492b-925a-55e14b0cbc73 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:00.929122 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9198c-0bc2-492b-925a-55e14b0cbc73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:00.941432 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d9198c-0bc2-492b-925a-55e14b0cbc73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:20:00.949635 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-59d9198c-0bc2-492b-925a-55e14b0cbc73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:20:00.949635 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:20:00.949635 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:20:00.949635 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:20:00.949635 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:20:00.949635 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:20:00.949635 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:20:00.949635 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:20:00.949635 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:20:00.949635 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:20:00.949635 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:20:00.949635 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:20:00.949635 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:20:00.949635 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:20:00.949635 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:20:00.949635 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:20:00.950679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:20:00.950679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:20:00.950679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:20:00.950679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:20:00.950679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:20:00.950679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:20:00.950679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:20:00.950679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:20:00.950679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:20:00.950679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:20:00.950679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:20:00.950679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:20:00.950679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:20:00.950679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:20:00.950679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:20:00.950679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:20:00.952177 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:20:00.952177 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:20:00.952177 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:20:00.952177 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:20:00.952177 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:20:00.952177 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:20:00.952177 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:20:00.952177 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:20:00.952177 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:20:00.952177 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:20:00.952177 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:20:00.952177 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:20:00.952177 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 536/1058] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:20:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:20:00.957887 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9198c-0bc2-492b-925a-55e14b0cbc73 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:00.967475 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:01.012978 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced771eb-0601-4037-bf57-62975cdc5e54 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:01.049640 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec297836-141d-4edb-8d6b-0c3675453a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:01.050432 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec297836-141d-4edb-8d6b-0c3675453a53 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:01.050718 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec297836-141d-4edb-8d6b-0c3675453a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:01.050993 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec297836-141d-4edb-8d6b-0c3675453a53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:01.062426 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec297836-141d-4edb-8d6b-0c3675453a53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:01.071323 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec297836-141d-4edb-8d6b-0c3675453a53 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:01.074686 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9198c-0bc2-492b-925a-55e14b0cbc73 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:01.089803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-ec297836-141d-4edb-8d6b-0c3675453a53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:20:01.089803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:20:01.089803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:20:01.089803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:20:01.089803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:20:01.089803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:20:01.089803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:20:01.089803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:20:01.089803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:20:01.089803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:20:01.089803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:20:01.089803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:20:01.089803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:20:01.089803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:20:01.089803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:20:01.090739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:20:01.090739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:20:01.090739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:20:01.090739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:20:01.090739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:20:01.090739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:20:01.090739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:20:01.090739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:20:01.090739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:20:01.090739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:20:01.090739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:20:01.090739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:20:01.090739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:20:01.090739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:20:01.090739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:20:01.090739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:20:01.090739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:20:01.091687 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:20:01.091687 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:20:01.091687 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:20:01.091687 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:20:01.091687 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 523/1059] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:20:01.097599 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec297836-141d-4edb-8d6b-0c3675453a53 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:01.118100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a2768-53a2-4893-92fe-44bfe55837fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:01.118774 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a2768-53a2-4893-92fe-44bfe55837fb None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:01.119061 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a2768-53a2-4893-92fe-44bfe55837fb None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:01.119374 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a2768-53a2-4893-92fe-44bfe55837fb None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:01.120634 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a2768-53a2-4893-92fe-44bfe55837fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:20:01.120956 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a2768-53a2-4893-92fe-44bfe55837fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:01.122864 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a2768-53a2-4893-92fe-44bfe55837fb None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:01.134555 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 537/1060] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:20:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:20:01.139194 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a2768-53a2-4893-92fe-44bfe55837fb None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:01.154919 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:01.208150 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec297836-141d-4edb-8d6b-0c3675453a53 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:01.227603 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:01.247041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07622c15-8247-40d5-b01d-1ea7fd10e0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:01.247997 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07622c15-8247-40d5-b01d-1ea7fd10e0e5 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:01.248196 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a2768-53a2-4893-92fe-44bfe55837fb None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:01.248651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07622c15-8247-40d5-b01d-1ea7fd10e0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:01.248745 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07622c15-8247-40d5-b01d-1ea7fd10e0e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:01.249479 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07622c15-8247-40d5-b01d-1ea7fd10e0e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:20:01.249793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07622c15-8247-40d5-b01d-1ea7fd10e0e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:01.251175 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07622c15-8247-40d5-b01d-1ea7fd10e0e5 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:01.265216 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 524/1061] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:01.271306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07622c15-8247-40d5-b01d-1ea7fd10e0e5 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:01.303128 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e0c22-339e-45b3-8731-9c6522d2f9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:01.304449 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e0c22-339e-45b3-8731-9c6522d2f9fc None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:01.305006 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e0c22-339e-45b3-8731-9c6522d2f9fc None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:01.305289 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e0c22-339e-45b3-8731-9c6522d2f9fc None admin] PATH_INFO: `/v3/users/20a5a7280c774363a212a55239a1b6b6` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:01.319795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e0c22-339e-45b3-8731-9c6522d2f9fc None admin] RBAC: Authorizing `identity:get_user(user_id=20a5a7280c774363a212a55239a1b6b6)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:01.321372 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e0c22-339e-45b3-8731-9c6522d2f9fc None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:01.327904 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 538/1062] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:20:01 2022] GET /identity/v3/users/20a5a7280c774363a212a55239a1b6b6 => generated 285 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:01.328717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e0c22-339e-45b3-8731-9c6522d2f9fc None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:01.383538 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07622c15-8247-40d5-b01d-1ea7fd10e0e5 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:01.400102 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:01.428246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6535a94-685b-4788-b2e9-7f0e28f4fe8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:01.429140 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6535a94-685b-4788-b2e9-7f0e28f4fe8b None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:01.429513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6535a94-685b-4788-b2e9-7f0e28f4fe8b None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:01.429857 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6535a94-685b-4788-b2e9-7f0e28f4fe8b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:01.435975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e0c22-339e-45b3-8731-9c6522d2f9fc None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:01.437907 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6535a94-685b-4788-b2e9-7f0e28f4fe8b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:01.439496 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6535a94-685b-4788-b2e9-7f0e28f4fe8b None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:01.454238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-c6535a94-685b-4788-b2e9-7f0e28f4fe8b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:20:01.454238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:20:01.454238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:20:01.454238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:20:01.454238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:20:01.454238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:20:01.454238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:20:01.454238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:20:01.454238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:20:01.454238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:20:01.454238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:20:01.454238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:20:01.454238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:20:01.454238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:20:01.454238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:20:01.454238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:20:01.455837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:20:01.455837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:20:01.455837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:20:01.455837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:20:01.455837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:20:01.455837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:20:01.455837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:20:01.455837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:20:01.455837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:20:01.455837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:20:01.455837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:20:01.455837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:20:01.455837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:20:01.455837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:20:01.455837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:20:01.455837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:20:01.455837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:20:01.455837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:20:01.457253 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:20:01.457253 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:20:01.457253 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:20:01.457253 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:20:01.457253 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:20:01.457253 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:20:01.457253 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:20:01.457253 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:20:01.457253 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:20:01.457253 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:20:01.457253 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 525/1063] 10.222.0.44 () {56 vars in 1093 bytes} [Tue Jul 19 15:20:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:20:01.464689 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6535a94-685b-4788-b2e9-7f0e28f4fe8b None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:01.483605 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683ead5-612e-4707-ba40-a9bd156c4268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:01.484305 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683ead5-612e-4707-ba40-a9bd156c4268 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:01.484550 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683ead5-612e-4707-ba40-a9bd156c4268 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:01.484831 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683ead5-612e-4707-ba40-a9bd156c4268 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:01.512296 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:01.578856 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683ead5-612e-4707-ba40-a9bd156c4268 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:01.581198 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683ead5-612e-4707-ba40-a9bd156c4268 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:01.589232 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6535a94-685b-4788-b2e9-7f0e28f4fe8b None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:01.628318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80cf08f-100c-4bab-94cf-44940d0f71ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:01.628986 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cf08f-100c-4bab-94cf-44940d0f71ff None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:01.629267 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cf08f-100c-4bab-94cf-44940d0f71ff None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:01.629537 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cf08f-100c-4bab-94cf-44940d0f71ff None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:01.630362 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80cf08f-100c-4bab-94cf-44940d0f71ff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:20:01.630667 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80cf08f-100c-4bab-94cf-44940d0f71ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:01.632113 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80cf08f-100c-4bab-94cf-44940d0f71ff None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:01.651280 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 526/1064] 10.222.0.44 () {56 vars in 1133 bytes} [Tue Jul 19 15:20:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:20:01.656944 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80cf08f-100c-4bab-94cf-44940d0f71ff None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:01.658714 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:01.697142 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 539/1065] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:20:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:20:01.702542 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683ead5-612e-4707-ba40-a9bd156c4268 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:01.762665 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:01.768844 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80cf08f-100c-4bab-94cf-44940d0f71ff None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:01.809752 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459cca47-a65e-4c46-bb70-b534026003f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:01.810564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459cca47-a65e-4c46-bb70-b534026003f2 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:01.810851 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459cca47-a65e-4c46-bb70-b534026003f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:01.811127 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459cca47-a65e-4c46-bb70-b534026003f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:01.815920 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683ead5-612e-4707-ba40-a9bd156c4268 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:01.822571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459cca47-a65e-4c46-bb70-b534026003f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:01.824050 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459cca47-a65e-4c46-bb70-b534026003f2 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:01.842941 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-459cca47-a65e-4c46-bb70-b534026003f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:20:01.842941 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:20:01.842941 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:20:01.842941 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:20:01.842941 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:20:01.842941 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:20:01.842941 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:20:01.842941 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:20:01.842941 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:20:01.842941 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:20:01.842941 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:20:01.842941 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:20:01.842941 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:20:01.842941 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:20:01.842941 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:20:01.843972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:20:01.843972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:20:01.843972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:20:01.843972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:20:01.843972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:20:01.843972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:20:01.843972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:20:01.843972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:20:01.843972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:20:01.843972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:20:01.843972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:20:01.843972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:20:01.843972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:20:01.843972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:20:01.843972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:20:01.843972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:20:01.843972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:20:01.844861 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:20:01.844861 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:20:01.844861 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:20:01.844861 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:20:01.844861 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 527/1066] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:20:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:20:01.850255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459cca47-a65e-4c46-bb70-b534026003f2 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:01.859197 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd235c5-af47-4307-bfae-6f0ed27ca32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:01.860122 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd235c5-af47-4307-bfae-6f0ed27ca32b None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:01.860408 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd235c5-af47-4307-bfae-6f0ed27ca32b None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:01.860686 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd235c5-af47-4307-bfae-6f0ed27ca32b None admin] PATH_INFO: `/v3/projects/ec17c558f89a43a0842863c73663f583` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:01.866021 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd235c5-af47-4307-bfae-6f0ed27ca32b None admin] RBAC: Authorizing `identity:get_project(project_id=ec17c558f89a43a0842863c73663f583)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:01.867518 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd235c5-af47-4307-bfae-6f0ed27ca32b None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:01.874096 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 540/1067] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:20:01 2022] GET /identity/v3/projects/ec17c558f89a43a0842863c73663f583 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:20:01.875065 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd235c5-af47-4307-bfae-6f0ed27ca32b None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:01.922319 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:01.962251 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459cca47-a65e-4c46-bb70-b534026003f2 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:01.990289 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd235c5-af47-4307-bfae-6f0ed27ca32b None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:02.002734 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0727c-ebaa-4dc3-8f9c-448057cb665c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:02.003755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0727c-ebaa-4dc3-8f9c-448057cb665c None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:02.004354 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0727c-ebaa-4dc3-8f9c-448057cb665c None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:02.005203 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0727c-ebaa-4dc3-8f9c-448057cb665c None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:02.006391 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0727c-ebaa-4dc3-8f9c-448057cb665c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:20:02.006884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0727c-ebaa-4dc3-8f9c-448057cb665c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:02.008866 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0727c-ebaa-4dc3-8f9c-448057cb665c None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:02.024641 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 528/1068] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:20:02.024790 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fbd79-47e3-4fdd-8241-5d677aea70cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:02.025336 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fbd79-47e3-4fdd-8241-5d677aea70cd None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:02.025620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fbd79-47e3-4fdd-8241-5d677aea70cd None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:02.025894 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fbd79-47e3-4fdd-8241-5d677aea70cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:02.026721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514fbd79-47e3-4fdd-8241-5d677aea70cd None admin] RBAC: Adding query filter params (role.id=d884ddf33c1440d9b3a3351b85e83e76, scope.project.id=ec17c558f89a43a0842863c73663f583, user.id=20a5a7280c774363a212a55239a1b6b6) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:20:02.027033 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514fbd79-47e3-4fdd-8241-5d677aea70cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:02.028480 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514fbd79-47e3-4fdd-8241-5d677aea70cd None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:02.030118 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0727c-ebaa-4dc3-8f9c-448057cb665c None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:02.034350 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 541/1069] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:20:01 2022] GET /identity/v3/role_assignments?user.id=20a5a7280c774363a212a55239a1b6b6&scope.project.id=ec17c558f89a43a0842863c73663f583&role.id=d884ddf33c1440d9b3a3351b85e83e76 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:20:02.052560 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:02.151474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0727c-ebaa-4dc3-8f9c-448057cb665c None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:02.189828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd7396-c78e-452d-8d34-0b38862d7735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:02.190625 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd7396-c78e-452d-8d34-0b38862d7735 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:02.190903 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd7396-c78e-452d-8d34-0b38862d7735 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:02.191177 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd7396-c78e-452d-8d34-0b38862d7735 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:02.198625 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd7396-c78e-452d-8d34-0b38862d7735 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:02.200110 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd7396-c78e-452d-8d34-0b38862d7735 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:02.216153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-e1fd7396-c78e-452d-8d34-0b38862d7735 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:20:02.216153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:20:02.216153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:20:02.216153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:20:02.216153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:20:02.216153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:20:02.216153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:20:02.216153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:20:02.216153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:20:02.216153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:20:02.216153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:20:02.216153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:20:02.216153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:20:02.216153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:20:02.216153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:20:02.217201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:20:02.217201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:20:02.217201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:20:02.217201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:20:02.217201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:20:02.217201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:20:02.217201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:20:02.217201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:20:02.217201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:20:02.217201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:20:02.217201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:20:02.217201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:20:02.217201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:20:02.217201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:20:02.217201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:20:02.217201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:20:02.217201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:20:02.218482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:20:02.218482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:20:02.218482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:20:02.218482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:20:02.218482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:20:02.218482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:20:02.218482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:20:02.218482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:20:02.218482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 529/1070] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:20:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:20:02.223831 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fbd79-47e3-4fdd-8241-5d677aea70cd None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:02.321280 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d889b-bc10-4907-82db-28fe848a7dcd None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:02.321515 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d889b-bc10-4907-82db-28fe848a7dcd None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:02.321810 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d889b-bc10-4907-82db-28fe848a7dcd None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:02.323271 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 530/1071] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:20:02.330418 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fbd79-47e3-4fdd-8241-5d677aea70cd None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:02.330599 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37b5d7-6fbb-489b-a02d-f24d83c4876a None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:02.330599 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37b5d7-6fbb-489b-a02d-f24d83c4876a None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:02.330599 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37b5d7-6fbb-489b-a02d-f24d83c4876a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:02.330795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:02.347928 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-7b37b5d7-6fbb-489b-a02d-f24d83c4876a None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:20:02.349122 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-7b37b5d7-6fbb-489b-a02d-f24d83c4876a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:20:02.367200 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf778f-fa4c-4285-b0d4-0ff8fe9d6ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:02.367895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf778f-fa4c-4285-b0d4-0ff8fe9d6ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:02.368187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf778f-fa4c-4285-b0d4-0ff8fe9d6ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:02.368508 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf778f-fa4c-4285-b0d4-0ff8fe9d6ae1 None admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:02.369290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf778f-fa4c-4285-b0d4-0ff8fe9d6ae1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:20:02.369608 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf778f-fa4c-4285-b0d4-0ff8fe9d6ae1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:02.371031 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf778f-fa4c-4285-b0d4-0ff8fe9d6ae1 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:02.387381 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 542/1072] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:20:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:02.389737 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf778f-fa4c-4285-b0d4-0ff8fe9d6ae1 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:02.420766 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:02.427043 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 531/1073] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:20:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:20:02.449394 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37b5d7-6fbb-489b-a02d-f24d83c4876a None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:02.502498 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf778f-fa4c-4285-b0d4-0ff8fe9d6ae1 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:02.539146 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631d581-606c-4012-ae97-5bfaf149f59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:02.540044 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631d581-606c-4012-ae97-5bfaf149f59f None admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:02.540269 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631d581-606c-4012-ae97-5bfaf149f59f None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:02.541058 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631d581-606c-4012-ae97-5bfaf149f59f None admin] PATH_INFO: `/v3/projects/c54934775a86487295bdbc02ed3a0103/users/fef0511f56144ca9945b2dddfa2601a2/roles/acfcbbe4bd7247258d939ba45bb097b7` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:02.542827 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631d581-606c-4012-ae97-5bfaf149f59f None admin] RBAC: Authorizing `identity:create_grant(project_id=c54934775a86487295bdbc02ed3a0103, user_id=fef0511f56144ca9945b2dddfa2601a2, role_id=acfcbbe4bd7247258d939ba45bb097b7)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:02.544283 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631d581-606c-4012-ae97-5bfaf149f59f None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:02.559631 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 543/1074] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 19 15:20:02 2022] PUT /identity/v3/projects/c54934775a86487295bdbc02ed3a0103/users/fef0511f56144ca9945b2dddfa2601a2/roles/acfcbbe4bd7247258d939ba45bb097b7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:20:02.574989 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37b5d7-6fbb-489b-a02d-f24d83c4876a None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:02.614665 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067093b0-2bc4-4e68-b7bf-28001904e035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:02.615392 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067093b0-2bc4-4e68-b7bf-28001904e035 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:02.615660 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067093b0-2bc4-4e68-b7bf-28001904e035 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:02.615917 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067093b0-2bc4-4e68-b7bf-28001904e035 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:02.687264 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:02.692496 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067093b0-2bc4-4e68-b7bf-28001904e035 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:02.693991 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067093b0-2bc4-4e68-b7bf-28001904e035 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:02.797976 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 532/1075] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:20:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 15:20:02.803958 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631d581-606c-4012-ae97-5bfaf149f59f None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:02.829157 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:02.913810 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631d581-606c-4012-ae97-5bfaf149f59f None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:02.951834 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e06d62-ec42-4803-8341-771c94cb3f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:02.952630 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e06d62-ec42-4803-8341-771c94cb3f03 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:02.952912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e06d62-ec42-4803-8341-771c94cb3f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:02.953263 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e06d62-ec42-4803-8341-771c94cb3f03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:02.964478 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e06d62-ec42-4803-8341-771c94cb3f03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:02.966026 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e06d62-ec42-4803-8341-771c94cb3f03 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:02.983450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-59e06d62-ec42-4803-8341-771c94cb3f03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:20:02.983450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:20:02.983450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:20:02.983450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:20:02.983450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:20:02.983450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:20:02.983450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:20:02.983450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:20:02.983450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:20:02.983450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:20:02.983450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:20:02.983450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:20:02.983450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:20:02.983450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:20:02.983450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:20:02.984405 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:20:02.984405 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:20:02.984405 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:20:02.984405 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:20:02.984405 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:20:02.984405 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:20:02.984405 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:20:02.984405 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:20:02.984405 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:20:02.984405 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:20:02.984405 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:20:02.984405 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:20:02.984405 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:20:02.984405 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:20:02.984405 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:20:02.984405 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:20:02.984405 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:20:02.985367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:20:02.985367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:20:02.985367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:20:02.985367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:20:02.987299 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 544/1076] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:20:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:20:02.990607 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067093b0-2bc4-4e68-b7bf-28001904e035 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:03.088400 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:03.092922 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067093b0-2bc4-4e68-b7bf-28001904e035 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:03.128236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f803519-effb-4fc0-9681-e737eda767d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:03.128901 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f803519-effb-4fc0-9681-e737eda767d8 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:03.129182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f803519-effb-4fc0-9681-e737eda767d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:03.129459 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f803519-effb-4fc0-9681-e737eda767d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:03.130182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f803519-effb-4fc0-9681-e737eda767d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:20:03.130499 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f803519-effb-4fc0-9681-e737eda767d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:03.131872 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f803519-effb-4fc0-9681-e737eda767d8 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:03.143461 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 533/1077] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:04.109734 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374638c-2467-4ba4-9688-f6ba6654e69e None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:04.110239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374638c-2467-4ba4-9688-f6ba6654e69e None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:04.110239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374638c-2467-4ba4-9688-f6ba6654e69e None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:04.111676 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 545/1078] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:20:04.117050 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c29cb-7159-4e32-b2e0-f3abc4c42502 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:04.117475 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c29cb-7159-4e32-b2e0-f3abc4c42502 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:04.117618 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c29cb-7159-4e32-b2e0-f3abc4c42502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:04.134673 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-922c29cb-7159-4e32-b2e0-f3abc4c42502 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:20:04.135890 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-922c29cb-7159-4e32-b2e0-f3abc4c42502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:20:04.201957 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 534/1079] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:20:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:20:04.224527 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374638c-2467-4ba4-9688-f6ba6654e69e None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:04.300521 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:04.328191 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374638c-2467-4ba4-9688-f6ba6654e69e None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:04.361804 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d008c07-b398-4829-a597-c2072341b7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:04.362507 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d008c07-b398-4829-a597-c2072341b7ce None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:04.362794 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d008c07-b398-4829-a597-c2072341b7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:04.363071 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d008c07-b398-4829-a597-c2072341b7ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:04.373117 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d008c07-b398-4829-a597-c2072341b7ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:20:04.380857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-2d008c07-b398-4829-a597-c2072341b7ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:20:04.380857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:20:04.380857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:20:04.380857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:20:04.380857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:20:04.380857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:20:04.380857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:20:04.380857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:20:04.380857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:20:04.380857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:20:04.380857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:20:04.380857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:20:04.380857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:20:04.380857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:20:04.380857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:20:04.380857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:20:04.381803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:20:04.381803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:20:04.381803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:20:04.381803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:20:04.381803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:20:04.381803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:20:04.381803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:20:04.381803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:20:04.381803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:20:04.381803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:20:04.381803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:20:04.381803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:20:04.381803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:20:04.381803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:20:04.381803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:20:04.381803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:20:04.382638 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:20:04.382638 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:20:04.382638 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:20:04.382638 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:20:04.382638 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:20:04.382638 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:20:04.382638 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:20:04.382638 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:20:04.382638 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:20:04.382638 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:20:04.382638 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:20:04.382638 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:20:04.382638 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 546/1080] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:20:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:20:04.388058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c29cb-7159-4e32-b2e0-f3abc4c42502 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:04.475304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:04.487499 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c29cb-7159-4e32-b2e0-f3abc4c42502 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:04.520551 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077ebb6-eb13-4d64-ad74-f727557337d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:04.521219 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077ebb6-eb13-4d64-ad74-f727557337d5 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:04.521505 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077ebb6-eb13-4d64-ad74-f727557337d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:04.521783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077ebb6-eb13-4d64-ad74-f727557337d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:04.522526 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077ebb6-eb13-4d64-ad74-f727557337d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:20:04.522835 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077ebb6-eb13-4d64-ad74-f727557337d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:04.524219 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077ebb6-eb13-4d64-ad74-f727557337d5 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:04.532617 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 535/1081] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:20:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:04.538365 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d008c07-b398-4829-a597-c2072341b7ce None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:04.624423 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875b578-5677-4a7e-85e1-158c44bd1767 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:04.624633 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875b578-5677-4a7e-85e1-158c44bd1767 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:04.624922 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875b578-5677-4a7e-85e1-158c44bd1767 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:04.626292 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 536/1082] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:20:04.631341 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21450424-40a2-44e5-aa3b-ae1381f586dc None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:04.631638 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21450424-40a2-44e5-aa3b-ae1381f586dc None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:04.631919 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21450424-40a2-44e5-aa3b-ae1381f586dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:04.637508 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d008c07-b398-4829-a597-c2072341b7ce None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:04.649068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-21450424-40a2-44e5-aa3b-ae1381f586dc None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:20:04.650265 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-21450424-40a2-44e5-aa3b-ae1381f586dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:20:04.671466 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16518f7-2eff-407b-9e96-43eb1997d257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:04.672343 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16518f7-2eff-407b-9e96-43eb1997d257 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:04.672634 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16518f7-2eff-407b-9e96-43eb1997d257 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:04.672919 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16518f7-2eff-407b-9e96-43eb1997d257 None admin] PATH_INFO: `/v3/users/20a5a7280c774363a212a55239a1b6b6` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:04.674645 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16518f7-2eff-407b-9e96-43eb1997d257 None admin] RBAC: Authorizing `identity:get_user(user_id=20a5a7280c774363a212a55239a1b6b6)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:04.676098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16518f7-2eff-407b-9e96-43eb1997d257 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:04.677754 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 547/1083] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:20:04 2022] GET /identity/v3/users/20a5a7280c774363a212a55239a1b6b6 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:04.683524 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16518f7-2eff-407b-9e96-43eb1997d257 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:04.686121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:04.717585 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 537/1084] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:20:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:20:04.741550 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21450424-40a2-44e5-aa3b-ae1381f586dc None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:04.789787 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16518f7-2eff-407b-9e96-43eb1997d257 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:04.821534 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:04.823061 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45584295-fd44-4cf7-9b85-2691354eb806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:04.824025 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45584295-fd44-4cf7-9b85-2691354eb806 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:04.824315 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45584295-fd44-4cf7-9b85-2691354eb806 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:04.824589 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45584295-fd44-4cf7-9b85-2691354eb806 None admin] PATH_INFO: `/v3/projects/ec17c558f89a43a0842863c73663f583` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:04.825781 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45584295-fd44-4cf7-9b85-2691354eb806 None admin] RBAC: Authorizing `identity:get_project(project_id=ec17c558f89a43a0842863c73663f583)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:04.827193 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45584295-fd44-4cf7-9b85-2691354eb806 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:04.828916 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 548/1085] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:20:04 2022] GET /identity/v3/projects/ec17c558f89a43a0842863c73663f583 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:20:04.834681 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45584295-fd44-4cf7-9b85-2691354eb806 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:04.844247 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21450424-40a2-44e5-aa3b-ae1381f586dc None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:04.879399 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8f89d-3833-4968-ada2-aa2d15b01f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:04.880125 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8f89d-3833-4968-ada2-aa2d15b01f31 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:04.880407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8f89d-3833-4968-ada2-aa2d15b01f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:04.880685 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8f89d-3833-4968-ada2-aa2d15b01f31 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:04.890522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f8f89d-3833-4968-ada2-aa2d15b01f31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:20:04.898674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-45f8f89d-3833-4968-ada2-aa2d15b01f31 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 15:20:04.898674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:20:04.898674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:20:04.898674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:20:04.898674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:20:04.898674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:20:04.898674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:20:04.898674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:20:04.898674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:20:04.898674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:20:04.898674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:20:04.898674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:20:04.898674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:20:04.898674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:20:04.898674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:20:04.898674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:20:04.899713 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:20:04.899713 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:20:04.899713 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:20:04.899713 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:20:04.899713 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:20:04.899713 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:20:04.899713 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:20:04.899713 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:20:04.899713 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:20:04.899713 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:20:04.899713 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:20:04.899713 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:20:04.899713 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:20:04.899713 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:20:04.899713 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:20:04.899713 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:20:04.900795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:20:04.900795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:20:04.900795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:20:04.900795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:20:04.900795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:20:04.900795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:20:04.900795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:20:04.900795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:20:04.900795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:20:04.900795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:20:04.900795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 15:20:04.900795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:20:04.900795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 538/1086] 10.222.0.44 () {56 vars in 1120 bytes} [Tue Jul 19 15:20:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:20:04.906206 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8f89d-3833-4968-ada2-aa2d15b01f31 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:04.909849 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:04.944402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45584295-fd44-4cf7-9b85-2691354eb806 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:04.978185 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a8f90-215c-4ef5-b3e9-d084c82cb447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:04.979073 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a8f90-215c-4ef5-b3e9-d084c82cb447 None admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:04.979384 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a8f90-215c-4ef5-b3e9-d084c82cb447 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:04.979663 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a8f90-215c-4ef5-b3e9-d084c82cb447 None admin] PATH_INFO: `/v3/projects/ec17c558f89a43a0842863c73663f583/users/20a5a7280c774363a212a55239a1b6b6/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:04.981987 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a8f90-215c-4ef5-b3e9-d084c82cb447 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec17c558f89a43a0842863c73663f583, user_id=20a5a7280c774363a212a55239a1b6b6, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:04.983049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a8f90-215c-4ef5-b3e9-d084c82cb447 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:04.996640 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 549/1087] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 19 15:20:04 2022] PUT /identity/v3/projects/ec17c558f89a43a0842863c73663f583/users/20a5a7280c774363a212a55239a1b6b6/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:20:05.007368 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8f89d-3833-4968-ada2-aa2d15b01f31 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:05.044647 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119671c-b2bd-49e0-985e-2c5236d05b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:05.045337 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119671c-b2bd-49e0-985e-2c5236d05b43 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:05.045622 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119671c-b2bd-49e0-985e-2c5236d05b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:05.045900 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119671c-b2bd-49e0-985e-2c5236d05b43 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:05.046674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119671c-b2bd-49e0-985e-2c5236d05b43 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:20:05.046991 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119671c-b2bd-49e0-985e-2c5236d05b43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:05.048496 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119671c-b2bd-49e0-985e-2c5236d05b43 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:05.058489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 539/1088] 10.222.0.44 () {56 vars in 1115 bytes} [Tue Jul 19 15:20:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:20:05.064580 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a8f90-215c-4ef5-b3e9-d084c82cb447 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:05.170607 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a8f90-215c-4ef5-b3e9-d084c82cb447 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:05.197697 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:05.204385 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d635d84-7a79-41cd-862c-44516e5224f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:05.205876 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d635d84-7a79-41cd-862c-44516e5224f4 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:05.206303 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d635d84-7a79-41cd-862c-44516e5224f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:05.206801 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d635d84-7a79-41cd-862c-44516e5224f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:05.217318 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d635d84-7a79-41cd-862c-44516e5224f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:05.218741 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d635d84-7a79-41cd-862c-44516e5224f4 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:05.236274 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-2d635d84-7a79-41cd-862c-44516e5224f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:20:05.236274 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:20:05.236274 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:20:05.236274 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:20:05.236274 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:20:05.236274 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:20:05.236274 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:20:05.236274 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:20:05.236274 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:20:05.236274 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:20:05.236274 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:20:05.236274 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:20:05.236274 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:20:05.236274 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:20:05.236274 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:20:05.237352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:20:05.237352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:20:05.237352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:20:05.237352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:20:05.237352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:20:05.237352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:20:05.237352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:20:05.237352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:20:05.237352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:20:05.237352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:20:05.237352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:20:05.237352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:20:05.237352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:20:05.237352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:20:05.237352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:20:05.237352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:20:05.237352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:20:05.238256 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:20:05.238256 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:20:05.238256 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:20:05.238256 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:20:05.238256 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 550/1089] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:20:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:20:05.243337 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119671c-b2bd-49e0-985e-2c5236d05b43 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:05.246228 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:05.343109 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119671c-b2bd-49e0-985e-2c5236d05b43 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:05.376692 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05370575-4537-4b3c-aa91-32668a73c7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:05.377358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05370575-4537-4b3c-aa91-32668a73c7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:05.377641 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05370575-4537-4b3c-aa91-32668a73c7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:05.377916 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05370575-4537-4b3c-aa91-32668a73c7c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:05.378637 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05370575-4537-4b3c-aa91-32668a73c7c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:20:05.378944 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05370575-4537-4b3c-aa91-32668a73c7c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:05.380344 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05370575-4537-4b3c-aa91-32668a73c7c1 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:05.394035 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 540/1090] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:05.399914 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d635d84-7a79-41cd-862c-44516e5224f4 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:05.499967 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d635d84-7a79-41cd-862c-44516e5224f4 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:05.532700 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8edc1-d044-4881-8207-93856746f9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:05.534046 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8edc1-d044-4881-8207-93856746f9b6 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:05.534330 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8edc1-d044-4881-8207-93856746f9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:05.534608 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8edc1-d044-4881-8207-93856746f9b6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:05.542362 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8edc1-d044-4881-8207-93856746f9b6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:05.543807 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8edc1-d044-4881-8207-93856746f9b6 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:05.558245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-1ff8edc1-d044-4881-8207-93856746f9b6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:20:05.558245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:20:05.558245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:20:05.558245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:20:05.558245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:20:05.558245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:20:05.558245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:20:05.558245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:20:05.558245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:20:05.558245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:20:05.558245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:20:05.558245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:20:05.558245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:20:05.558245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:20:05.558245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:20:05.558245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:20:05.559523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:20:05.559523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:20:05.559523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:20:05.559523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:20:05.559523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:20:05.559523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:20:05.559523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:20:05.559523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:20:05.559523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:20:05.559523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:20:05.559523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:20:05.559523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:20:05.559523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:20:05.559523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:20:05.559523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:20:05.559523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:20:05.559523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:20:05.559523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:20:05.560645 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:20:05.560645 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:20:05.560645 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:20:05.560645 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:20:05.560645 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:20:05.560645 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:20:05.560645 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:20:05.560645 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:20:05.560645 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 15:20:05.560645 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:20:05.560645 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 551/1091] 10.222.0.44 () {56 vars in 1093 bytes} [Tue Jul 19 15:20:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:20:05.565708 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05370575-4537-4b3c-aa91-32668a73c7c1 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:05.625120 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:05.663708 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05370575-4537-4b3c-aa91-32668a73c7c1 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:05.698211 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453137d-3fd8-497b-b9ad-bb290dc41a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:05.698877 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453137d-3fd8-497b-b9ad-bb290dc41a3d None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:05.699164 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453137d-3fd8-497b-b9ad-bb290dc41a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:05.699464 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453137d-3fd8-497b-b9ad-bb290dc41a3d None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:05.700309 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453137d-3fd8-497b-b9ad-bb290dc41a3d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:20:05.700614 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453137d-3fd8-497b-b9ad-bb290dc41a3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:05.702026 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453137d-3fd8-497b-b9ad-bb290dc41a3d None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:05.719296 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 541/1092] 10.222.0.44 () {56 vars in 1133 bytes} [Tue Jul 19 15:20:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:05.725520 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8edc1-d044-4881-8207-93856746f9b6 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:05.770145 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:05.827755 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8edc1-d044-4881-8207-93856746f9b6 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:05.865180 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b071b2d-1ad0-4413-b469-1663cef996d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:05.865827 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b071b2d-1ad0-4413-b469-1663cef996d2 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:05.866114 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b071b2d-1ad0-4413-b469-1663cef996d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:05.866393 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b071b2d-1ad0-4413-b469-1663cef996d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:05.932522 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b071b2d-1ad0-4413-b469-1663cef996d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:05.933974 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b071b2d-1ad0-4413-b469-1663cef996d2 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:05.976001 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:06.037908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 552/1093] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:20:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:20:06.039470 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453137d-3fd8-497b-b9ad-bb290dc41a3d None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:06.138220 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453137d-3fd8-497b-b9ad-bb290dc41a3d None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:06.159023 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:06.173099 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e4f00-dc44-453f-9bfe-30206969d16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:06.173937 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e4f00-dc44-453f-9bfe-30206969d16f None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:06.174217 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e4f00-dc44-453f-9bfe-30206969d16f None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:06.174488 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e4f00-dc44-453f-9bfe-30206969d16f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:06.184470 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e4f00-dc44-453f-9bfe-30206969d16f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:06.185907 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e4f00-dc44-453f-9bfe-30206969d16f None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:06.202836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-367e4f00-dc44-453f-9bfe-30206969d16f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:20:06.202836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:20:06.202836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:20:06.202836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:20:06.202836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:20:06.202836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:20:06.202836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:20:06.202836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:20:06.202836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:20:06.202836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:20:06.202836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:20:06.202836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:20:06.202836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:20:06.202836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:20:06.202836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:20:06.203757 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:20:06.203757 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:20:06.203757 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:20:06.203757 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:20:06.203757 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:20:06.203757 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:20:06.203757 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:20:06.203757 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:20:06.203757 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:20:06.203757 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:20:06.203757 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:20:06.203757 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:20:06.203757 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:20:06.203757 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:20:06.203757 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:20:06.203757 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:20:06.203757 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:20:06.205163 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:20:06.205163 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:20:06.205163 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:20:06.205163 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:20:06.207380 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 542/1094] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:20:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:20:06.210350 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b071b2d-1ad0-4413-b469-1663cef996d2 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:06.311178 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b071b2d-1ad0-4413-b469-1663cef996d2 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:06.349761 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1629e00-3c2c-4b33-9d8f-e284612218ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:06.350490 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1629e00-3c2c-4b33-9d8f-e284612218ef None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:06.350918 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1629e00-3c2c-4b33-9d8f-e284612218ef None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:06.351376 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1629e00-3c2c-4b33-9d8f-e284612218ef None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:06.352117 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1629e00-3c2c-4b33-9d8f-e284612218ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:20:06.352430 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1629e00-3c2c-4b33-9d8f-e284612218ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:06.354089 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1629e00-3c2c-4b33-9d8f-e284612218ef None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:06.365448 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 553/1095] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:06.371181 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e4f00-dc44-453f-9bfe-30206969d16f None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:06.473055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e4f00-dc44-453f-9bfe-30206969d16f None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:06.506441 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea66b7-4240-4b70-8517-e96bc64b7360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:06.507244 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea66b7-4240-4b70-8517-e96bc64b7360 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:06.507545 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea66b7-4240-4b70-8517-e96bc64b7360 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:06.507827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea66b7-4240-4b70-8517-e96bc64b7360 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:06.514694 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea66b7-4240-4b70-8517-e96bc64b7360 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:06.516155 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea66b7-4240-4b70-8517-e96bc64b7360 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:06.530523 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-27ea66b7-4240-4b70-8517-e96bc64b7360 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:20:06.530523 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:20:06.530523 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:20:06.530523 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:20:06.530523 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:20:06.530523 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:20:06.530523 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:20:06.530523 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:20:06.530523 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:20:06.530523 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:20:06.530523 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:20:06.530523 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:20:06.530523 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:20:06.530523 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:20:06.530523 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:20:06.531572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:20:06.531572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:20:06.531572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:20:06.531572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:20:06.531572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:20:06.531572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:20:06.531572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:20:06.531572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:20:06.531572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:20:06.531572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:20:06.531572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:20:06.531572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:20:06.531572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:20:06.531572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:20:06.531572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:20:06.531572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:20:06.531572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:20:06.532887 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:20:06.532887 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:20:06.532887 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:20:06.532887 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:20:06.532887 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:20:06.532887 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:20:06.532887 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:20:06.532887 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:20:06.532887 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 543/1096] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:20:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:20:06.537627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1629e00-3c2c-4b33-9d8f-e284612218ef None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:06.540494 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:06.638078 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1629e00-3c2c-4b33-9d8f-e284612218ef None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:06.677630 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad12e2-9d6f-4fc9-b0da-bd27070d83de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:06.678599 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad12e2-9d6f-4fc9-b0da-bd27070d83de None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:06.678887 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad12e2-9d6f-4fc9-b0da-bd27070d83de None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:06.679159 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad12e2-9d6f-4fc9-b0da-bd27070d83de None admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:06.679998 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad12e2-9d6f-4fc9-b0da-bd27070d83de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:20:06.680306 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad12e2-9d6f-4fc9-b0da-bd27070d83de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:06.682175 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad12e2-9d6f-4fc9-b0da-bd27070d83de None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:06.695517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 554/1097] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:20:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:06.701528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea66b7-4240-4b70-8517-e96bc64b7360 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:06.745156 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:06.822844 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea66b7-4240-4b70-8517-e96bc64b7360 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:06.866575 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001d3b1-7f8e-4fff-868f-a5ab5927949c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:06.867588 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001d3b1-7f8e-4fff-868f-a5ab5927949c None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:06.868019 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001d3b1-7f8e-4fff-868f-a5ab5927949c None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:06.868431 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001d3b1-7f8e-4fff-868f-a5ab5927949c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:06.869785 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001d3b1-7f8e-4fff-868f-a5ab5927949c None admin] RBAC: Adding query filter params (role.id=acfcbbe4bd7247258d939ba45bb097b7, scope.project.id=c54934775a86487295bdbc02ed3a0103, user.id=fef0511f56144ca9945b2dddfa2601a2) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:20:06.870268 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001d3b1-7f8e-4fff-868f-a5ab5927949c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:06.872532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001d3b1-7f8e-4fff-868f-a5ab5927949c None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:06.880358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 544/1098] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:20:06 2022] GET /identity/v3/role_assignments?user.id=fef0511f56144ca9945b2dddfa2601a2&scope.project.id=c54934775a86487295bdbc02ed3a0103&role.id=acfcbbe4bd7247258d939ba45bb097b7 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:07.060827 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc336430-0a75-4b29-b72b-80f34d406252 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:07.061050 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc336430-0a75-4b29-b72b-80f34d406252 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:07.061339 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc336430-0a75-4b29-b72b-80f34d406252 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:07.062737 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 555/1099] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:20:07.068276 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5794f-19de-4732-822d-e89b5da92079 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:07.068585 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5794f-19de-4732-822d-e89b5da92079 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:07.068876 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5794f-19de-4732-822d-e89b5da92079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:07.085919 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-dec5794f-19de-4732-822d-e89b5da92079 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:20:07.087124 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-dec5794f-19de-4732-822d-e89b5da92079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:20:07.156705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 545/1100] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:20:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:20:07.180632 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc336430-0a75-4b29-b72b-80f34d406252 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:07.251355 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:07.292323 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc336430-0a75-4b29-b72b-80f34d406252 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:07.327612 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14b739-a74c-4fd7-9f1c-a017b45725fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:07.328328 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14b739-a74c-4fd7-9f1c-a017b45725fd None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:07.328611 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14b739-a74c-4fd7-9f1c-a017b45725fd None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:07.328893 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14b739-a74c-4fd7-9f1c-a017b45725fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:07.339661 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae14b739-a74c-4fd7-9f1c-a017b45725fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:20:07.347864 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-ae14b739-a74c-4fd7-9f1c-a017b45725fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:20:07.347864 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:20:07.347864 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:20:07.347864 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:20:07.347864 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:20:07.347864 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:20:07.347864 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:20:07.347864 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:20:07.347864 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:20:07.347864 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:20:07.347864 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:20:07.347864 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:20:07.347864 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:20:07.347864 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:20:07.347864 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:20:07.347864 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:20:07.349664 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:20:07.349664 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:20:07.349664 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:20:07.349664 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:20:07.349664 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:20:07.349664 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:20:07.349664 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:20:07.349664 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:20:07.349664 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:20:07.349664 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:20:07.349664 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:20:07.349664 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:20:07.349664 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:20:07.349664 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:20:07.349664 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:20:07.349664 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:20:07.350809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:20:07.350809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:20:07.350809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:20:07.350809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:20:07.350809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:20:07.350809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:20:07.350809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:20:07.350809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:20:07.350809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:20:07.350809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:20:07.350809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:20:07.350809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:20:07.350809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 556/1101] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:20:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:20:07.355154 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5794f-19de-4732-822d-e89b5da92079 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:07.385132 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:07.462408 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5794f-19de-4732-822d-e89b5da92079 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:07.498422 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3e6ca-b95e-44b6-8a37-8c5ed3682fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:07.499091 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3e6ca-b95e-44b6-8a37-8c5ed3682fdc None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:07.499460 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3e6ca-b95e-44b6-8a37-8c5ed3682fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:07.499740 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3e6ca-b95e-44b6-8a37-8c5ed3682fdc None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:07.500493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3e6ca-b95e-44b6-8a37-8c5ed3682fdc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:20:07.500799 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3e6ca-b95e-44b6-8a37-8c5ed3682fdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:07.502793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3e6ca-b95e-44b6-8a37-8c5ed3682fdc None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:07.511075 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 546/1102] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:20:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:07.516997 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14b739-a74c-4fd7-9f1c-a017b45725fd None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:07.623885 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14b739-a74c-4fd7-9f1c-a017b45725fd None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:07.649340 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:07.662332 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf7d15-ae35-45b2-ad9d-943aa265bbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:07.663206 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf7d15-ae35-45b2-ad9d-943aa265bbc6 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:07.663517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf7d15-ae35-45b2-ad9d-943aa265bbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:07.663795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf7d15-ae35-45b2-ad9d-943aa265bbc6 None admin] PATH_INFO: `/v3/users/20a5a7280c774363a212a55239a1b6b6` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:07.664990 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf7d15-ae35-45b2-ad9d-943aa265bbc6 None admin] RBAC: Authorizing `identity:get_user(user_id=20a5a7280c774363a212a55239a1b6b6)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:07.666409 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf7d15-ae35-45b2-ad9d-943aa265bbc6 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:07.668069 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 557/1103] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:20:07 2022] GET /identity/v3/users/20a5a7280c774363a212a55239a1b6b6 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:07.673848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3e6ca-b95e-44b6-8a37-8c5ed3682fdc None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:07.768764 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:07.781152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3e6ca-b95e-44b6-8a37-8c5ed3682fdc None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:07.813132 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32e801-71d1-46e1-90f7-85ffd7d15229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:07.813800 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32e801-71d1-46e1-90f7-85ffd7d15229 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:07.814586 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32e801-71d1-46e1-90f7-85ffd7d15229 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:07.814863 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32e801-71d1-46e1-90f7-85ffd7d15229 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:07.883029 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d32e801-71d1-46e1-90f7-85ffd7d15229 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:07.884447 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d32e801-71d1-46e1-90f7-85ffd7d15229 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:07.970100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:07.982843 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 547/1104] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:20:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:20:07.988738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf7d15-ae35-45b2-ad9d-943aa265bbc6 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:08.087149 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf7d15-ae35-45b2-ad9d-943aa265bbc6 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:08.120482 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474aa2a-86f4-444f-a660-4deab8966aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:08.121330 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474aa2a-86f4-444f-a660-4deab8966aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:08.121621 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474aa2a-86f4-444f-a660-4deab8966aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:08.121897 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474aa2a-86f4-444f-a660-4deab8966aa1 None admin] PATH_INFO: `/v3/projects/ec17c558f89a43a0842863c73663f583` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:08.123078 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474aa2a-86f4-444f-a660-4deab8966aa1 None admin] RBAC: Authorizing `identity:get_project(project_id=ec17c558f89a43a0842863c73663f583)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:08.124544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474aa2a-86f4-444f-a660-4deab8966aa1 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:08.126264 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 558/1105] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:20:07 2022] GET /identity/v3/projects/ec17c558f89a43a0842863c73663f583 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:08.132467 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32e801-71d1-46e1-90f7-85ffd7d15229 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:08.230663 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32e801-71d1-46e1-90f7-85ffd7d15229 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:08.264398 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ada0e4-0eb3-410d-932b-6faf06718153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:08.265044 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ada0e4-0eb3-410d-932b-6faf06718153 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:08.265334 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ada0e4-0eb3-410d-932b-6faf06718153 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:08.265608 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ada0e4-0eb3-410d-932b-6faf06718153 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:08.266437 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ada0e4-0eb3-410d-932b-6faf06718153 None admin] RBAC: Adding query filter params (role.id=d884ddf33c1440d9b3a3351b85e83e76, scope.project.id=ec17c558f89a43a0842863c73663f583, user.id=20a5a7280c774363a212a55239a1b6b6) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:20:08.266751 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ada0e4-0eb3-410d-932b-6faf06718153 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:08.268699 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ada0e4-0eb3-410d-932b-6faf06718153 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:08.274621 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 548/1106] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:20:08 2022] GET /identity/v3/role_assignments?user.id=20a5a7280c774363a212a55239a1b6b6&scope.project.id=ec17c558f89a43a0842863c73663f583&role.id=d884ddf33c1440d9b3a3351b85e83e76 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:10.319456 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d5001-2c01-4b18-94a0-eea67595699c None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:10.321467 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d5001-2c01-4b18-94a0-eea67595699c None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:10.321467 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d5001-2c01-4b18-94a0-eea67595699c None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:10.321467 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 559/1107] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:20:10.326433 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a645d6-6350-41d6-9501-f3310c356285 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:10.326858 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a645d6-6350-41d6-9501-f3310c356285 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:10.327007 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a645d6-6350-41d6-9501-f3310c356285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:10.344109 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-49a645d6-6350-41d6-9501-f3310c356285 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:20:10.345863 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-49a645d6-6350-41d6-9501-f3310c356285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:20:10.391227 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:10.412182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 549/1108] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:20:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:20:10.436210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d5001-2c01-4b18-94a0-eea67595699c None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:10.496434 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:10.542244 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d5001-2c01-4b18-94a0-eea67595699c None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:10.575081 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776c068-c69b-4296-9deb-1fec9af3e632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:10.575826 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776c068-c69b-4296-9deb-1fec9af3e632 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:10.576115 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776c068-c69b-4296-9deb-1fec9af3e632 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:10.576395 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776c068-c69b-4296-9deb-1fec9af3e632 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:10.577570 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776c068-c69b-4296-9deb-1fec9af3e632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:10.578989 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776c068-c69b-4296-9deb-1fec9af3e632 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:10.581174 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 560/1109] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:20:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:10.586909 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a645d6-6350-41d6-9501-f3310c356285 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:10.682446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a645d6-6350-41d6-9501-f3310c356285 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:10.715298 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececca52-5278-42c3-ae2f-391cf2e2e01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:10.715956 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececca52-5278-42c3-ae2f-391cf2e2e01e None admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:10.716245 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececca52-5278-42c3-ae2f-391cf2e2e01e None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:10.716525 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececca52-5278-42c3-ae2f-391cf2e2e01e None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:10.717250 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ececca52-5278-42c3-ae2f-391cf2e2e01e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:10.718670 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ececca52-5278-42c3-ae2f-391cf2e2e01e None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:10.738581 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 550/1110] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jul 19 15:20:10 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:20:12.813059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a3391-b596-41ae-81e6-23a4d79aede0 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:12.813624 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a3391-b596-41ae-81e6-23a4d79aede0 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:12.813624 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a3391-b596-41ae-81e6-23a4d79aede0 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:12.815001 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 561/1111] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:20:12.820584 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609bfeb-f048-444a-994c-47c344a2218e None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:12.821043 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609bfeb-f048-444a-994c-47c344a2218e None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:12.821164 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609bfeb-f048-444a-994c-47c344a2218e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:12.839549 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-3609bfeb-f048-444a-994c-47c344a2218e None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:20:12.840767 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-3609bfeb-f048-444a-994c-47c344a2218e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:20:12.873881 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:12.913770 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 551/1112] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:20:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:20:12.937269 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a3391-b596-41ae-81e6-23a4d79aede0 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:13.051304 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a3391-b596-41ae-81e6-23a4d79aede0 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:13.077128 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:13.086607 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0161c-989d-4530-8340-2bd152dd48d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:13.087508 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0161c-989d-4530-8340-2bd152dd48d2 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:13.087799 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0161c-989d-4530-8340-2bd152dd48d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:13.088080 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0161c-989d-4530-8340-2bd152dd48d2 None admin] PATH_INFO: `/v3/roles/361f7a146e9b47e997cf572bae05c96e` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:13.089576 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0161c-989d-4530-8340-2bd152dd48d2 None admin] RBAC: Authorizing `identity:get_role(role_id=361f7a146e9b47e997cf572bae05c96e)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:13.090940 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0161c-989d-4530-8340-2bd152dd48d2 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:13.092383 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 562/1113] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:20:12 2022] GET /identity/v3/roles/361f7a146e9b47e997cf572bae05c96e => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:13.098461 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609bfeb-f048-444a-994c-47c344a2218e None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:13.197811 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609bfeb-f048-444a-994c-47c344a2218e None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:13.232614 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ad7d4-d07b-4056-bd12-f957ba21ca66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:13.233484 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ad7d4-d07b-4056-bd12-f957ba21ca66 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:13.233771 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ad7d4-d07b-4056-bd12-f957ba21ca66 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:13.234051 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ad7d4-d07b-4056-bd12-f957ba21ca66 None admin] PATH_INFO: `/v3/users/ef46d9fed2c1479288b53e84cb3d6a6d` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:13.247864 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ad7d4-d07b-4056-bd12-f957ba21ca66 None admin] RBAC: Authorizing `identity:get_user(user_id=ef46d9fed2c1479288b53e84cb3d6a6d)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:13.249313 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ad7d4-d07b-4056-bd12-f957ba21ca66 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:13.251044 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 552/1114] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:20:13 2022] GET /identity/v3/users/ef46d9fed2c1479288b53e84cb3d6a6d => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:13.257379 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0161c-989d-4530-8340-2bd152dd48d2 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:13.354133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0161c-989d-4530-8340-2bd152dd48d2 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:13.389467 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfece5e-6171-4d09-8858-16c1518b53cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:13.390336 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfece5e-6171-4d09-8858-16c1518b53cb None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:13.390650 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfece5e-6171-4d09-8858-16c1518b53cb None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:13.390930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfece5e-6171-4d09-8858-16c1518b53cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:13.451240 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:13.459053 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfece5e-6171-4d09-8858-16c1518b53cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:13.460529 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfece5e-6171-4d09-8858-16c1518b53cb None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:13.558042 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 563/1115] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:20:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:20:13.564948 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ad7d4-d07b-4056-bd12-f957ba21ca66 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:13.591687 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:13.665226 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ad7d4-d07b-4056-bd12-f957ba21ca66 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:13.698852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51e9af-b809-4c5c-a4ae-e1dc9cde62db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:13.699743 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51e9af-b809-4c5c-a4ae-e1dc9cde62db None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:13.700033 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51e9af-b809-4c5c-a4ae-e1dc9cde62db None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:13.700313 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51e9af-b809-4c5c-a4ae-e1dc9cde62db None admin] PATH_INFO: `/v3/projects/ec17c558f89a43a0842863c73663f583` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:13.701501 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51e9af-b809-4c5c-a4ae-e1dc9cde62db None admin] RBAC: Authorizing `identity:get_project(project_id=ec17c558f89a43a0842863c73663f583)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:13.702931 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51e9af-b809-4c5c-a4ae-e1dc9cde62db None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:13.704719 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 553/1116] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:20:13 2022] GET /identity/v3/projects/ec17c558f89a43a0842863c73663f583 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:13.711088 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfece5e-6171-4d09-8858-16c1518b53cb None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:13.808921 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:13.815796 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfece5e-6171-4d09-8858-16c1518b53cb None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:13.851080 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbaf1a-2903-4cf7-b937-1b8f183c6c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:13.851463 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbaf1a-2903-4cf7-b937-1b8f183c6c11 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:13.851657 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbaf1a-2903-4cf7-b937-1b8f183c6c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:13.851938 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbaf1a-2903-4cf7-b937-1b8f183c6c11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:13.852785 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbaf1a-2903-4cf7-b937-1b8f183c6c11 None admin] RBAC: Adding query filter params (role.id=361f7a146e9b47e997cf572bae05c96e, scope.project.id=ec17c558f89a43a0842863c73663f583, user.id=ef46d9fed2c1479288b53e84cb3d6a6d) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:20:13.853105 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbaf1a-2903-4cf7-b937-1b8f183c6c11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:13.854554 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbaf1a-2903-4cf7-b937-1b8f183c6c11 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:13.861422 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 564/1117] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:20:13 2022] GET /identity/v3/role_assignments?user.id=ef46d9fed2c1479288b53e84cb3d6a6d&scope.project.id=ec17c558f89a43a0842863c73663f583&role.id=361f7a146e9b47e997cf572bae05c96e => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:15.870258 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bf3c8-69e8-478e-8a35-72a6dbef89df None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:15.870731 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bf3c8-69e8-478e-8a35-72a6dbef89df None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:15.870834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bf3c8-69e8-478e-8a35-72a6dbef89df None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:15.872247 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 554/1118] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:20:15.878017 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f25eb-21ea-43e5-8df9-d054c8c4ac61 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:15.878443 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f25eb-21ea-43e5-8df9-d054c8c4ac61 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:15.878574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f25eb-21ea-43e5-8df9-d054c8c4ac61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:15.894937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-e24f25eb-21ea-43e5-8df9-d054c8c4ac61 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:20:15.896141 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-e24f25eb-21ea-43e5-8df9-d054c8c4ac61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:20:15.960888 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 565/1119] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:20:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:20:15.983572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bf3c8-69e8-478e-8a35-72a6dbef89df None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:16.081885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:16.089696 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bf3c8-69e8-478e-8a35-72a6dbef89df None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:16.123433 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53b96a-8949-49cc-a2c7-d3371a529209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:16.124201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53b96a-8949-49cc-a2c7-d3371a529209 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:16.124487 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53b96a-8949-49cc-a2c7-d3371a529209 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:16.124764 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53b96a-8949-49cc-a2c7-d3371a529209 None admin] PATH_INFO: `/v3/roles/361f7a146e9b47e997cf572bae05c96e` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:16.126265 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53b96a-8949-49cc-a2c7-d3371a529209 None admin] RBAC: Authorizing `identity:get_role(role_id=361f7a146e9b47e997cf572bae05c96e)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:16.127671 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53b96a-8949-49cc-a2c7-d3371a529209 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:16.129048 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 555/1120] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:20:15 2022] GET /identity/v3/roles/361f7a146e9b47e997cf572bae05c96e => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:16.134842 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f25eb-21ea-43e5-8df9-d054c8c4ac61 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:16.220829 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:16.232815 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f25eb-21ea-43e5-8df9-d054c8c4ac61 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:16.267167 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a09a6-ffb1-4809-8032-6c1dc5dd08ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:16.268068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a09a6-ffb1-4809-8032-6c1dc5dd08ba None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:16.268357 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a09a6-ffb1-4809-8032-6c1dc5dd08ba None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:16.268638 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a09a6-ffb1-4809-8032-6c1dc5dd08ba None admin] PATH_INFO: `/v3/users/ef46d9fed2c1479288b53e84cb3d6a6d` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:16.269822 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a09a6-ffb1-4809-8032-6c1dc5dd08ba None admin] RBAC: Authorizing `identity:get_user(user_id=ef46d9fed2c1479288b53e84cb3d6a6d)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:16.271259 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a09a6-ffb1-4809-8032-6c1dc5dd08ba None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:16.272903 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 566/1121] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:20:16 2022] GET /identity/v3/users/ef46d9fed2c1479288b53e84cb3d6a6d => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:16.278817 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53b96a-8949-49cc-a2c7-d3371a529209 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:16.376481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53b96a-8949-49cc-a2c7-d3371a529209 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:16.410033 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70088a3f-79f0-40a3-89b7-dfe1770d9a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:16.410877 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70088a3f-79f0-40a3-89b7-dfe1770d9a54 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:16.411164 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70088a3f-79f0-40a3-89b7-dfe1770d9a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:16.411473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70088a3f-79f0-40a3-89b7-dfe1770d9a54 None admin] PATH_INFO: `/v3/projects/ec17c558f89a43a0842863c73663f583` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:16.412653 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70088a3f-79f0-40a3-89b7-dfe1770d9a54 None admin] RBAC: Authorizing `identity:get_project(project_id=ec17c558f89a43a0842863c73663f583)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:16.414080 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70088a3f-79f0-40a3-89b7-dfe1770d9a54 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:16.415821 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 556/1122] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:20:16 2022] GET /identity/v3/projects/ec17c558f89a43a0842863c73663f583 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:16.422191 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a09a6-ffb1-4809-8032-6c1dc5dd08ba None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:16.521165 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a09a6-ffb1-4809-8032-6c1dc5dd08ba None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:16.555249 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206f4b0-bee7-47ad-be25-cfccc1fa4c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:16.556147 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206f4b0-bee7-47ad-be25-cfccc1fa4c04 None admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:16.556429 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206f4b0-bee7-47ad-be25-cfccc1fa4c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:16.556701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206f4b0-bee7-47ad-be25-cfccc1fa4c04 None admin] PATH_INFO: `/v3/projects/ec17c558f89a43a0842863c73663f583/users/ef46d9fed2c1479288b53e84cb3d6a6d/roles/361f7a146e9b47e997cf572bae05c96e` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:16.558876 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206f4b0-bee7-47ad-be25-cfccc1fa4c04 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec17c558f89a43a0842863c73663f583, user_id=ef46d9fed2c1479288b53e84cb3d6a6d, role_id=361f7a146e9b47e997cf572bae05c96e)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:16.560311 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206f4b0-bee7-47ad-be25-cfccc1fa4c04 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:16.573764 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 567/1123] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 19 15:20:16 2022] PUT /identity/v3/projects/ec17c558f89a43a0842863c73663f583/users/ef46d9fed2c1479288b53e84cb3d6a6d/roles/361f7a146e9b47e997cf572bae05c96e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:20:18.572484 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a9263-4bfc-4f06-8360-a6007622315d None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:18.573037 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a9263-4bfc-4f06-8360-a6007622315d None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:18.573037 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a9263-4bfc-4f06-8360-a6007622315d None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:18.574418 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 557/1124] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:20:18.579643 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac8fb0-163b-4706-9aa5-72abd8516a84 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:18.580051 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac8fb0-163b-4706-9aa5-72abd8516a84 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:18.580210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac8fb0-163b-4706-9aa5-72abd8516a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:18.597333 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-bcac8fb0-163b-4706-9aa5-72abd8516a84 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:20:18.598511 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-bcac8fb0-163b-4706-9aa5-72abd8516a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:20:18.609109 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:18.664880 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 568/1125] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:20:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:20:18.689065 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a9263-4bfc-4f06-8360-a6007622315d None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:18.718528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:18.800828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a9263-4bfc-4f06-8360-a6007622315d None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:18.836362 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e12c3-997b-4cea-85ba-a8f8f45ab515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:18.837227 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e12c3-997b-4cea-85ba-a8f8f45ab515 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:18.837510 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e12c3-997b-4cea-85ba-a8f8f45ab515 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:18.837783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e12c3-997b-4cea-85ba-a8f8f45ab515 None admin] PATH_INFO: `/v3/roles/361f7a146e9b47e997cf572bae05c96e` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:18.839344 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e12c3-997b-4cea-85ba-a8f8f45ab515 None admin] RBAC: Authorizing `identity:get_role(role_id=361f7a146e9b47e997cf572bae05c96e)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:18.840721 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e12c3-997b-4cea-85ba-a8f8f45ab515 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:18.842127 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 558/1126] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:20:18 2022] GET /identity/v3/roles/361f7a146e9b47e997cf572bae05c96e => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:18.848474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac8fb0-163b-4706-9aa5-72abd8516a84 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:18.947073 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac8fb0-163b-4706-9aa5-72abd8516a84 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:18.980699 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70a4d7-43b0-41d4-bb16-b453bf90aade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:18.981564 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70a4d7-43b0-41d4-bb16-b453bf90aade None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:18.981848 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70a4d7-43b0-41d4-bb16-b453bf90aade None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:18.982122 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70a4d7-43b0-41d4-bb16-b453bf90aade None admin] PATH_INFO: `/v3/users/ef46d9fed2c1479288b53e84cb3d6a6d` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:18.983322 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70a4d7-43b0-41d4-bb16-b453bf90aade None admin] RBAC: Authorizing `identity:get_user(user_id=ef46d9fed2c1479288b53e84cb3d6a6d)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:18.984728 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70a4d7-43b0-41d4-bb16-b453bf90aade None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:18.986400 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 569/1127] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:20:18 2022] GET /identity/v3/users/ef46d9fed2c1479288b53e84cb3d6a6d => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:18.992171 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e12c3-997b-4cea-85ba-a8f8f45ab515 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:19.085991 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:19.089958 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e12c3-997b-4cea-85ba-a8f8f45ab515 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:19.123344 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369809bd-19f8-4e4a-894d-25b76536c817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:19.123997 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369809bd-19f8-4e4a-894d-25b76536c817 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:19.124284 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369809bd-19f8-4e4a-894d-25b76536c817 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:19.124565 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369809bd-19f8-4e4a-894d-25b76536c817 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:19.195299 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369809bd-19f8-4e4a-894d-25b76536c817 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:19.196752 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369809bd-19f8-4e4a-894d-25b76536c817 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:19.290124 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:19.295253 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 559/1128] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:20:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:20:19.300876 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70a4d7-43b0-41d4-bb16-b453bf90aade None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:19.316587 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:19.399188 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70a4d7-43b0-41d4-bb16-b453bf90aade None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:19.432955 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88413cfc-0b91-4774-88b0-103affd6c92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:19.433813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88413cfc-0b91-4774-88b0-103affd6c92d None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:19.434098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88413cfc-0b91-4774-88b0-103affd6c92d None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:19.434377 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88413cfc-0b91-4774-88b0-103affd6c92d None admin] PATH_INFO: `/v3/projects/ec17c558f89a43a0842863c73663f583` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:19.435571 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88413cfc-0b91-4774-88b0-103affd6c92d None admin] RBAC: Authorizing `identity:get_project(project_id=ec17c558f89a43a0842863c73663f583)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:19.436992 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88413cfc-0b91-4774-88b0-103affd6c92d None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:19.438791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 570/1129] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:20:19 2022] GET /identity/v3/projects/ec17c558f89a43a0842863c73663f583 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:19.445434 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369809bd-19f8-4e4a-894d-25b76536c817 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:19.540667 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369809bd-19f8-4e4a-894d-25b76536c817 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:19.574058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1147d7-01b4-47ed-a957-3f6bfd12f7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:19.574708 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1147d7-01b4-47ed-a957-3f6bfd12f7de None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:19.574997 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1147d7-01b4-47ed-a957-3f6bfd12f7de None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:19.575316 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1147d7-01b4-47ed-a957-3f6bfd12f7de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:19.576151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1147d7-01b4-47ed-a957-3f6bfd12f7de None admin] RBAC: Adding query filter params (role.id=361f7a146e9b47e997cf572bae05c96e, scope.project.id=ec17c558f89a43a0842863c73663f583, user.id=ef46d9fed2c1479288b53e84cb3d6a6d) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:20:19.576468 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1147d7-01b4-47ed-a957-3f6bfd12f7de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:19.577893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1147d7-01b4-47ed-a957-3f6bfd12f7de None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:19.583776 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 560/1130] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:20:19 2022] GET /identity/v3/role_assignments?user.id=ef46d9fed2c1479288b53e84cb3d6a6d&scope.project.id=ec17c558f89a43a0842863c73663f583&role.id=361f7a146e9b47e997cf572bae05c96e => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:21.640931 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e2207-024d-4611-aace-3e7ef42cdfe6 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:21.641985 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e2207-024d-4611-aace-3e7ef42cdfe6 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:21.641985 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e2207-024d-4611-aace-3e7ef42cdfe6 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:21.643354 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 571/1131] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:20:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:20:21.648566 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7afe44-4ad4-4c6d-90b1-a8b5d39168b6 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:21.648989 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7afe44-4ad4-4c6d-90b1-a8b5d39168b6 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:21.649102 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7afe44-4ad4-4c6d-90b1-a8b5d39168b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:21.666529 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-5d7afe44-4ad4-4c6d-90b1-a8b5d39168b6 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:20:21.667753 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-5d7afe44-4ad4-4c6d-90b1-a8b5d39168b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:20:21.722112 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:21.732495 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 561/1132] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:20:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:20:21.755548 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e2207-024d-4611-aace-3e7ef42cdfe6 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:21.836784 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:21.861144 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e2207-024d-4611-aace-3e7ef42cdfe6 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:21.897513 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14fba5-a44c-49da-b9d3-355573efee9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:21.898236 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14fba5-a44c-49da-b9d3-355573efee9a None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:21.898523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14fba5-a44c-49da-b9d3-355573efee9a None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:21.898801 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14fba5-a44c-49da-b9d3-355573efee9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:21.900016 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14fba5-a44c-49da-b9d3-355573efee9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:21.901430 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14fba5-a44c-49da-b9d3-355573efee9a None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:21.903053 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 572/1133] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:20:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:21.909860 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7afe44-4ad4-4c6d-90b1-a8b5d39168b6 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:22.007201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7afe44-4ad4-4c6d-90b1-a8b5d39168b6 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:22.040569 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f392f19-f62d-4c82-9a5c-dd76504f75bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:22.041216 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f392f19-f62d-4c82-9a5c-dd76504f75bc None admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:22.041499 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f392f19-f62d-4c82-9a5c-dd76504f75bc None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:22.041773 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f392f19-f62d-4c82-9a5c-dd76504f75bc None admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:22.042479 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f392f19-f62d-4c82-9a5c-dd76504f75bc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:22.043912 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f392f19-f62d-4c82-9a5c-dd76504f75bc None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:22.070377 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 562/1134] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jul 19 15:20:21 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:20:24.128055 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d29ed-9b81-485d-99ee-a69aaaff1f13 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:24.128565 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d29ed-9b81-485d-99ee-a69aaaff1f13 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:24.128667 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d29ed-9b81-485d-99ee-a69aaaff1f13 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:24.130023 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 573/1135] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:20:24.135338 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64b005-ff7f-4f12-b958-223c00424b55 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:24.135789 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64b005-ff7f-4f12-b958-223c00424b55 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:24.135890 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64b005-ff7f-4f12-b958-223c00424b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:24.153376 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-3d64b005-ff7f-4f12-b958-223c00424b55 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:20:24.154807 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-3d64b005-ff7f-4f12-b958-223c00424b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:20:24.193313 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:24.220776 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 563/1136] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:20:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:20:24.244762 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d29ed-9b81-485d-99ee-a69aaaff1f13 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:24.344460 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d29ed-9b81-485d-99ee-a69aaaff1f13 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:24.377775 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5db376-f96f-438d-a182-1f7e79d70390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:24.378622 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5db376-f96f-438d-a182-1f7e79d70390 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:24.378860 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5db376-f96f-438d-a182-1f7e79d70390 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:24.379142 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5db376-f96f-438d-a182-1f7e79d70390 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:24.380353 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5db376-f96f-438d-a182-1f7e79d70390 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:24.381773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5db376-f96f-438d-a182-1f7e79d70390 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:24.383414 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 574/1137] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:20:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:24.389167 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64b005-ff7f-4f12-b958-223c00424b55 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:24.483497 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64b005-ff7f-4f12-b958-223c00424b55 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:24.515940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225666c2-3c71-41f2-8f62-088b25e103c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:24.517138 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225666c2-3c71-41f2-8f62-088b25e103c8 None admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:24.517416 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225666c2-3c71-41f2-8f62-088b25e103c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:24.517686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225666c2-3c71-41f2-8f62-088b25e103c8 None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:24.518388 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225666c2-3c71-41f2-8f62-088b25e103c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:24.519874 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225666c2-3c71-41f2-8f62-088b25e103c8 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:24.539279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 564/1138] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jul 19 15:20:24 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:20:26.664858 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19ba5b-235c-49ce-920c-32a6a3941698 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:26.665414 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19ba5b-235c-49ce-920c-32a6a3941698 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:26.665414 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19ba5b-235c-49ce-920c-32a6a3941698 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:26.666768 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 575/1139] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:20:26.672114 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d98879-dc09-4de9-a478-2c14798e0b0e None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:26.672627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d98879-dc09-4de9-a478-2c14798e0b0e None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:26.672718 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d98879-dc09-4de9-a478-2c14798e0b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:26.690423 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-a7d98879-dc09-4de9-a478-2c14798e0b0e None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:20:26.691675 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-a7d98879-dc09-4de9-a478-2c14798e0b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:20:26.715471 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:26.759205 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 565/1140] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:20:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:20:26.783110 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19ba5b-235c-49ce-920c-32a6a3941698 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:26.801366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:26.882173 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19ba5b-235c-49ce-920c-32a6a3941698 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:26.913925 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556994f3-cda9-4116-837c-4e5585681053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:26.914697 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556994f3-cda9-4116-837c-4e5585681053 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:26.915032 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556994f3-cda9-4116-837c-4e5585681053 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:26.915276 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556994f3-cda9-4116-837c-4e5585681053 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:26.925521 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556994f3-cda9-4116-837c-4e5585681053 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:20:26.933068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-556994f3-cda9-4116-837c-4e5585681053 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:20:26.933068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:20:26.933068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:20:26.933068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:20:26.933068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:20:26.933068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:20:26.933068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:20:26.933068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:20:26.933068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:20:26.933068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:20:26.933068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:20:26.933068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:20:26.933068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:20:26.933068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:20:26.933068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:20:26.933068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:20:26.934230 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:20:26.934230 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:20:26.934230 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:20:26.934230 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:20:26.934230 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:20:26.934230 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:20:26.934230 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:20:26.934230 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:20:26.934230 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:20:26.934230 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:20:26.934230 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:20:26.934230 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:20:26.934230 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:20:26.934230 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:20:26.934230 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:20:26.934230 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:20:26.935470 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:20:26.935470 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:20:26.935470 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:20:26.935470 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:20:26.935470 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:20:26.935470 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:20:26.935470 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:20:26.935470 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:20:26.935470 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:20:26.935470 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:20:26.935470 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:20:26.935470 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:20:26.935470 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 576/1141] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:20:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:20:26.940972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d98879-dc09-4de9-a478-2c14798e0b0e None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:27.039245 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d98879-dc09-4de9-a478-2c14798e0b0e None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:27.073601 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc85633-a417-446c-9150-d340f0e5d23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:27.074263 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc85633-a417-446c-9150-d340f0e5d23e None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:27.074546 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc85633-a417-446c-9150-d340f0e5d23e None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:27.074820 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc85633-a417-446c-9150-d340f0e5d23e None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:27.075593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc85633-a417-446c-9150-d340f0e5d23e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:20:27.075902 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc85633-a417-446c-9150-d340f0e5d23e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:27.077256 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc85633-a417-446c-9150-d340f0e5d23e None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:27.085669 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 566/1142] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:20:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:27.091540 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556994f3-cda9-4116-837c-4e5585681053 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:27.168887 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:27.191191 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556994f3-cda9-4116-837c-4e5585681053 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:27.224356 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e85e4b-1208-47f6-b850-d1cd195e1ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:27.225234 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e85e4b-1208-47f6-b850-d1cd195e1ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:27.225525 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e85e4b-1208-47f6-b850-d1cd195e1ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:27.225807 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e85e4b-1208-47f6-b850-d1cd195e1ef2 None admin] PATH_INFO: `/v3/users/fa8389ef25484aec8793b6bbb8050a22` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:27.239696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e85e4b-1208-47f6-b850-d1cd195e1ef2 None admin] RBAC: Authorizing `identity:get_user(user_id=fa8389ef25484aec8793b6bbb8050a22)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:27.241157 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e85e4b-1208-47f6-b850-d1cd195e1ef2 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:27.242823 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 577/1143] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:20:27 2022] GET /identity/v3/users/fa8389ef25484aec8793b6bbb8050a22 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:27.248611 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc85633-a417-446c-9150-d340f0e5d23e None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:27.272761 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:27.346760 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc85633-a417-446c-9150-d340f0e5d23e None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:27.380235 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3153f-3202-48b1-968e-add691266d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:27.380875 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3153f-3202-48b1-968e-add691266d4f None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:27.381162 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3153f-3202-48b1-968e-add691266d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:27.381448 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3153f-3202-48b1-968e-add691266d4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:27.446678 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3153f-3202-48b1-968e-add691266d4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:27.448067 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3153f-3202-48b1-968e-add691266d4f None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:27.470558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:27.544265 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 567/1144] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:20:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:20:27.550710 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e85e4b-1208-47f6-b850-d1cd195e1ef2 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:27.645894 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e85e4b-1208-47f6-b850-d1cd195e1ef2 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:27.678651 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10fe73c-4e8d-4503-82c0-094568f6a1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:27.679531 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fe73c-4e8d-4503-82c0-094568f6a1cd None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:27.679813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fe73c-4e8d-4503-82c0-094568f6a1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:27.680087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fe73c-4e8d-4503-82c0-094568f6a1cd None admin] PATH_INFO: `/v3/projects/f7f8856e875648a8ae8e6c5dcde490e8` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:27.681269 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10fe73c-4e8d-4503-82c0-094568f6a1cd None admin] RBAC: Authorizing `identity:get_project(project_id=f7f8856e875648a8ae8e6c5dcde490e8)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:27.682680 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10fe73c-4e8d-4503-82c0-094568f6a1cd None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:27.684409 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 578/1145] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:20:27 2022] GET /identity/v3/projects/f7f8856e875648a8ae8e6c5dcde490e8 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:27.690536 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3153f-3202-48b1-968e-add691266d4f None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:27.791867 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3153f-3202-48b1-968e-add691266d4f None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:27.815528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:27.831789 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47928d29-5cfa-4798-8ffb-534538bc31b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:27.832452 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47928d29-5cfa-4798-8ffb-534538bc31b6 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:27.832736 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47928d29-5cfa-4798-8ffb-534538bc31b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:27.833016 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47928d29-5cfa-4798-8ffb-534538bc31b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:27.833868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47928d29-5cfa-4798-8ffb-534538bc31b6 None admin] RBAC: Adding query filter params (role.id=d884ddf33c1440d9b3a3351b85e83e76, scope.project.id=f7f8856e875648a8ae8e6c5dcde490e8, user.id=fa8389ef25484aec8793b6bbb8050a22) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:20:27.834185 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47928d29-5cfa-4798-8ffb-534538bc31b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:27.835652 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47928d29-5cfa-4798-8ffb-534538bc31b6 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:27.841698 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 568/1146] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:20:27 2022] GET /identity/v3/role_assignments?user.id=fa8389ef25484aec8793b6bbb8050a22&scope.project.id=f7f8856e875648a8ae8e6c5dcde490e8&role.id=d884ddf33c1440d9b3a3351b85e83e76 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:29.889779 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5e837-4d8d-4f19-9b1e-6d49c21fc75f None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:29.890341 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5e837-4d8d-4f19-9b1e-6d49c21fc75f None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:29.890341 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5e837-4d8d-4f19-9b1e-6d49c21fc75f None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:29.891743 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 579/1147] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:20:29.897698 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73166f5c-0a07-4a91-ba54-b6fb3fa1172b None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:29.898179 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73166f5c-0a07-4a91-ba54-b6fb3fa1172b None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:29.898273 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73166f5c-0a07-4a91-ba54-b6fb3fa1172b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:29.914973 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-73166f5c-0a07-4a91-ba54-b6fb3fa1172b None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:20:29.916213 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-73166f5c-0a07-4a91-ba54-b6fb3fa1172b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:20:29.982621 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 569/1148] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:20:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:20:30.004898 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5e837-4d8d-4f19-9b1e-6d49c21fc75f None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:30.008725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:30.103496 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5e837-4d8d-4f19-9b1e-6d49c21fc75f None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:30.135716 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef91f2d-e29a-419f-8ab8-6f9726dabbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:30.136429 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef91f2d-e29a-419f-8ab8-6f9726dabbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:30.136713 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef91f2d-e29a-419f-8ab8-6f9726dabbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:30.136993 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef91f2d-e29a-419f-8ab8-6f9726dabbf9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:30.147144 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef91f2d-e29a-419f-8ab8-6f9726dabbf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:20:30.154892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-fef91f2d-e29a-419f-8ab8-6f9726dabbf9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:20:30.154892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:20:30.154892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:20:30.154892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:20:30.154892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:20:30.154892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:20:30.154892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:20:30.154892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:20:30.154892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:20:30.154892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:20:30.154892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:20:30.154892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:20:30.154892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:20:30.154892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:20:30.154892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:20:30.154892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:20:30.156041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:20:30.156041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:20:30.156041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:20:30.156041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:20:30.156041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:20:30.156041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:20:30.156041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:20:30.156041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:20:30.156041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:20:30.156041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:20:30.156041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:20:30.156041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:20:30.156041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:20:30.156041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:20:30.156041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:20:30.156041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:20:30.157809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:20:30.157809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:20:30.157809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:20:30.157809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:20:30.157809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:20:30.157809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:20:30.157809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:20:30.157809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:20:30.157809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:20:30.157809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:20:30.157809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:20:30.157809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:20:30.157809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 580/1149] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:20:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:20:30.162712 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73166f5c-0a07-4a91-ba54-b6fb3fa1172b None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:30.263683 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73166f5c-0a07-4a91-ba54-b6fb3fa1172b None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:30.282491 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:30.300048 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a53506-7d05-4685-b78f-829de1768724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:30.300728 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a53506-7d05-4685-b78f-829de1768724 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:30.301008 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a53506-7d05-4685-b78f-829de1768724 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:30.301283 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a53506-7d05-4685-b78f-829de1768724 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:30.302036 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a53506-7d05-4685-b78f-829de1768724 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:20:30.302343 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a53506-7d05-4685-b78f-829de1768724 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:30.303729 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a53506-7d05-4685-b78f-829de1768724 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:30.315345 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 570/1150] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:20:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:30.321237 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef91f2d-e29a-419f-8ab8-6f9726dabbf9 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:30.383540 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:30.421368 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef91f2d-e29a-419f-8ab8-6f9726dabbf9 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:30.455167 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a39189-97db-47f4-8572-b1c11a8b64ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:30.456068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a39189-97db-47f4-8572-b1c11a8b64ed None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:30.456808 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a39189-97db-47f4-8572-b1c11a8b64ed None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:30.456808 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a39189-97db-47f4-8572-b1c11a8b64ed None admin] PATH_INFO: `/v3/users/fa8389ef25484aec8793b6bbb8050a22` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:30.457831 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a39189-97db-47f4-8572-b1c11a8b64ed None admin] RBAC: Authorizing `identity:get_user(user_id=fa8389ef25484aec8793b6bbb8050a22)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:30.459276 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a39189-97db-47f4-8572-b1c11a8b64ed None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:30.460914 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 581/1151] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:20:30 2022] GET /identity/v3/users/fa8389ef25484aec8793b6bbb8050a22 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:30.466853 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a53506-7d05-4685-b78f-829de1768724 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:30.561898 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a53506-7d05-4685-b78f-829de1768724 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:30.600361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04924ecb-fca7-473c-ad7b-6dea46bd4876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:30.601230 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04924ecb-fca7-473c-ad7b-6dea46bd4876 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:30.601519 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04924ecb-fca7-473c-ad7b-6dea46bd4876 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:30.601841 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04924ecb-fca7-473c-ad7b-6dea46bd4876 None admin] PATH_INFO: `/v3/projects/f7f8856e875648a8ae8e6c5dcde490e8` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:30.603037 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04924ecb-fca7-473c-ad7b-6dea46bd4876 None admin] RBAC: Authorizing `identity:get_project(project_id=f7f8856e875648a8ae8e6c5dcde490e8)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:30.604495 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04924ecb-fca7-473c-ad7b-6dea46bd4876 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:30.606205 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 571/1152] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:20:30 2022] GET /identity/v3/projects/f7f8856e875648a8ae8e6c5dcde490e8 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:30.613305 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a39189-97db-47f4-8572-b1c11a8b64ed None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:30.714322 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a39189-97db-47f4-8572-b1c11a8b64ed None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:30.742489 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:30.751372 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1decf4c-0b37-4307-83d1-ea4547add41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:30.752690 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1decf4c-0b37-4307-83d1-ea4547add41f None admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:30.752979 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1decf4c-0b37-4307-83d1-ea4547add41f None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:30.753292 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1decf4c-0b37-4307-83d1-ea4547add41f None admin] PATH_INFO: `/v3/projects/f7f8856e875648a8ae8e6c5dcde490e8/users/fa8389ef25484aec8793b6bbb8050a22/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:30.755495 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1decf4c-0b37-4307-83d1-ea4547add41f None admin] RBAC: Authorizing `identity:create_grant(project_id=f7f8856e875648a8ae8e6c5dcde490e8, user_id=fa8389ef25484aec8793b6bbb8050a22, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:30.756934 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1decf4c-0b37-4307-83d1-ea4547add41f None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:30.771394 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 582/1153] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 19 15:20:30 2022] PUT /identity/v3/projects/f7f8856e875648a8ae8e6c5dcde490e8/users/fa8389ef25484aec8793b6bbb8050a22/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:20:32.847455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c365025-fc49-46cf-b210-5ce063fb38c4 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:32.847986 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c365025-fc49-46cf-b210-5ce063fb38c4 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:32.847986 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c365025-fc49-46cf-b210-5ce063fb38c4 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:32.849416 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 572/1154] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:20:32.855071 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e21b69-c5ee-4762-b9e9-43c1f84b2b95 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:32.855908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e21b69-c5ee-4762-b9e9-43c1f84b2b95 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:32.856876 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e21b69-c5ee-4762-b9e9-43c1f84b2b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:32.874836 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-c9e21b69-c5ee-4762-b9e9-43c1f84b2b95 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:20:32.876853 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-c9e21b69-c5ee-4762-b9e9-43c1f84b2b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:20:32.945375 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 583/1155] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:20:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:20:32.969632 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c365025-fc49-46cf-b210-5ce063fb38c4 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:33.018673 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:33.072964 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c365025-fc49-46cf-b210-5ce063fb38c4 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:33.106797 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6678ff7-9725-4bf9-976e-a03250dee71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:33.107525 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6678ff7-9725-4bf9-976e-a03250dee71b None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:33.107838 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6678ff7-9725-4bf9-976e-a03250dee71b None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:33.108116 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6678ff7-9725-4bf9-976e-a03250dee71b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:33.118929 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6678ff7-9725-4bf9-976e-a03250dee71b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:20:33.126692 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-b6678ff7-9725-4bf9-976e-a03250dee71b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:20:33.126692 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:20:33.126692 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:20:33.126692 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:20:33.126692 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:20:33.126692 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:20:33.126692 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:20:33.126692 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:20:33.126692 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:20:33.126692 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:20:33.126692 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:20:33.126692 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:20:33.126692 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:20:33.126692 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:20:33.126692 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:20:33.126692 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:20:33.127896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:20:33.127896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:20:33.127896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:20:33.127896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:20:33.127896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:20:33.127896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:20:33.127896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:20:33.127896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:20:33.127896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:20:33.127896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:20:33.127896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:20:33.127896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:20:33.127896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:20:33.127896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:20:33.127896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:20:33.127896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:20:33.128819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:20:33.128819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:20:33.128819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:20:33.128819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:20:33.128819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:20:33.128819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:20:33.128819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:20:33.128819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:20:33.128819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:20:33.128819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:20:33.128819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:20:33.128819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:20:33.128819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 573/1156] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:20:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:20:33.134347 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e21b69-c5ee-4762-b9e9-43c1f84b2b95 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:33.233289 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e21b69-c5ee-4762-b9e9-43c1f84b2b95 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:33.256431 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:33.270134 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185aa3d-ff81-478d-b2b8-91c0bf3f7940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:33.270809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185aa3d-ff81-478d-b2b8-91c0bf3f7940 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:33.271098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185aa3d-ff81-478d-b2b8-91c0bf3f7940 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:33.271412 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185aa3d-ff81-478d-b2b8-91c0bf3f7940 None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:33.272163 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185aa3d-ff81-478d-b2b8-91c0bf3f7940 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:20:33.272474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185aa3d-ff81-478d-b2b8-91c0bf3f7940 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:33.273829 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185aa3d-ff81-478d-b2b8-91c0bf3f7940 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:33.283513 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 584/1157] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:20:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:33.289370 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6678ff7-9725-4bf9-976e-a03250dee71b None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:33.397078 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6678ff7-9725-4bf9-976e-a03250dee71b None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:33.404614 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:33.434087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffad84b-b5ae-40ef-9504-72794510f8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:33.434958 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffad84b-b5ae-40ef-9504-72794510f8cc None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:33.435256 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffad84b-b5ae-40ef-9504-72794510f8cc None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:33.435539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffad84b-b5ae-40ef-9504-72794510f8cc None admin] PATH_INFO: `/v3/users/fa8389ef25484aec8793b6bbb8050a22` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:33.436745 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffad84b-b5ae-40ef-9504-72794510f8cc None admin] RBAC: Authorizing `identity:get_user(user_id=fa8389ef25484aec8793b6bbb8050a22)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:33.438863 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffad84b-b5ae-40ef-9504-72794510f8cc None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:33.440686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 574/1158] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:20:33 2022] GET /identity/v3/users/fa8389ef25484aec8793b6bbb8050a22 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:33.446445 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185aa3d-ff81-478d-b2b8-91c0bf3f7940 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:33.545467 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185aa3d-ff81-478d-b2b8-91c0bf3f7940 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:33.579641 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf09bde-ead5-48ca-9e95-34b355fe4a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:33.580283 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf09bde-ead5-48ca-9e95-34b355fe4a47 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:33.580572 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf09bde-ead5-48ca-9e95-34b355fe4a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:33.580858 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf09bde-ead5-48ca-9e95-34b355fe4a47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:33.631439 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:33.646825 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf09bde-ead5-48ca-9e95-34b355fe4a47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:33.648338 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf09bde-ead5-48ca-9e95-34b355fe4a47 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:33.743182 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 585/1159] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:20:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:20:33.749040 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffad84b-b5ae-40ef-9504-72794510f8cc None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:33.848630 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffad84b-b5ae-40ef-9504-72794510f8cc None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:33.882440 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a5699-8376-428c-a9d5-030f1a670920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:33.883317 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a5699-8376-428c-a9d5-030f1a670920 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:33.883598 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a5699-8376-428c-a9d5-030f1a670920 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:33.883870 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a5699-8376-428c-a9d5-030f1a670920 None admin] PATH_INFO: `/v3/projects/f7f8856e875648a8ae8e6c5dcde490e8` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:33.885025 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a5699-8376-428c-a9d5-030f1a670920 None admin] RBAC: Authorizing `identity:get_project(project_id=f7f8856e875648a8ae8e6c5dcde490e8)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:33.886429 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a5699-8376-428c-a9d5-030f1a670920 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:33.888136 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 575/1160] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:20:33 2022] GET /identity/v3/projects/f7f8856e875648a8ae8e6c5dcde490e8 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:33.894234 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf09bde-ead5-48ca-9e95-34b355fe4a47 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:33.978994 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:33.995565 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf09bde-ead5-48ca-9e95-34b355fe4a47 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:34.028485 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cb42d-b2d1-424e-9919-da3cc466616b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:34.029385 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cb42d-b2d1-424e-9919-da3cc466616b None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:34.029673 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cb42d-b2d1-424e-9919-da3cc466616b None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:34.029955 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cb42d-b2d1-424e-9919-da3cc466616b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:34.030783 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3cb42d-b2d1-424e-9919-da3cc466616b None admin] RBAC: Adding query filter params (role.id=d884ddf33c1440d9b3a3351b85e83e76, scope.project.id=f7f8856e875648a8ae8e6c5dcde490e8, user.id=fa8389ef25484aec8793b6bbb8050a22) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:20:34.031100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3cb42d-b2d1-424e-9919-da3cc466616b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:34.033087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3cb42d-b2d1-424e-9919-da3cc466616b None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:34.038738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 586/1161] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:20:33 2022] GET /identity/v3/role_assignments?user.id=fa8389ef25484aec8793b6bbb8050a22&scope.project.id=f7f8856e875648a8ae8e6c5dcde490e8&role.id=d884ddf33c1440d9b3a3351b85e83e76 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:20:36.100485 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae70331-5c7b-41a0-b111-6baa7bec026b None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:36.101029 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae70331-5c7b-41a0-b111-6baa7bec026b None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:36.101029 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae70331-5c7b-41a0-b111-6baa7bec026b None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:36.102434 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 576/1162] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:20:36.108666 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44216dd-8e29-4e55-8425-297eadad8690 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:36.109198 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44216dd-8e29-4e55-8425-297eadad8690 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:36.109198 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44216dd-8e29-4e55-8425-297eadad8690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:36.127451 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-c44216dd-8e29-4e55-8425-297eadad8690 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:20:36.128667 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-c44216dd-8e29-4e55-8425-297eadad8690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:20:36.198779 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 587/1163] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:20:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:20:36.221999 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae70331-5c7b-41a0-b111-6baa7bec026b None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:36.267902 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:36.327100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae70331-5c7b-41a0-b111-6baa7bec026b None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:36.360695 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b02597-ed01-44dd-88e8-27f2971b96bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:36.361254 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b02597-ed01-44dd-88e8-27f2971b96bd None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:36.361542 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b02597-ed01-44dd-88e8-27f2971b96bd None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:36.361811 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b02597-ed01-44dd-88e8-27f2971b96bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:36.426326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b02597-ed01-44dd-88e8-27f2971b96bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:36.427799 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b02597-ed01-44dd-88e8-27f2971b96bd None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:36.468803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:36.525174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 577/1164] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:20:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:20:36.531514 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44216dd-8e29-4e55-8425-297eadad8690 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:36.607622 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:36.629400 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44216dd-8e29-4e55-8425-297eadad8690 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:36.661386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f5975-8062-4179-8353-d485206b1075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:36.662181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f5975-8062-4179-8353-d485206b1075 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:36.662468 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f5975-8062-4179-8353-d485206b1075 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:36.662746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f5975-8062-4179-8353-d485206b1075 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:36.669233 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f5975-8062-4179-8353-d485206b1075 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:36.670642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f5975-8062-4179-8353-d485206b1075 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:36.684930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-190f5975-8062-4179-8353-d485206b1075 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 19 15:20:36.684930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:20:36.684930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 15:20:36.684930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 15:20:36.684930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:20:36.684930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:20:36.684930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:20:36.684930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:20:36.684930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 19 15:20:36.684930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:20:36.684930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:20:36.684930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:20:36.684930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:20:36.684930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:20:36.684930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:20:36.684930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:20:36.684930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:20:36.686133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:20:36.686133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:20:36.686133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:20:36.686133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:20:36.686133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:20:36.686133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:20:36.686133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:20:36.686133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:20:36.686133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:20:36.686133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:20:36.686133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:20:36.686133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:20:36.686133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:20:36.686133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:20:36.686133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:20:36.686133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:20:36.687019 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:20:36.687019 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:20:36.687019 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:20:36.687019 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:20:36.687019 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:20:36.687019 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:20:36.687019 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:20:36.687019 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:20:36.687019 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:20:36.687019 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:20:36.687019 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 15:20:36.687019 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:20:36.687019 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 19 15:20:36.687019 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:20:36.687019 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 588/1165] 10.222.0.44 () {56 vars in 1117 bytes} [Tue Jul 19 15:20:36 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:20:36.692661 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b02597-ed01-44dd-88e8-27f2971b96bd None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:36.790031 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b02597-ed01-44dd-88e8-27f2971b96bd None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:36.824936 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e886a-cca0-4549-8a7d-54d6ee85d019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:36.825604 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e886a-cca0-4549-8a7d-54d6ee85d019 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:36.825885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e886a-cca0-4549-8a7d-54d6ee85d019 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:36.826168 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e886a-cca0-4549-8a7d-54d6ee85d019 None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:36.826901 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e886a-cca0-4549-8a7d-54d6ee85d019 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:20:36.827208 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e886a-cca0-4549-8a7d-54d6ee85d019 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:36.828728 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e886a-cca0-4549-8a7d-54d6ee85d019 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:36.836645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 578/1166] 10.222.0.44 () {56 vars in 1115 bytes} [Tue Jul 19 15:20:36 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:38.905147 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650c4e4-092e-4f35-bedf-71d64ba2b4b7 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:38.905704 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650c4e4-092e-4f35-bedf-71d64ba2b4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:38.905704 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650c4e4-092e-4f35-bedf-71d64ba2b4b7 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:38.907185 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 589/1167] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:20:38.912866 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934ccc0-4ef2-4b65-bb76-aa2c33d48211 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:38.913358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934ccc0-4ef2-4b65-bb76-aa2c33d48211 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:38.913473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934ccc0-4ef2-4b65-bb76-aa2c33d48211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:38.926580 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:38.932280 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-a934ccc0-4ef2-4b65-bb76-aa2c33d48211 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:20:38.933507 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-a934ccc0-4ef2-4b65-bb76-aa2c33d48211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:20:39.005393 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 579/1168] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:20:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:20:39.028712 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650c4e4-092e-4f35-bedf-71d64ba2b4b7 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:39.139349 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650c4e4-092e-4f35-bedf-71d64ba2b4b7 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:39.174248 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824b4f9-d8da-4295-b2bf-dbf507112fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:39.174908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824b4f9-d8da-4295-b2bf-dbf507112fd5 None admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:39.175197 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824b4f9-d8da-4295-b2bf-dbf507112fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:39.175505 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824b4f9-d8da-4295-b2bf-dbf507112fd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:39.176247 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824b4f9-d8da-4295-b2bf-dbf507112fd5 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:39.177604 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824b4f9-d8da-4295-b2bf-dbf507112fd5 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:39.186494 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:39.195565 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 590/1169] 10.222.0.44 () {60 vars in 1138 bytes} [Tue Jul 19 15:20:39 2022] POST /identity/v3/domains => generated 267 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:20:41.338969 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ee663-1508-4eb2-8b42-a01a9fb3c3ab None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:41.339593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ee663-1508-4eb2-8b42-a01a9fb3c3ab None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:41.339593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ee663-1508-4eb2-8b42-a01a9fb3c3ab None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:41.340909 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 580/1170] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:20:41.347020 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728c740-c30c-462d-b9e6-a87902f585ee None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:41.347574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728c740-c30c-462d-b9e6-a87902f585ee None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:41.347676 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728c740-c30c-462d-b9e6-a87902f585ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:41.364235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-a728c740-c30c-462d-b9e6-a87902f585ee None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:20:41.365451 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-a728c740-c30c-462d-b9e6-a87902f585ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:20:41.432991 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 591/1171] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:20:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:20:41.456882 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ee663-1508-4eb2-8b42-a01a9fb3c3ab None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:41.558240 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ee663-1508-4eb2-8b42-a01a9fb3c3ab None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:41.593155 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3555aa9-5426-4660-8958-be6721bb20b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:41.593955 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3555aa9-5426-4660-8958-be6721bb20b8 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:41.594241 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3555aa9-5426-4660-8958-be6721bb20b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:41.594516 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3555aa9-5426-4660-8958-be6721bb20b8 None admin] PATH_INFO: `/v3/domains/ac4d5a3bc7b94c948609b72afaf0510a` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:41.597613 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:41.606190 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3555aa9-5426-4660-8958-be6721bb20b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ac4d5a3bc7b94c948609b72afaf0510a)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:41.607675 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3555aa9-5426-4660-8958-be6721bb20b8 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:41.609438 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 581/1172] 10.222.0.44 () {56 vars in 1183 bytes} [Tue Jul 19 15:20:41 2022] GET /identity/v3/domains/ac4d5a3bc7b94c948609b72afaf0510a => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:41.615347 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728c740-c30c-462d-b9e6-a87902f585ee None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:41.714784 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728c740-c30c-462d-b9e6-a87902f585ee None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:41.742871 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:41.755935 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3fd61-de35-4577-b52f-b0b3e5744d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:41.756622 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3fd61-de35-4577-b52f-b0b3e5744d63 None admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:41.756909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3fd61-de35-4577-b52f-b0b3e5744d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:41.757200 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3fd61-de35-4577-b52f-b0b3e5744d63 None admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:41.757936 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e3fd61-de35-4577-b52f-b0b3e5744d63 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:41.759398 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e3fd61-de35-4577-b52f-b0b3e5744d63 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:41.788640 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 592/1173] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jul 19 15:20:41 2022] POST /identity/v3/projects => generated 361 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:20:43.876357 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ce46e-0fe3-4a0b-be57-f55d34564053 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:43.876988 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ce46e-0fe3-4a0b-be57-f55d34564053 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:43.876988 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ce46e-0fe3-4a0b-be57-f55d34564053 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:43.878301 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 582/1174] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:20:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:20:43.884336 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a29dd3-9adc-4b37-af96-75fab7046a6a None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:43.884935 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a29dd3-9adc-4b37-af96-75fab7046a6a None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:43.884935 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a29dd3-9adc-4b37-af96-75fab7046a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:43.903164 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-31a29dd3-9adc-4b37-af96-75fab7046a6a None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:20:43.904706 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-31a29dd3-9adc-4b37-af96-75fab7046a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:20:43.981216 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 593/1175] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:20:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:20:44.006480 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ce46e-0fe3-4a0b-be57-f55d34564053 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:44.125862 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ce46e-0fe3-4a0b-be57-f55d34564053 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:44.162129 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e6337-7dae-473d-990c-16135f5e75d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:44.162983 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e6337-7dae-473d-990c-16135f5e75d7 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:44.163388 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e6337-7dae-473d-990c-16135f5e75d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:44.163579 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e6337-7dae-473d-990c-16135f5e75d7 None admin] PATH_INFO: `/v3/domains/ac4d5a3bc7b94c948609b72afaf0510a` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:44.164816 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e6337-7dae-473d-990c-16135f5e75d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ac4d5a3bc7b94c948609b72afaf0510a)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:44.166270 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e6337-7dae-473d-990c-16135f5e75d7 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:44.168002 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 583/1176] 10.222.0.44 () {56 vars in 1183 bytes} [Tue Jul 19 15:20:44 2022] GET /identity/v3/domains/ac4d5a3bc7b94c948609b72afaf0510a => generated 267 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:44.173957 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a29dd3-9adc-4b37-af96-75fab7046a6a None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:44.273097 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a29dd3-9adc-4b37-af96-75fab7046a6a None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:44.284752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:44.309347 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f697a-5f1c-4b79-98de-fbc090356b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:44.310029 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f697a-5f1c-4b79-98de-fbc090356b01 None admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:44.310317 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f697a-5f1c-4b79-98de-fbc090356b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:44.310598 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f697a-5f1c-4b79-98de-fbc090356b01 None admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:44.311375 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f697a-5f1c-4b79-98de-fbc090356b01 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:44.312885 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f697a-5f1c-4b79-98de-fbc090356b01 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:44.336530 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 594/1177] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jul 19 15:20:44 2022] POST /identity/v3/users => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:20:46.423539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175655d0-a21d-40a5-80ab-87908f6d6bae None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:46.424110 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175655d0-a21d-40a5-80ab-87908f6d6bae None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:46.424110 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175655d0-a21d-40a5-80ab-87908f6d6bae None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:46.425447 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 584/1178] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:20:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:20:46.430813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f43067-9393-4616-a293-81268d48d06c None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:46.431296 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f43067-9393-4616-a293-81268d48d06c None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:46.431419 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f43067-9393-4616-a293-81268d48d06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:46.448635 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-c4f43067-9393-4616-a293-81268d48d06c None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:20:46.449846 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-c4f43067-9393-4616-a293-81268d48d06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:20:46.516339 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 595/1179] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:20:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:20:46.539591 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175655d0-a21d-40a5-80ab-87908f6d6bae None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:46.600345 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:46.638024 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175655d0-a21d-40a5-80ab-87908f6d6bae None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:46.670086 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f076a-3e6b-4bea-877d-63d6cea7e769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:46.670855 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f076a-3e6b-4bea-877d-63d6cea7e769 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:46.671137 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f076a-3e6b-4bea-877d-63d6cea7e769 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:46.671952 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f076a-3e6b-4bea-877d-63d6cea7e769 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:46.681787 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f076a-3e6b-4bea-877d-63d6cea7e769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:20:46.689849 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-ce8f076a-3e6b-4bea-877d-63d6cea7e769 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:20:46.689849 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:20:46.689849 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:20:46.689849 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:20:46.689849 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:20:46.689849 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:20:46.689849 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:20:46.689849 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:20:46.689849 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:20:46.689849 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:20:46.689849 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:20:46.689849 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:20:46.689849 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:20:46.689849 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:20:46.689849 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:20:46.689849 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:20:46.691022 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:20:46.691022 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:20:46.691022 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:20:46.691022 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:20:46.691022 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:20:46.691022 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:20:46.691022 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:20:46.691022 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:20:46.691022 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:20:46.691022 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:20:46.691022 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:20:46.691022 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:20:46.691022 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:20:46.691022 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:20:46.691022 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:20:46.691022 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:20:46.692027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:20:46.692027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:20:46.692027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:20:46.692027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:20:46.692027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:20:46.692027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:20:46.692027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:20:46.692027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:20:46.692027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:20:46.692027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:20:46.692027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:20:46.692027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:20:46.692027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 585/1180] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:20:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:20:46.697172 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f43067-9393-4616-a293-81268d48d06c None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:46.785779 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:46.792294 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f43067-9393-4616-a293-81268d48d06c None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:46.825048 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49a745-923a-4bf9-92d3-3ae53c444675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:46.825721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49a745-923a-4bf9-92d3-3ae53c444675 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:46.826002 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49a745-923a-4bf9-92d3-3ae53c444675 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:46.826278 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49a745-923a-4bf9-92d3-3ae53c444675 None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:46.827026 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49a745-923a-4bf9-92d3-3ae53c444675 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:20:46.827375 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49a745-923a-4bf9-92d3-3ae53c444675 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:46.828755 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49a745-923a-4bf9-92d3-3ae53c444675 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:46.837352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 596/1181] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:20:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:46.843141 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f076a-3e6b-4bea-877d-63d6cea7e769 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:46.944563 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f076a-3e6b-4bea-877d-63d6cea7e769 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:46.972117 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:46.983289 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087ad63-75e9-4401-80d8-b50359afdf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:46.984808 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087ad63-75e9-4401-80d8-b50359afdf35 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:46.985095 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087ad63-75e9-4401-80d8-b50359afdf35 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:46.985376 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087ad63-75e9-4401-80d8-b50359afdf35 None admin] PATH_INFO: `/v3/users/6811cad0fe8c4badaa648936a3032c52` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:46.998973 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087ad63-75e9-4401-80d8-b50359afdf35 None admin] RBAC: Authorizing `identity:get_user(user_id=6811cad0fe8c4badaa648936a3032c52)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:47.000467 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087ad63-75e9-4401-80d8-b50359afdf35 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:47.002217 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 586/1182] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:20:46 2022] GET /identity/v3/users/6811cad0fe8c4badaa648936a3032c52 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:47.008026 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49a745-923a-4bf9-92d3-3ae53c444675 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:47.109052 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49a745-923a-4bf9-92d3-3ae53c444675 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:47.142480 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a42a28-f18d-4ec1-9871-f4cb162ab441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:47.143124 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a42a28-f18d-4ec1-9871-f4cb162ab441 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:47.143441 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a42a28-f18d-4ec1-9871-f4cb162ab441 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:47.143721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a42a28-f18d-4ec1-9871-f4cb162ab441 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:47.170375 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:47.211003 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a42a28-f18d-4ec1-9871-f4cb162ab441 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:47.212398 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a42a28-f18d-4ec1-9871-f4cb162ab441 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:47.311912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 597/1183] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:20:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:20:47.318046 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087ad63-75e9-4401-80d8-b50359afdf35 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:47.416279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087ad63-75e9-4401-80d8-b50359afdf35 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:47.448537 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb746f-72e6-431d-9078-f6467fe7076b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:47.449376 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb746f-72e6-431d-9078-f6467fe7076b None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:47.449654 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb746f-72e6-431d-9078-f6467fe7076b None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:47.449926 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb746f-72e6-431d-9078-f6467fe7076b None admin] PATH_INFO: `/v3/projects/6476f594068a4bd6a3f595838ea5b969` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:47.451078 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb746f-72e6-431d-9078-f6467fe7076b None admin] RBAC: Authorizing `identity:get_project(project_id=6476f594068a4bd6a3f595838ea5b969)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:47.452525 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb746f-72e6-431d-9078-f6467fe7076b None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:47.454858 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 587/1184] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:20:47 2022] GET /identity/v3/projects/6476f594068a4bd6a3f595838ea5b969 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:47.461470 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a42a28-f18d-4ec1-9871-f4cb162ab441 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:47.519906 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:47.562666 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a42a28-f18d-4ec1-9871-f4cb162ab441 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:47.597615 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3b885-b74f-4c2c-bf65-c6000b760c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:47.598275 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3b885-b74f-4c2c-bf65-c6000b760c10 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:47.598567 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3b885-b74f-4c2c-bf65-c6000b760c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:47.598852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3b885-b74f-4c2c-bf65-c6000b760c10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:47.599720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a3b885-b74f-4c2c-bf65-c6000b760c10 None admin] RBAC: Adding query filter params (role.id=d884ddf33c1440d9b3a3351b85e83e76, scope.project.id=6476f594068a4bd6a3f595838ea5b969, user.id=6811cad0fe8c4badaa648936a3032c52) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:20:47.600040 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a3b885-b74f-4c2c-bf65-c6000b760c10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:47.601478 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a3b885-b74f-4c2c-bf65-c6000b760c10 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:47.607607 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 598/1185] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:20:47 2022] GET /identity/v3/role_assignments?user.id=6811cad0fe8c4badaa648936a3032c52&scope.project.id=6476f594068a4bd6a3f595838ea5b969&role.id=d884ddf33c1440d9b3a3351b85e83e76 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:49.609207 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d50a01-77af-4850-92b0-7a22293875f1 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:49.609768 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d50a01-77af-4850-92b0-7a22293875f1 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:49.609768 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d50a01-77af-4850-92b0-7a22293875f1 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:49.611117 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 588/1186] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:20:49.616230 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efc07d-9b36-47bf-ab35-4052e9bd0154 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:49.616627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efc07d-9b36-47bf-ab35-4052e9bd0154 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:49.616795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efc07d-9b36-47bf-ab35-4052e9bd0154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:49.632987 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-d5efc07d-9b36-47bf-ab35-4052e9bd0154 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:20:49.634163 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-d5efc07d-9b36-47bf-ab35-4052e9bd0154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:20:49.697746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 599/1187] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:20:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:20:49.720898 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d50a01-77af-4850-92b0-7a22293875f1 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:49.772585 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:49.839017 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d50a01-77af-4850-92b0-7a22293875f1 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:49.875119 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b454f9-5b7a-4054-8bb9-d361c87427a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:49.875970 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b454f9-5b7a-4054-8bb9-d361c87427a3 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:49.876140 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b454f9-5b7a-4054-8bb9-d361c87427a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:49.876421 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b454f9-5b7a-4054-8bb9-d361c87427a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:49.886990 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b454f9-5b7a-4054-8bb9-d361c87427a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:20:49.895412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-65b454f9-5b7a-4054-8bb9-d361c87427a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:20:49.895412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:20:49.895412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:20:49.895412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:20:49.895412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:20:49.895412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:20:49.895412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:20:49.895412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:20:49.895412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:20:49.895412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:20:49.895412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:20:49.895412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:20:49.895412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:20:49.895412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:20:49.895412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:20:49.895412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:20:49.896558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:20:49.896558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:20:49.896558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:20:49.896558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:20:49.896558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:20:49.896558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:20:49.896558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:20:49.896558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:20:49.896558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:20:49.896558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:20:49.896558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:20:49.896558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:20:49.896558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:20:49.896558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:20:49.896558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:20:49.896558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:20:49.897628 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:20:49.897628 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:20:49.897628 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:20:49.897628 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:20:49.897628 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:20:49.897628 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:20:49.897628 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:20:49.897628 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:20:49.897628 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:20:49.897628 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:20:49.897628 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:20:49.897628 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:20:49.897628 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 589/1188] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:20:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:20:49.902801 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efc07d-9b36-47bf-ab35-4052e9bd0154 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:49.956418 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:50.002680 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efc07d-9b36-47bf-ab35-4052e9bd0154 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:50.036910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27291667-6098-41eb-8440-9f6c6af242e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:50.037578 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27291667-6098-41eb-8440-9f6c6af242e9 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:50.037866 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27291667-6098-41eb-8440-9f6c6af242e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:50.038147 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27291667-6098-41eb-8440-9f6c6af242e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:50.038896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27291667-6098-41eb-8440-9f6c6af242e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:20:50.039208 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27291667-6098-41eb-8440-9f6c6af242e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:50.040594 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27291667-6098-41eb-8440-9f6c6af242e9 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:50.049880 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 600/1189] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:20:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:50.055804 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b454f9-5b7a-4054-8bb9-d361c87427a3 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:50.154908 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b454f9-5b7a-4054-8bb9-d361c87427a3 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:50.165285 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:50.190156 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa7de7-b0f0-4406-9271-19b1bdd63bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:50.191033 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa7de7-b0f0-4406-9271-19b1bdd63bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:50.191349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa7de7-b0f0-4406-9271-19b1bdd63bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:50.191630 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa7de7-b0f0-4406-9271-19b1bdd63bb3 None admin] PATH_INFO: `/v3/users/6811cad0fe8c4badaa648936a3032c52` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:50.192837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa7de7-b0f0-4406-9271-19b1bdd63bb3 None admin] RBAC: Authorizing `identity:get_user(user_id=6811cad0fe8c4badaa648936a3032c52)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:50.194267 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa7de7-b0f0-4406-9271-19b1bdd63bb3 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:50.195950 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 590/1190] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:20:50 2022] GET /identity/v3/users/6811cad0fe8c4badaa648936a3032c52 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:50.201985 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27291667-6098-41eb-8440-9f6c6af242e9 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:50.303110 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27291667-6098-41eb-8440-9f6c6af242e9 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:50.317444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:50.338985 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b5859-c6f5-439e-b822-b729ec422999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:50.339895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b5859-c6f5-439e-b822-b729ec422999 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:50.340182 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b5859-c6f5-439e-b822-b729ec422999 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:50.340466 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b5859-c6f5-439e-b822-b729ec422999 None admin] PATH_INFO: `/v3/projects/6476f594068a4bd6a3f595838ea5b969` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:50.341673 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b5859-c6f5-439e-b822-b729ec422999 None admin] RBAC: Authorizing `identity:get_project(project_id=6476f594068a4bd6a3f595838ea5b969)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:50.343131 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b5859-c6f5-439e-b822-b729ec422999 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:50.344891 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 601/1191] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:20:50 2022] GET /identity/v3/projects/6476f594068a4bd6a3f595838ea5b969 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:50.350987 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa7de7-b0f0-4406-9271-19b1bdd63bb3 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:50.447913 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa7de7-b0f0-4406-9271-19b1bdd63bb3 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:50.480705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4599f3-5fa8-4c8b-a20e-70d540cf4587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:50.481581 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4599f3-5fa8-4c8b-a20e-70d540cf4587 None admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:50.481861 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4599f3-5fa8-4c8b-a20e-70d540cf4587 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:50.482132 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4599f3-5fa8-4c8b-a20e-70d540cf4587 None admin] PATH_INFO: `/v3/projects/6476f594068a4bd6a3f595838ea5b969/users/6811cad0fe8c4badaa648936a3032c52/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:50.484623 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4599f3-5fa8-4c8b-a20e-70d540cf4587 None admin] RBAC: Authorizing `identity:create_grant(project_id=6476f594068a4bd6a3f595838ea5b969, user_id=6811cad0fe8c4badaa648936a3032c52, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:50.486018 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4599f3-5fa8-4c8b-a20e-70d540cf4587 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:50.498453 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 591/1192] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 19 15:20:50 2022] PUT /identity/v3/projects/6476f594068a4bd6a3f595838ea5b969/users/6811cad0fe8c4badaa648936a3032c52/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:20:52.525655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f673125-7f43-4a17-8c44-00a8fed29070 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:52.526235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f673125-7f43-4a17-8c44-00a8fed29070 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:52.526235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f673125-7f43-4a17-8c44-00a8fed29070 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:52.527603 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 602/1193] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:20:52.533923 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66b22a-84c6-4c77-ab38-cbefe720af0d None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:52.534386 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66b22a-84c6-4c77-ab38-cbefe720af0d None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:52.534493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66b22a-84c6-4c77-ab38-cbefe720af0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:52.552001 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-6d66b22a-84c6-4c77-ab38-cbefe720af0d None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:20:52.553240 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-6d66b22a-84c6-4c77-ab38-cbefe720af0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:20:52.585250 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:52.650071 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 592/1194] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:20:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:20:52.674110 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f673125-7f43-4a17-8c44-00a8fed29070 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:52.779334 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f673125-7f43-4a17-8c44-00a8fed29070 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:52.814000 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d8da9-baa1-4af4-832f-ef68de2dcbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:52.814789 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d8da9-baa1-4af4-832f-ef68de2dcbb5 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:52.815075 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d8da9-baa1-4af4-832f-ef68de2dcbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:52.815383 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d8da9-baa1-4af4-832f-ef68de2dcbb5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:52.826681 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d8da9-baa1-4af4-832f-ef68de2dcbb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:20:52.834958 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-669d8da9-baa1-4af4-832f-ef68de2dcbb5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:20:52.834958 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:20:52.834958 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:20:52.834958 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:20:52.834958 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:20:52.834958 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:20:52.834958 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:20:52.834958 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:20:52.834958 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:20:52.834958 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:20:52.834958 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:20:52.834958 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:20:52.834958 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:20:52.834958 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:20:52.834958 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:20:52.834958 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:20:52.835978 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:20:52.835978 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:20:52.835978 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:20:52.835978 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:20:52.835978 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:20:52.835978 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:20:52.835978 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:20:52.835978 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:20:52.835978 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:20:52.835978 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:20:52.835978 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:20:52.835978 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:20:52.835978 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:20:52.835978 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:20:52.835978 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:20:52.835978 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:20:52.836937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:20:52.836937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:20:52.836937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:20:52.836937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:20:52.836937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:20:52.836937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:20:52.836937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:20:52.836937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:20:52.836937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:20:52.836937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:20:52.836937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:20:52.836937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:20:52.836937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 603/1195] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:20:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:20:52.842433 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66b22a-84c6-4c77-ab38-cbefe720af0d None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:52.949766 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66b22a-84c6-4c77-ab38-cbefe720af0d None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:52.984969 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c37a4b-d12d-4d35-aa2e-73b7b1daf5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:52.985644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c37a4b-d12d-4d35-aa2e-73b7b1daf5db None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:52.985930 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c37a4b-d12d-4d35-aa2e-73b7b1daf5db None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:52.986210 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c37a4b-d12d-4d35-aa2e-73b7b1daf5db None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:52.986970 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c37a4b-d12d-4d35-aa2e-73b7b1daf5db None admin] RBAC: Adding query filter params (name=admin) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:20:52.987314 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c37a4b-d12d-4d35-aa2e-73b7b1daf5db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:52.988687 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c37a4b-d12d-4d35-aa2e-73b7b1daf5db None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:52.997289 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 593/1196] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:20:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:53.003953 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d8da9-baa1-4af4-832f-ef68de2dcbb5 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:53.063324 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:53.120070 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d8da9-baa1-4af4-832f-ef68de2dcbb5 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:53.154893 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe6fad-3b31-4315-9ece-a1d912ce975f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:53.155833 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe6fad-3b31-4315-9ece-a1d912ce975f None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:53.156124 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe6fad-3b31-4315-9ece-a1d912ce975f None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:53.156402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe6fad-3b31-4315-9ece-a1d912ce975f None admin] PATH_INFO: `/v3/users/6811cad0fe8c4badaa648936a3032c52` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:53.157638 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe6fad-3b31-4315-9ece-a1d912ce975f None admin] RBAC: Authorizing `identity:get_user(user_id=6811cad0fe8c4badaa648936a3032c52)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:53.159066 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe6fad-3b31-4315-9ece-a1d912ce975f None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:53.160769 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 604/1197] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jul 19 15:20:53 2022] GET /identity/v3/users/6811cad0fe8c4badaa648936a3032c52 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:53.166752 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c37a4b-d12d-4d35-aa2e-73b7b1daf5db None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:53.198784 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:53.274657 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c37a4b-d12d-4d35-aa2e-73b7b1daf5db None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:53.310342 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192dcf1-c0f9-47ab-a4eb-f28c51c82cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:53.311135 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192dcf1-c0f9-47ab-a4eb-f28c51c82cbe None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:53.311576 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192dcf1-c0f9-47ab-a4eb-f28c51c82cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:53.312020 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192dcf1-c0f9-47ab-a4eb-f28c51c82cbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:53.378770 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192dcf1-c0f9-47ab-a4eb-f28c51c82cbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:53.380403 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192dcf1-c0f9-47ab-a4eb-f28c51c82cbe None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:53.409605 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:53.476844 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 594/1198] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:20:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:20:53.482872 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe6fad-3b31-4315-9ece-a1d912ce975f None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:53.582018 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe6fad-3b31-4315-9ece-a1d912ce975f None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:53.591905 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:53.616399 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44185d1c-08f1-4c98-9166-0f2c3bec4e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:53.617252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44185d1c-08f1-4c98-9166-0f2c3bec4e36 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:53.617536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44185d1c-08f1-4c98-9166-0f2c3bec4e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:53.617809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44185d1c-08f1-4c98-9166-0f2c3bec4e36 None admin] PATH_INFO: `/v3/projects/6476f594068a4bd6a3f595838ea5b969` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:53.619181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44185d1c-08f1-4c98-9166-0f2c3bec4e36 None admin] RBAC: Authorizing `identity:get_project(project_id=6476f594068a4bd6a3f595838ea5b969)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:53.620879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44185d1c-08f1-4c98-9166-0f2c3bec4e36 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:53.622599 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 605/1199] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jul 19 15:20:53 2022] GET /identity/v3/projects/6476f594068a4bd6a3f595838ea5b969 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:20:53.629458 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192dcf1-c0f9-47ab-a4eb-f28c51c82cbe None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:53.726767 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192dcf1-c0f9-47ab-a4eb-f28c51c82cbe None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:53.755092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:53.761082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7281ed4a-b6b0-45b0-ba90-7e67f315cc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:53.761736 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281ed4a-b6b0-45b0-ba90-7e67f315cc6e None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:53.762022 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281ed4a-b6b0-45b0-ba90-7e67f315cc6e None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:53.762306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281ed4a-b6b0-45b0-ba90-7e67f315cc6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:53.763147 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7281ed4a-b6b0-45b0-ba90-7e67f315cc6e None admin] RBAC: Adding query filter params (role.id=d884ddf33c1440d9b3a3351b85e83e76, scope.project.id=6476f594068a4bd6a3f595838ea5b969, user.id=6811cad0fe8c4badaa648936a3032c52) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:20:53.763488 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7281ed4a-b6b0-45b0-ba90-7e67f315cc6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:53.765454 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7281ed4a-b6b0-45b0-ba90-7e67f315cc6e None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:53.771417 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 595/1200] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:20:53 2022] GET /identity/v3/role_assignments?user.id=6811cad0fe8c4badaa648936a3032c52&scope.project.id=6476f594068a4bd6a3f595838ea5b969&role.id=d884ddf33c1440d9b3a3351b85e83e76 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:21:03.611906 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=11 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:21:03.768638 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:21:49.726952 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d665a6-ff33-41c7-8193-1d991ff4e8b3 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:49.727781 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d665a6-ff33-41c7-8193-1d991ff4e8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:49.727781 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d665a6-ff33-41c7-8193-1d991ff4e8b3 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:49.728975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 606/1201] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:21:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:21:49.737413 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cf05f-db61-4ffc-8798-468d0a3e6676 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:49.737982 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cf05f-db61-4ffc-8798-468d0a3e6676 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:49.738225 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cf05f-db61-4ffc-8798-468d0a3e6676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:49.759382 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-8d8cf05f-db61-4ffc-8798-468d0a3e6676 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:21:49.760974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-8d8cf05f-db61-4ffc-8798-468d0a3e6676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:21:49.875190 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 596/1202] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:21:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 15:21:49.903371 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d665a6-ff33-41c7-8193-1d991ff4e8b3 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:50.040669 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d665a6-ff33-41c7-8193-1d991ff4e8b3 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:50.088876 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe6304-d702-4a2b-acc7-53bc8ae985dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:50.089738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe6304-d702-4a2b-acc7-53bc8ae985dd None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:50.090170 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe6304-d702-4a2b-acc7-53bc8ae985dd None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:50.090556 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe6304-d702-4a2b-acc7-53bc8ae985dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:50.102491 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe6304-d702-4a2b-acc7-53bc8ae985dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:50.103992 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe6304-d702-4a2b-acc7-53bc8ae985dd None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:50.123099 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-acfe6304-d702-4a2b-acc7-53bc8ae985dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:21:50.123099 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:21:50.123099 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:21:50.123099 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:21:50.123099 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:21:50.123099 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:21:50.123099 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:21:50.123099 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:21:50.123099 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:21:50.123099 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:21:50.123099 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:21:50.123099 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:21:50.123099 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:21:50.123099 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:21:50.123099 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:21:50.124225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:21:50.124225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:21:50.124225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:21:50.124225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:21:50.124225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:21:50.124225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:21:50.124225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:21:50.124225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:21:50.124225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:21:50.124225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:21:50.124225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:21:50.124225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:21:50.124225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:21:50.124225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:21:50.124225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:21:50.124225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:21:50.124225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:21:50.125202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:21:50.125202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:21:50.125202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:21:50.125202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:21:50.125202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 607/1203] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:21:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:21:50.131213 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cf05f-db61-4ffc-8798-468d0a3e6676 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:50.273382 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cf05f-db61-4ffc-8798-468d0a3e6676 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:50.311872 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:21:50.321196 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f686df4-b62e-47a4-89cb-41d38642855a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:50.322513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f686df4-b62e-47a4-89cb-41d38642855a None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:50.322513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f686df4-b62e-47a4-89cb-41d38642855a None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:50.322513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f686df4-b62e-47a4-89cb-41d38642855a None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:50.323139 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f686df4-b62e-47a4-89cb-41d38642855a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:21:50.323485 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f686df4-b62e-47a4-89cb-41d38642855a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:50.325086 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f686df4-b62e-47a4-89cb-41d38642855a None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:50.343180 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 597/1204] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:21:50.344217 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe6304-d702-4a2b-acc7-53bc8ae985dd None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:50.420385 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:21:50.493303 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe6304-d702-4a2b-acc7-53bc8ae985dd None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:50.537931 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52a1ab-6870-4adb-9e92-9582880cfb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:50.538639 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52a1ab-6870-4adb-9e92-9582880cfb92 None admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:50.538985 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52a1ab-6870-4adb-9e92-9582880cfb92 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:50.539303 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52a1ab-6870-4adb-9e92-9582880cfb92 None admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:50.540120 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52a1ab-6870-4adb-9e92-9582880cfb92 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:50.541715 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52a1ab-6870-4adb-9e92-9582880cfb92 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:50.570599 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 608/1205] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jul 19 15:21:50 2022] POST /identity/v3/users => generated 251 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:21:52.891728 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39e430-5ec4-4fb6-a72d-d99af187f0d1 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:52.892319 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39e430-5ec4-4fb6-a72d-d99af187f0d1 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:52.892319 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39e430-5ec4-4fb6-a72d-d99af187f0d1 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:52.893659 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 598/1206] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:21:52.899179 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bd1c6-0400-4b99-b07f-0a67fbbdff09 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:52.899697 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bd1c6-0400-4b99-b07f-0a67fbbdff09 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:52.899790 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bd1c6-0400-4b99-b07f-0a67fbbdff09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:52.922454 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-ec5bd1c6-0400-4b99-b07f-0a67fbbdff09 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:21:52.924091 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-ec5bd1c6-0400-4b99-b07f-0a67fbbdff09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:21:53.011535 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 609/1207] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:21:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:21:53.038081 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39e430-5ec4-4fb6-a72d-d99af187f0d1 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:53.163541 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39e430-5ec4-4fb6-a72d-d99af187f0d1 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:53.204621 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe4637-591c-476f-b188-1eb8df7abe41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:53.205641 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe4637-591c-476f-b188-1eb8df7abe41 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:53.205990 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe4637-591c-476f-b188-1eb8df7abe41 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:53.206312 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe4637-591c-476f-b188-1eb8df7abe41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:53.219190 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe4637-591c-476f-b188-1eb8df7abe41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:21:53.227744 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-86fe4637-591c-476f-b188-1eb8df7abe41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:21:53.227744 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:21:53.227744 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:21:53.227744 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:21:53.227744 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:21:53.227744 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:21:53.227744 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:21:53.227744 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:21:53.227744 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:21:53.227744 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:21:53.227744 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:21:53.227744 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:21:53.227744 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:21:53.227744 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:21:53.227744 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:21:53.227744 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:21:53.228777 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:21:53.228777 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:21:53.228777 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:21:53.228777 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:21:53.228777 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:21:53.228777 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:21:53.228777 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:21:53.228777 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:21:53.228777 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:21:53.228777 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:21:53.228777 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:21:53.228777 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:21:53.228777 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:21:53.228777 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:21:53.228777 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:21:53.228777 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:21:53.229654 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:21:53.229654 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:21:53.229654 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:21:53.229654 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:21:53.229654 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:21:53.229654 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:21:53.229654 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:21:53.229654 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:21:53.229654 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:21:53.229654 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:21:53.229654 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:21:53.229654 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:21:53.233825 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 599/1208] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 19 15:21:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:21:53.235743 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bd1c6-0400-4b99-b07f-0a67fbbdff09 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:53.285471 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:21:53.359882 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bd1c6-0400-4b99-b07f-0a67fbbdff09 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:53.409358 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b492e-12ff-4fe4-bb35-572aa93be2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:53.410393 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b492e-12ff-4fe4-bb35-572aa93be2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:53.410756 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b492e-12ff-4fe4-bb35-572aa93be2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:53.411133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b492e-12ff-4fe4-bb35-572aa93be2a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:53.412005 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b492e-12ff-4fe4-bb35-572aa93be2a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:21:53.412482 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b492e-12ff-4fe4-bb35-572aa93be2a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:53.415753 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b492e-12ff-4fe4-bb35-572aa93be2a6 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:53.431079 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 610/1209] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 19 15:21:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:21:53.437885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe4637-591c-476f-b188-1eb8df7abe41 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:53.494282 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:21:53.550003 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe4637-591c-476f-b188-1eb8df7abe41 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:53.594382 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72884577-2db7-4c44-96ed-cdc9f2cfbbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:53.595237 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72884577-2db7-4c44-96ed-cdc9f2cfbbc4 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:53.595532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72884577-2db7-4c44-96ed-cdc9f2cfbbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:53.595813 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72884577-2db7-4c44-96ed-cdc9f2cfbbc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:53.609286 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72884577-2db7-4c44-96ed-cdc9f2cfbbc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:53.611567 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72884577-2db7-4c44-96ed-cdc9f2cfbbc4 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:53.631198 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-72884577-2db7-4c44-96ed-cdc9f2cfbbc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:21:53.631198 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:21:53.631198 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:21:53.631198 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:21:53.631198 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:21:53.631198 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:21:53.631198 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:21:53.631198 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:21:53.631198 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:21:53.631198 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:21:53.631198 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:21:53.631198 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:21:53.631198 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:21:53.631198 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:21:53.631198 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:21:53.632255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:21:53.632255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:21:53.632255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:21:53.632255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:21:53.632255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:21:53.632255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:21:53.632255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:21:53.632255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:21:53.632255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:21:53.632255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:21:53.632255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:21:53.632255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:21:53.632255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:21:53.632255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:21:53.632255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:21:53.632255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:21:53.632255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:21:53.633809 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:21:53.633809 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:21:53.633809 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:21:53.633809 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:21:53.633809 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 600/1210] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:21:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:21:53.638266 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b492e-12ff-4fe4-bb35-572aa93be2a6 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:53.757057 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:21:53.760634 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b492e-12ff-4fe4-bb35-572aa93be2a6 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:53.799569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33609a-18a3-42fb-8541-e42dca03123a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:53.800258 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33609a-18a3-42fb-8541-e42dca03123a None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:53.800549 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33609a-18a3-42fb-8541-e42dca03123a None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:53.800827 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33609a-18a3-42fb-8541-e42dca03123a None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:53.805937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33609a-18a3-42fb-8541-e42dca03123a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:21:53.805937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33609a-18a3-42fb-8541-e42dca03123a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:53.805937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33609a-18a3-42fb-8541-e42dca03123a None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:53.819994 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 611/1211] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:21:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:21:53.825676 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72884577-2db7-4c44-96ed-cdc9f2cfbbc4 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:53.943681 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72884577-2db7-4c44-96ed-cdc9f2cfbbc4 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:53.945410 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:21:53.984416 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dda7c2-566d-4bed-8f43-0d11ab97ec07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:53.985226 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dda7c2-566d-4bed-8f43-0d11ab97ec07 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:53.985504 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dda7c2-566d-4bed-8f43-0d11ab97ec07 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:53.985776 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dda7c2-566d-4bed-8f43-0d11ab97ec07 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:53.994636 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dda7c2-566d-4bed-8f43-0d11ab97ec07 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:53.996667 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dda7c2-566d-4bed-8f43-0d11ab97ec07 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:54.015593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-57dda7c2-566d-4bed-8f43-0d11ab97ec07 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 15:21:54.015593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:21:54.015593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:21:54.015593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:21:54.015593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:21:54.015593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:21:54.015593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:21:54.015593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:21:54.015593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:21:54.015593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:21:54.015593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:21:54.015593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:21:54.015593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:21:54.015593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:21:54.015593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:21:54.015593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:21:54.019851 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:21:54.019851 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:21:54.019851 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:21:54.019851 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:21:54.019851 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:21:54.019851 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:21:54.019851 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:21:54.019851 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:21:54.019851 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:21:54.019851 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:21:54.019851 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:21:54.019851 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:21:54.019851 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:21:54.019851 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:21:54.019851 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:21:54.019851 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:21:54.019851 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:21:54.019851 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:21:54.021150 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:21:54.021150 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:21:54.021150 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:21:54.021150 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:21:54.021150 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:21:54.021150 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:21:54.021150 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:21:54.021150 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:21:54.021150 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 15:21:54.021150 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:21:54.021150 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 601/1212] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:21:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:21:54.021782 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33609a-18a3-42fb-8541-e42dca03123a None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:54.132517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33609a-18a3-42fb-8541-e42dca03123a None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:54.173501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fcea2-637d-48b8-b152-1186b5bd6e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:54.174551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fcea2-637d-48b8-b152-1186b5bd6e2f None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:54.174889 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fcea2-637d-48b8-b152-1186b5bd6e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:54.175213 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fcea2-637d-48b8-b152-1186b5bd6e2f None admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:54.176139 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fcea2-637d-48b8-b152-1186b5bd6e2f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:21:54.176497 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fcea2-637d-48b8-b152-1186b5bd6e2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:54.178048 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fcea2-637d-48b8-b152-1186b5bd6e2f None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:54.199652 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 612/1213] 10.222.0.44 () {56 vars in 1143 bytes} [Tue Jul 19 15:21:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:21:54.205957 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dda7c2-566d-4bed-8f43-0d11ab97ec07 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:54.325011 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dda7c2-566d-4bed-8f43-0d11ab97ec07 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:54.371836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38048a1-240d-4d39-8066-829281f032a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:54.373225 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38048a1-240d-4d39-8066-829281f032a9 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:54.373511 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38048a1-240d-4d39-8066-829281f032a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:54.373786 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38048a1-240d-4d39-8066-829281f032a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:54.415528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:21:54.463698 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38048a1-240d-4d39-8066-829281f032a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:54.465925 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38048a1-240d-4d39-8066-829281f032a9 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:54.602775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 602/1214] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:21:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:21:54.609959 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fcea2-637d-48b8-b152-1186b5bd6e2f None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:54.639462 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:21:54.759163 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fcea2-637d-48b8-b152-1186b5bd6e2f None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:54.800776 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef1669-ba03-4023-af11-eb7570104bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:54.801840 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef1669-ba03-4023-af11-eb7570104bab None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:54.802290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef1669-ba03-4023-af11-eb7570104bab None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:54.802747 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef1669-ba03-4023-af11-eb7570104bab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:54.814641 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef1669-ba03-4023-af11-eb7570104bab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:54.816373 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef1669-ba03-4023-af11-eb7570104bab None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:54.836379 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-48ef1669-ba03-4023-af11-eb7570104bab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:21:54.836379 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:21:54.836379 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:21:54.836379 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:21:54.836379 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:21:54.836379 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:21:54.836379 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:21:54.836379 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:21:54.836379 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:21:54.836379 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:21:54.836379 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:21:54.836379 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:21:54.836379 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:21:54.836379 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:21:54.836379 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:21:54.837539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:21:54.837539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:21:54.837539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:21:54.837539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:21:54.837539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:21:54.837539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:21:54.837539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:21:54.837539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:21:54.837539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:21:54.837539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:21:54.837539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:21:54.837539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:21:54.837539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:21:54.837539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:21:54.837539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:21:54.837539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:21:54.837539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:21:54.838628 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:21:54.838628 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:21:54.838628 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:21:54.838628 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:21:54.843045 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 613/1215] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:21:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:21:54.846472 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38048a1-240d-4d39-8066-829281f032a9 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:54.917337 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:21:54.968468 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38048a1-240d-4d39-8066-829281f032a9 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:55.011361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3dd19-30cb-47da-a402-1d3079034b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:55.012230 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3dd19-30cb-47da-a402-1d3079034b3e None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:55.013031 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3dd19-30cb-47da-a402-1d3079034b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:55.013414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3dd19-30cb-47da-a402-1d3079034b3e None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:55.014279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3dd19-30cb-47da-a402-1d3079034b3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:21:55.014719 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3dd19-30cb-47da-a402-1d3079034b3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:55.016267 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3dd19-30cb-47da-a402-1d3079034b3e None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:55.034492 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 603/1216] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:21:55.040051 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef1669-ba03-4023-af11-eb7570104bab None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:55.124730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:21:55.158079 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef1669-ba03-4023-af11-eb7570104bab None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:55.199813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7816a85-787b-4ee5-827d-ceeab5b69999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:55.201062 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7816a85-787b-4ee5-827d-ceeab5b69999 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:55.201445 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7816a85-787b-4ee5-827d-ceeab5b69999 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:55.201877 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7816a85-787b-4ee5-827d-ceeab5b69999 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:55.210448 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7816a85-787b-4ee5-827d-ceeab5b69999 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:55.212239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7816a85-787b-4ee5-827d-ceeab5b69999 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:55.229155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-e7816a85-787b-4ee5-827d-ceeab5b69999 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:21:55.229155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:21:55.229155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:21:55.229155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:21:55.229155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:21:55.229155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:21:55.229155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:21:55.229155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:21:55.229155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:21:55.229155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:21:55.229155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:21:55.229155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:21:55.229155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:21:55.229155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:21:55.229155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:21:55.230850 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:21:55.230850 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:21:55.230850 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:21:55.230850 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:21:55.230850 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:21:55.230850 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:21:55.230850 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:21:55.230850 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:21:55.230850 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:21:55.230850 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:21:55.230850 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:21:55.230850 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:21:55.230850 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:21:55.230850 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:21:55.230850 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:21:55.230850 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:21:55.230850 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:21:55.232020 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:21:55.232020 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:21:55.232020 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:21:55.232020 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:21:55.232020 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:21:55.232020 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:21:55.232020 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:21:55.232020 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:21:55.238388 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 614/1217] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:21:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:21:55.239511 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3dd19-30cb-47da-a402-1d3079034b3e None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:55.362651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3dd19-30cb-47da-a402-1d3079034b3e None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:55.391146 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:21:55.407097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185c84b-2da0-433c-ac5c-06b12ab215dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:55.408134 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185c84b-2da0-433c-ac5c-06b12ab215dc None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:55.408525 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185c84b-2da0-433c-ac5c-06b12ab215dc None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:55.408885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185c84b-2da0-433c-ac5c-06b12ab215dc None admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:55.409733 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185c84b-2da0-433c-ac5c-06b12ab215dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:21:55.410068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185c84b-2da0-433c-ac5c-06b12ab215dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:55.411769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185c84b-2da0-433c-ac5c-06b12ab215dc None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:55.427452 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 604/1218] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:21:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:21:55.433602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7816a85-787b-4ee5-827d-ceeab5b69999 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:55.550204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7816a85-787b-4ee5-827d-ceeab5b69999 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:55.581726 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:21:55.589458 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b55da3-9a66-4426-a031-18d648990df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:55.590903 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b55da3-9a66-4426-a031-18d648990df8 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:55.591279 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b55da3-9a66-4426-a031-18d648990df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:55.591606 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b55da3-9a66-4426-a031-18d648990df8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:55.592485 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b55da3-9a66-4426-a031-18d648990df8 None admin] RBAC: Adding query filter params (role.id=1ff62289fb434d09a13001c3ffbab080, scope.project.id=c54934775a86487295bdbc02ed3a0103, user.id=2a27fe78683743c397fe7929e9053c5e) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:21:55.592823 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b55da3-9a66-4426-a031-18d648990df8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:55.594411 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b55da3-9a66-4426-a031-18d648990df8 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:55.600178 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 615/1219] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:21:55 2022] GET /identity/v3/role_assignments?user.id=2a27fe78683743c397fe7929e9053c5e&scope.project.id=c54934775a86487295bdbc02ed3a0103&role.id=1ff62289fb434d09a13001c3ffbab080 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:21:57.659268 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f32ed-3741-4073-aee6-ca5afbfab0b5 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:57.659851 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f32ed-3741-4073-aee6-ca5afbfab0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:57.659851 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f32ed-3741-4073-aee6-ca5afbfab0b5 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:57.661218 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 605/1220] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:21:57.666666 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5763c-43a9-4745-b943-3d9e21732e01 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:57.667163 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5763c-43a9-4745-b943-3d9e21732e01 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:57.667284 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5763c-43a9-4745-b943-3d9e21732e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:57.685087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-71b5763c-43a9-4745-b943-3d9e21732e01 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:21:57.686377 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-71b5763c-43a9-4745-b943-3d9e21732e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:21:57.774193 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 616/1221] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:21:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:21:57.800056 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f32ed-3741-4073-aee6-ca5afbfab0b5 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:57.915133 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f32ed-3741-4073-aee6-ca5afbfab0b5 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:57.958527 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69b328-4ade-4617-a01b-e48c0212c75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:57.959367 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69b328-4ade-4617-a01b-e48c0212c75b None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:57.959656 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69b328-4ade-4617-a01b-e48c0212c75b None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:57.959937 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69b328-4ade-4617-a01b-e48c0212c75b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:57.970901 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69b328-4ade-4617-a01b-e48c0212c75b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:21:57.979076 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-ed69b328-4ade-4617-a01b-e48c0212c75b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:21:57.979076 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:21:57.979076 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:21:57.979076 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:21:57.979076 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:21:57.979076 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:21:57.979076 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:21:57.979076 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:21:57.979076 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:21:57.979076 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:21:57.979076 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:21:57.979076 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:21:57.979076 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:21:57.979076 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:21:57.979076 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:21:57.979076 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:21:57.980798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:21:57.980798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:21:57.980798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:21:57.980798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:21:57.980798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:21:57.980798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:21:57.980798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:21:57.980798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:21:57.980798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:21:57.980798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:21:57.980798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:21:57.980798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:21:57.980798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:21:57.980798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:21:57.980798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:21:57.980798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:21:57.981716 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:21:57.981716 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:21:57.981716 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:21:57.981716 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:21:57.981716 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:21:57.981716 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:21:57.981716 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:21:57.981716 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:21:57.981716 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:21:57.981716 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:21:57.981716 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:21:57.981716 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:21:57.981716 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 606/1222] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 19 15:21:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:21:57.987053 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5763c-43a9-4745-b943-3d9e21732e01 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:58.095025 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5763c-43a9-4745-b943-3d9e21732e01 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:58.122565 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:21:58.138825 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da768ee8-a155-495f-a38c-af3b81ff612e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:58.140047 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da768ee8-a155-495f-a38c-af3b81ff612e None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:58.140460 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da768ee8-a155-495f-a38c-af3b81ff612e None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:58.140743 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da768ee8-a155-495f-a38c-af3b81ff612e None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:58.141515 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da768ee8-a155-495f-a38c-af3b81ff612e None admin] RBAC: Adding query filter params (name=service) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:21:58.141820 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da768ee8-a155-495f-a38c-af3b81ff612e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:58.143193 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da768ee8-a155-495f-a38c-af3b81ff612e None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:58.157664 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 617/1223] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 19 15:21:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:21:58.158914 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69b328-4ade-4617-a01b-e48c0212c75b None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:58.206952 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:21:58.276071 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69b328-4ade-4617-a01b-e48c0212c75b None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:58.314952 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12cdcf-e629-443b-b831-7d608f1f49d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:58.315789 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12cdcf-e629-443b-b831-7d608f1f49d6 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:58.316078 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12cdcf-e629-443b-b831-7d608f1f49d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:58.316386 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12cdcf-e629-443b-b831-7d608f1f49d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:58.331010 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12cdcf-e629-443b-b831-7d608f1f49d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:58.332917 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12cdcf-e629-443b-b831-7d608f1f49d6 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:58.355105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-1f12cdcf-e629-443b-b831-7d608f1f49d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:21:58.355105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:21:58.355105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:21:58.355105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:21:58.355105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:21:58.355105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:21:58.355105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:21:58.355105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:21:58.355105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:21:58.355105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:21:58.355105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:21:58.355105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:21:58.355105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:21:58.355105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:21:58.355105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:21:58.357097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:21:58.357097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:21:58.357097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:21:58.357097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:21:58.357097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:21:58.357097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:21:58.357097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:21:58.357097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:21:58.357097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:21:58.357097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:21:58.357097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:21:58.357097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:21:58.357097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:21:58.357097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:21:58.357097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:21:58.357097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:21:58.357097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:21:58.359130 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:21:58.359130 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:21:58.359130 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:21:58.359130 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:21:58.359130 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 607/1224] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:21:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:21:58.362561 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da768ee8-a155-495f-a38c-af3b81ff612e None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:58.474823 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da768ee8-a155-495f-a38c-af3b81ff612e None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:58.513483 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3112a08-2b04-429e-9247-f76bef36474a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:58.514152 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3112a08-2b04-429e-9247-f76bef36474a None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:58.514464 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3112a08-2b04-429e-9247-f76bef36474a None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:58.514744 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3112a08-2b04-429e-9247-f76bef36474a None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:58.515534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3112a08-2b04-429e-9247-f76bef36474a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:21:58.515846 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3112a08-2b04-429e-9247-f76bef36474a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:58.517629 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3112a08-2b04-429e-9247-f76bef36474a None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:58.529817 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 618/1225] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:21:58.535790 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12cdcf-e629-443b-b831-7d608f1f49d6 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:58.641234 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:21:58.650137 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12cdcf-e629-443b-b831-7d608f1f49d6 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:58.691798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed631643-6a28-43f6-9899-23d46305b89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:58.692617 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed631643-6a28-43f6-9899-23d46305b89d None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:58.692907 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed631643-6a28-43f6-9899-23d46305b89d None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:58.693188 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed631643-6a28-43f6-9899-23d46305b89d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:58.702824 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed631643-6a28-43f6-9899-23d46305b89d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:58.704370 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed631643-6a28-43f6-9899-23d46305b89d None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:58.720763 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-ed631643-6a28-43f6-9899-23d46305b89d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 15:21:58.720763 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:21:58.720763 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:21:58.720763 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:21:58.720763 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:21:58.720763 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:21:58.720763 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:21:58.720763 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:21:58.720763 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:21:58.720763 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:21:58.720763 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:21:58.720763 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:21:58.720763 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:21:58.720763 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:21:58.720763 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:21:58.720763 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:21:58.722023 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:21:58.722023 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:21:58.722023 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:21:58.722023 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:21:58.722023 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:21:58.722023 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:21:58.722023 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:21:58.722023 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:21:58.722023 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:21:58.722023 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:21:58.722023 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:21:58.722023 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:21:58.722023 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:21:58.722023 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:21:58.722023 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:21:58.722023 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:21:58.722023 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:21:58.722023 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:21:58.722996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:21:58.722996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:21:58.722996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:21:58.722996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:21:58.722996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:21:58.722996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:21:58.722996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:21:58.722996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:21:58.722996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 15:21:58.722996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:21:58.722996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 608/1226] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:21:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:21:58.728680 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3112a08-2b04-429e-9247-f76bef36474a None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:58.786617 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:21:58.845832 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3112a08-2b04-429e-9247-f76bef36474a None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:58.884206 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4c2ee-fd2f-42f8-957c-2644a458e484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:58.884868 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4c2ee-fd2f-42f8-957c-2644a458e484 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:58.885156 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4c2ee-fd2f-42f8-957c-2644a458e484 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:58.885433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4c2ee-fd2f-42f8-957c-2644a458e484 None admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:58.886841 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4c2ee-fd2f-42f8-957c-2644a458e484 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:21:58.887146 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4c2ee-fd2f-42f8-957c-2644a458e484 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:58.888594 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4c2ee-fd2f-42f8-957c-2644a458e484 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:58.911260 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 619/1227] 10.222.0.44 () {56 vars in 1143 bytes} [Tue Jul 19 15:21:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:21:58.918473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed631643-6a28-43f6-9899-23d46305b89d None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:59.049546 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed631643-6a28-43f6-9899-23d46305b89d None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:59.087369 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3deff-47f4-4314-8bf0-fd6aa33df9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:59.088232 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3deff-47f4-4314-8bf0-fd6aa33df9e9 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:59.088527 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3deff-47f4-4314-8bf0-fd6aa33df9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:59.088912 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3deff-47f4-4314-8bf0-fd6aa33df9e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:59.101701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3deff-47f4-4314-8bf0-fd6aa33df9e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:59.103204 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3deff-47f4-4314-8bf0-fd6aa33df9e9 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:59.122935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-3fc3deff-47f4-4314-8bf0-fd6aa33df9e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:21:59.122935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:21:59.122935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:21:59.122935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:21:59.122935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:21:59.122935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:21:59.122935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:21:59.122935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:21:59.122935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:21:59.122935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:21:59.122935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:21:59.122935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:21:59.122935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:21:59.122935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:21:59.122935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:21:59.124112 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:21:59.124112 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:21:59.124112 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:21:59.124112 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:21:59.124112 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:21:59.124112 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:21:59.124112 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:21:59.124112 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:21:59.124112 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:21:59.124112 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:21:59.124112 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:21:59.124112 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:21:59.124112 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:21:59.124112 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:21:59.124112 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:21:59.124112 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:21:59.124112 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:21:59.125174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:21:59.125174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:21:59.125174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:21:59.125174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:21:59.125174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 609/1228] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:21:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:21:59.130045 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4c2ee-fd2f-42f8-957c-2644a458e484 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:59.245208 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4c2ee-fd2f-42f8-957c-2644a458e484 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:59.247759 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:21:59.284951 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47982cc-6d25-45e2-b0e2-c003c6301fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:59.285739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47982cc-6d25-45e2-b0e2-c003c6301fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:59.286182 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47982cc-6d25-45e2-b0e2-c003c6301fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:59.286525 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47982cc-6d25-45e2-b0e2-c003c6301fa4 None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:59.287666 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47982cc-6d25-45e2-b0e2-c003c6301fa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:21:59.288045 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47982cc-6d25-45e2-b0e2-c003c6301fa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:59.289754 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47982cc-6d25-45e2-b0e2-c003c6301fa4 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:59.311315 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 620/1229] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:21:59.314682 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3deff-47f4-4314-8bf0-fd6aa33df9e9 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:59.325836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:21:59.453888 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3deff-47f4-4314-8bf0-fd6aa33df9e9 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:59.505567 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58054f-c507-4f0b-9a94-14cfdf3a510e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:59.506346 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58054f-c507-4f0b-9a94-14cfdf3a510e None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:59.506627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58054f-c507-4f0b-9a94-14cfdf3a510e None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:59.506900 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58054f-c507-4f0b-9a94-14cfdf3a510e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:59.515112 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b58054f-c507-4f0b-9a94-14cfdf3a510e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:59.516805 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b58054f-c507-4f0b-9a94-14cfdf3a510e None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:59.544558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-9b58054f-c507-4f0b-9a94-14cfdf3a510e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:21:59.544558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:21:59.544558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:21:59.544558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:21:59.544558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:21:59.544558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:21:59.544558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:21:59.544558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:21:59.544558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:21:59.544558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:21:59.544558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:21:59.544558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:21:59.544558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:21:59.544558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:21:59.544558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:21:59.546522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:21:59.546522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:21:59.546522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:21:59.546522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:21:59.546522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:21:59.546522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:21:59.546522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:21:59.546522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:21:59.546522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:21:59.546522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:21:59.546522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:21:59.546522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:21:59.546522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:21:59.546522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:21:59.546522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:21:59.546522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:21:59.546522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:21:59.548663 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:21:59.548663 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:21:59.548663 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:21:59.548663 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:21:59.548663 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:21:59.548663 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:21:59.548663 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:21:59.548663 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:21:59.548663 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 610/1230] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:21:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:21:59.553593 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47982cc-6d25-45e2-b0e2-c003c6301fa4 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:59.690564 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47982cc-6d25-45e2-b0e2-c003c6301fa4 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:59.733870 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea16ba4-54df-4eb7-9b77-337cd646d219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:59.735019 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea16ba4-54df-4eb7-9b77-337cd646d219 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:59.735458 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea16ba4-54df-4eb7-9b77-337cd646d219 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:59.735897 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea16ba4-54df-4eb7-9b77-337cd646d219 None admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:59.737081 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea16ba4-54df-4eb7-9b77-337cd646d219 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:21:59.737502 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea16ba4-54df-4eb7-9b77-337cd646d219 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:59.739537 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea16ba4-54df-4eb7-9b77-337cd646d219 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:59.757364 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 621/1231] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:21:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:21:59.763669 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58054f-c507-4f0b-9a94-14cfdf3a510e None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:59.851282 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:21:59.892343 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58054f-c507-4f0b-9a94-14cfdf3a510e None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:59.929953 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecb9c7-8028-4538-991d-9b84139a0528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:59.930848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecb9c7-8028-4538-991d-9b84139a0528 None admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:59.931138 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecb9c7-8028-4538-991d-9b84139a0528 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:59.931441 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecb9c7-8028-4538-991d-9b84139a0528 None admin] PATH_INFO: `/v3/projects/c54934775a86487295bdbc02ed3a0103/users/2a27fe78683743c397fe7929e9053c5e/roles/1ff62289fb434d09a13001c3ffbab080` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:59.950871 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ecb9c7-8028-4538-991d-9b84139a0528 None admin] RBAC: Authorizing `identity:create_grant(project_id=c54934775a86487295bdbc02ed3a0103, user_id=2a27fe78683743c397fe7929e9053c5e, role_id=1ff62289fb434d09a13001c3ffbab080)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:59.952293 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ecb9c7-8028-4538-991d-9b84139a0528 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:59.965210 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 611/1232] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 19 15:21:59 2022] PUT /identity/v3/projects/c54934775a86487295bdbc02ed3a0103/users/2a27fe78683743c397fe7929e9053c5e/roles/1ff62289fb434d09a13001c3ffbab080 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:22:02.090290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751cb3d-122d-4774-aa16-e1acb4bd8f6f None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:02.090918 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751cb3d-122d-4774-aa16-e1acb4bd8f6f None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:02.090918 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751cb3d-122d-4774-aa16-e1acb4bd8f6f None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:02.092318 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 622/1233] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:22:02.098194 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6352f3-0b65-4870-b897-ddb2c52423cc None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:02.098964 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6352f3-0b65-4870-b897-ddb2c52423cc None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:02.098964 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6352f3-0b65-4870-b897-ddb2c52423cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:02.118742 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-ac6352f3-0b65-4870-b897-ddb2c52423cc None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:22:02.119910 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-ac6352f3-0b65-4870-b897-ddb2c52423cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:22:02.204449 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 612/1234] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:22:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:22:02.249801 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751cb3d-122d-4774-aa16-e1acb4bd8f6f None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:02.299321 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:02.445342 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751cb3d-122d-4774-aa16-e1acb4bd8f6f None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:02.505352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d52ab-14c1-49fb-922f-2ecf2841c4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:02.506170 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d52ab-14c1-49fb-922f-2ecf2841c4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:02.506512 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d52ab-14c1-49fb-922f-2ecf2841c4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:02.506816 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d52ab-14c1-49fb-922f-2ecf2841c4f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:02.521390 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d52ab-14c1-49fb-922f-2ecf2841c4f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:22:02.530547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-cb4d52ab-14c1-49fb-922f-2ecf2841c4f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:22:02.530547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:22:02.530547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:22:02.530547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:22:02.530547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:22:02.530547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:22:02.530547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:22:02.530547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:22:02.530547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:22:02.530547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:22:02.530547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:22:02.530547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:22:02.530547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:22:02.530547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:22:02.530547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:22:02.530547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:22:02.532450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:22:02.532450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:22:02.532450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:22:02.532450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:22:02.532450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:22:02.532450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:22:02.532450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:22:02.532450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:22:02.532450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:22:02.532450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:22:02.532450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:22:02.532450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:22:02.532450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:22:02.532450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:22:02.532450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:22:02.532450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:22:02.534074 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:22:02.534074 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:22:02.534074 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:22:02.534074 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:22:02.534074 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:22:02.534074 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:22:02.534074 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:22:02.534074 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:22:02.534074 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:22:02.534074 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:22:02.534074 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 15:22:02.534074 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:22:02.534074 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 623/1235] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jul 19 15:22:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:22:02.538260 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6352f3-0b65-4870-b897-ddb2c52423cc None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:02.601905 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:02.669309 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6352f3-0b65-4870-b897-ddb2c52423cc None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:02.719144 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c90703-43a3-4d53-89b1-e1e14aba61a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:02.720347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c90703-43a3-4d53-89b1-e1e14aba61a5 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:02.720822 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c90703-43a3-4d53-89b1-e1e14aba61a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:02.721195 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c90703-43a3-4d53-89b1-e1e14aba61a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:02.722315 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c90703-43a3-4d53-89b1-e1e14aba61a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:22:02.722730 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c90703-43a3-4d53-89b1-e1e14aba61a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:02.724636 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c90703-43a3-4d53-89b1-e1e14aba61a5 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:02.735793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 613/1236] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jul 19 15:22:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:22:02.743048 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d52ab-14c1-49fb-922f-2ecf2841c4f9 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:02.850855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:02.875121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d52ab-14c1-49fb-922f-2ecf2841c4f9 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:02.912950 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf2bde-1536-4ab5-b8c7-7cf76ae19ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:02.913754 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf2bde-1536-4ab5-b8c7-7cf76ae19ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:02.914032 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf2bde-1536-4ab5-b8c7-7cf76ae19ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:02.914311 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf2bde-1536-4ab5-b8c7-7cf76ae19ed3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:02.926655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf2bde-1536-4ab5-b8c7-7cf76ae19ed3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:02.928193 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf2bde-1536-4ab5-b8c7-7cf76ae19ed3 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:02.949915 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-85cf2bde-1536-4ab5-b8c7-7cf76ae19ed3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:22:02.949915 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:22:02.949915 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:22:02.949915 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:22:02.949915 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:22:02.949915 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:22:02.949915 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:22:02.949915 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:22:02.949915 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:22:02.949915 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:22:02.949915 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:22:02.949915 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:22:02.949915 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:22:02.949915 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:22:02.949915 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:22:02.957833 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:22:02.957833 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:22:02.957833 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:22:02.957833 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:22:02.957833 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:22:02.957833 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:22:02.957833 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:22:02.957833 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:22:02.957833 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:22:02.957833 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:22:02.957833 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:22:02.957833 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:22:02.957833 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:22:02.957833 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:22:02.957833 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:22:02.957833 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:22:02.957833 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:22:02.958892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:22:02.958892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:22:02.958892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:22:02.958892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:22:02.958892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 624/1237] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:22:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:22:02.959252 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c90703-43a3-4d53-89b1-e1e14aba61a5 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:03.084692 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c90703-43a3-4d53-89b1-e1e14aba61a5 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:03.096166 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:03.136802 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84f3d5-141e-4018-bbaa-b5e67ff7bbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:03.137830 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84f3d5-141e-4018-bbaa-b5e67ff7bbd7 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:03.137830 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84f3d5-141e-4018-bbaa-b5e67ff7bbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:03.138141 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84f3d5-141e-4018-bbaa-b5e67ff7bbd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:03.138762 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84f3d5-141e-4018-bbaa-b5e67ff7bbd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:22:03.139093 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84f3d5-141e-4018-bbaa-b5e67ff7bbd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:03.140538 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84f3d5-141e-4018-bbaa-b5e67ff7bbd7 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:03.154476 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 614/1238] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:22:03.160458 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf2bde-1536-4ab5-b8c7-7cf76ae19ed3 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:03.272789 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf2bde-1536-4ab5-b8c7-7cf76ae19ed3 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:03.313320 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ed2e5-a484-406f-8770-0b27525f61ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:03.314141 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ed2e5-a484-406f-8770-0b27525f61ac None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:03.314429 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ed2e5-a484-406f-8770-0b27525f61ac None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:03.314704 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ed2e5-a484-406f-8770-0b27525f61ac None admin] PATH_INFO: `/v3/users/placement` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:03.317875 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:03.324134 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ed2e5-a484-406f-8770-0b27525f61ac None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:03.325821 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ed2e5-a484-406f-8770-0b27525f61ac None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:03.341882 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-f76ed2e5-a484-406f-8770-0b27525f61ac None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 15:22:03.341882 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:22:03.341882 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:22:03.341882 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:22:03.341882 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:22:03.341882 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:22:03.341882 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:22:03.341882 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:22:03.341882 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:22:03.341882 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:22:03.341882 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:22:03.341882 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:22:03.341882 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:22:03.341882 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:22:03.341882 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:22:03.341882 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:22:03.343204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:22:03.343204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:22:03.343204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:22:03.343204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:22:03.343204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:22:03.343204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:22:03.343204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:22:03.343204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:22:03.343204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:22:03.343204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:22:03.343204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:22:03.343204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:22:03.343204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:22:03.343204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:22:03.343204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:22:03.343204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:22:03.343204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:22:03.343204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:22:03.344369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:22:03.344369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:22:03.344369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:22:03.344369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:22:03.344369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:22:03.344369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:22:03.344369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:22:03.344369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:22:03.344369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 15:22:03.344369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:22:03.344369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 625/1239] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:22:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:22:03.349266 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84f3d5-141e-4018-bbaa-b5e67ff7bbd7 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:03.473061 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84f3d5-141e-4018-bbaa-b5e67ff7bbd7 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:03.511643 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634575b0-e811-4044-a294-69135fc63126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:03.512383 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634575b0-e811-4044-a294-69135fc63126 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:03.512732 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634575b0-e811-4044-a294-69135fc63126 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:03.513062 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634575b0-e811-4044-a294-69135fc63126 None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:03.514128 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634575b0-e811-4044-a294-69135fc63126 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:22:03.514441 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634575b0-e811-4044-a294-69135fc63126 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:03.516231 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634575b0-e811-4044-a294-69135fc63126 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:03.536545 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 615/1240] 10.222.0.44 () {56 vars in 1143 bytes} [Tue Jul 19 15:22:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:22:03.543836 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ed2e5-a484-406f-8770-0b27525f61ac None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:03.661221 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ed2e5-a484-406f-8770-0b27525f61ac None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:03.697926 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb55da2-d09a-4ff7-a3bf-5f4c3edf4488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:03.698605 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb55da2-d09a-4ff7-a3bf-5f4c3edf4488 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:03.698897 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb55da2-d09a-4ff7-a3bf-5f4c3edf4488 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:03.699187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb55da2-d09a-4ff7-a3bf-5f4c3edf4488 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:03.769820 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:03.778806 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb55da2-d09a-4ff7-a3bf-5f4c3edf4488 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:03.780346 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb55da2-d09a-4ff7-a3bf-5f4c3edf4488 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:03.898776 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 626/1241] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:22:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 15:22:03.906980 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634575b0-e811-4044-a294-69135fc63126 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:03.950147 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:04.035943 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634575b0-e811-4044-a294-69135fc63126 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:04.073191 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3be063-113a-4ab7-8bc8-fadc5a05ce1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:04.074727 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3be063-113a-4ab7-8bc8-fadc5a05ce1f None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:04.075011 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3be063-113a-4ab7-8bc8-fadc5a05ce1f None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:04.075397 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3be063-113a-4ab7-8bc8-fadc5a05ce1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:04.086711 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3be063-113a-4ab7-8bc8-fadc5a05ce1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:04.088286 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3be063-113a-4ab7-8bc8-fadc5a05ce1f None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:04.107893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-ef3be063-113a-4ab7-8bc8-fadc5a05ce1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:22:04.107893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:22:04.107893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:22:04.107893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:22:04.107893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:22:04.107893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:22:04.107893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:22:04.107893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:22:04.107893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:22:04.107893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:22:04.107893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:22:04.107893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:22:04.107893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:22:04.107893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:22:04.107893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:22:04.109053 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:22:04.109053 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:22:04.109053 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:22:04.109053 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:22:04.109053 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:22:04.109053 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:22:04.109053 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:22:04.109053 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:22:04.109053 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:22:04.109053 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:22:04.109053 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:22:04.109053 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:22:04.109053 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:22:04.109053 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:22:04.109053 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:22:04.109053 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:22:04.109053 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:22:04.110246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:22:04.110246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:22:04.110246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:22:04.110246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:22:04.110246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 616/1242] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:22:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:22:04.115680 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb55da2-d09a-4ff7-a3bf-5f4c3edf4488 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:04.228682 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:04.235117 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb55da2-d09a-4ff7-a3bf-5f4c3edf4488 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:04.288239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196df5cd-9a60-42d5-bbb9-e50af9d4cef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:04.289136 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196df5cd-9a60-42d5-bbb9-e50af9d4cef9 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:04.289541 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196df5cd-9a60-42d5-bbb9-e50af9d4cef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:04.290018 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196df5cd-9a60-42d5-bbb9-e50af9d4cef9 None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:04.290922 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196df5cd-9a60-42d5-bbb9-e50af9d4cef9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:22:04.291338 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196df5cd-9a60-42d5-bbb9-e50af9d4cef9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:04.293566 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196df5cd-9a60-42d5-bbb9-e50af9d4cef9 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:04.308604 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 627/1243] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:22:04.314292 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3be063-113a-4ab7-8bc8-fadc5a05ce1f None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:04.405758 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:04.437496 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3be063-113a-4ab7-8bc8-fadc5a05ce1f None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:04.476289 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210fbb41-5016-45ad-9784-fd0f619f5071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:04.477088 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210fbb41-5016-45ad-9784-fd0f619f5071 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:04.477374 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210fbb41-5016-45ad-9784-fd0f619f5071 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:04.477664 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210fbb41-5016-45ad-9784-fd0f619f5071 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:04.485651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210fbb41-5016-45ad-9784-fd0f619f5071 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:04.487313 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210fbb41-5016-45ad-9784-fd0f619f5071 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:04.501996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-210fbb41-5016-45ad-9784-fd0f619f5071 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:22:04.501996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:22:04.501996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:22:04.501996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:22:04.501996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:22:04.501996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:22:04.501996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:22:04.501996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:22:04.501996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:22:04.501996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:22:04.501996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:22:04.501996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:22:04.501996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:22:04.501996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:22:04.501996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:22:04.503201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:22:04.503201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:22:04.503201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:22:04.503201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:22:04.503201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:22:04.503201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:22:04.503201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:22:04.503201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:22:04.503201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:22:04.503201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:22:04.503201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:22:04.503201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:22:04.503201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:22:04.503201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:22:04.503201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:22:04.503201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:22:04.503201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:22:04.504266 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:22:04.504266 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:22:04.504266 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:22:04.504266 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:22:04.504266 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:22:04.504266 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:22:04.504266 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:22:04.504266 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:22:04.504266 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 617/1244] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:22:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:22:04.509374 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196df5cd-9a60-42d5-bbb9-e50af9d4cef9 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:04.632734 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196df5cd-9a60-42d5-bbb9-e50af9d4cef9 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:04.668533 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d38fcc-0583-4b45-996a-211e91f31a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:04.669211 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d38fcc-0583-4b45-996a-211e91f31a8c None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:04.669502 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d38fcc-0583-4b45-996a-211e91f31a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:04.669786 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d38fcc-0583-4b45-996a-211e91f31a8c None admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:04.670582 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d38fcc-0583-4b45-996a-211e91f31a8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:22:04.670899 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d38fcc-0583-4b45-996a-211e91f31a8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:04.672367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d38fcc-0583-4b45-996a-211e91f31a8c None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:04.687456 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 628/1245] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:22:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:22:04.694196 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210fbb41-5016-45ad-9784-fd0f619f5071 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:04.833548 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210fbb41-5016-45ad-9784-fd0f619f5071 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:04.880668 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3629a4c-c4d0-42ad-b375-236bbd5545ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:04.881634 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3629a4c-c4d0-42ad-b375-236bbd5545ed None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:04.882062 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3629a4c-c4d0-42ad-b375-236bbd5545ed None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:04.882511 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3629a4c-c4d0-42ad-b375-236bbd5545ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:04.883824 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3629a4c-c4d0-42ad-b375-236bbd5545ed None admin] RBAC: Adding query filter params (role.id=1ff62289fb434d09a13001c3ffbab080, scope.project.id=c54934775a86487295bdbc02ed3a0103, user.id=2a27fe78683743c397fe7929e9053c5e) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:22:04.884145 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3629a4c-c4d0-42ad-b375-236bbd5545ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:04.885602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3629a4c-c4d0-42ad-b375-236bbd5545ed None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:04.892609 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 618/1246] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:22:04 2022] GET /identity/v3/role_assignments?user.id=2a27fe78683743c397fe7929e9053c5e&scope.project.id=c54934775a86487295bdbc02ed3a0103&role.id=1ff62289fb434d09a13001c3ffbab080 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:22:07.208154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54140abf-b72d-44f9-91ae-5b5ed260d29a None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:07.208154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54140abf-b72d-44f9-91ae-5b5ed260d29a None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:07.208791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54140abf-b72d-44f9-91ae-5b5ed260d29a None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:07.209954 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 629/1247] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:22:07.215818 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949f565-82fd-4b2b-b635-da4447e1b02c None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:07.216311 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949f565-82fd-4b2b-b635-da4447e1b02c None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:07.216404 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949f565-82fd-4b2b-b635-da4447e1b02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:07.221435 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:07.239214 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-8949f565-82fd-4b2b-b635-da4447e1b02c None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:22:07.241071 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-8949f565-82fd-4b2b-b635-da4447e1b02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:22:07.324198 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 619/1248] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:22:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:22:07.349390 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54140abf-b72d-44f9-91ae-5b5ed260d29a None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:07.369643 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:07.479154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54140abf-b72d-44f9-91ae-5b5ed260d29a None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:07.515848 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010a614-b0f2-40eb-a050-bed72f904c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:07.516650 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010a614-b0f2-40eb-a050-bed72f904c7a None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:07.516939 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010a614-b0f2-40eb-a050-bed72f904c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:07.517226 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010a614-b0f2-40eb-a050-bed72f904c7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:07.529740 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6010a614-b0f2-40eb-a050-bed72f904c7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:22:07.537502 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-6010a614-b0f2-40eb-a050-bed72f904c7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:22:07.537502 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:22:07.537502 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:22:07.537502 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:22:07.537502 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:22:07.537502 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:22:07.537502 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:22:07.537502 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:22:07.537502 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:22:07.537502 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:22:07.537502 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:22:07.537502 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:22:07.537502 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:22:07.537502 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:22:07.537502 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:22:07.537502 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:22:07.538647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:22:07.538647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:22:07.538647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:22:07.538647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:22:07.538647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:22:07.538647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:22:07.538647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:22:07.538647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:22:07.538647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:22:07.538647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:22:07.538647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:22:07.538647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:22:07.538647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:22:07.538647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:22:07.538647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:22:07.538647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:22:07.539643 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:22:07.539643 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:22:07.539643 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:22:07.539643 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:22:07.539643 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:22:07.539643 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:22:07.539643 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:22:07.539643 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:22:07.539643 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:22:07.539643 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:22:07.539643 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:22:07.539643 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:22:07.539643 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 630/1249] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:22:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:22:07.545588 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949f565-82fd-4b2b-b635-da4447e1b02c None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:07.654013 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949f565-82fd-4b2b-b635-da4447e1b02c None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:07.689282 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:07.695665 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954caf6-3ba6-45d8-a63f-45bfbcf797d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:07.696455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954caf6-3ba6-45d8-a63f-45bfbcf797d5 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:07.696744 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954caf6-3ba6-45d8-a63f-45bfbcf797d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:07.697026 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954caf6-3ba6-45d8-a63f-45bfbcf797d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:07.697782 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f954caf6-3ba6-45d8-a63f-45bfbcf797d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:22:07.698092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f954caf6-3ba6-45d8-a63f-45bfbcf797d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:07.699798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f954caf6-3ba6-45d8-a63f-45bfbcf797d5 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:07.709503 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 620/1250] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:22:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:22:07.716244 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010a614-b0f2-40eb-a050-bed72f904c7a None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:07.817949 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:07.845101 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010a614-b0f2-40eb-a050-bed72f904c7a None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:07.884740 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c2f71-4fcc-4811-9c0c-ffef240c3d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:07.885638 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c2f71-4fcc-4811-9c0c-ffef240c3d41 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:07.886556 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c2f71-4fcc-4811-9c0c-ffef240c3d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:07.886874 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c2f71-4fcc-4811-9c0c-ffef240c3d41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:07.899833 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c2f71-4fcc-4811-9c0c-ffef240c3d41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:07.901340 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c2f71-4fcc-4811-9c0c-ffef240c3d41 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:07.919773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-3b0c2f71-4fcc-4811-9c0c-ffef240c3d41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:22:07.919773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:22:07.919773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:22:07.919773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:22:07.919773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:22:07.919773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:22:07.919773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:22:07.919773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:22:07.919773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:22:07.919773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:22:07.919773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:22:07.919773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:22:07.919773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:22:07.919773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:22:07.919773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:22:07.920955 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:22:07.920955 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:22:07.920955 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:22:07.920955 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:22:07.920955 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:22:07.920955 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:22:07.920955 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:22:07.920955 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:22:07.920955 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:22:07.920955 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:22:07.920955 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:22:07.920955 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:22:07.920955 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:22:07.920955 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:22:07.920955 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:22:07.920955 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:22:07.920955 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:22:07.921881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:22:07.921881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:22:07.921881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:22:07.921881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:22:07.921881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 631/1251] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:22:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:22:07.927245 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954caf6-3ba6-45d8-a63f-45bfbcf797d5 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:08.047834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954caf6-3ba6-45d8-a63f-45bfbcf797d5 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:08.086261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f6a06-646c-4501-a4cc-15e97acc6285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:08.087155 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f6a06-646c-4501-a4cc-15e97acc6285 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:08.087454 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f6a06-646c-4501-a4cc-15e97acc6285 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:08.087707 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f6a06-646c-4501-a4cc-15e97acc6285 None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:08.088514 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f6a06-646c-4501-a4cc-15e97acc6285 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:22:08.089013 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f6a06-646c-4501-a4cc-15e97acc6285 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:08.091066 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f6a06-646c-4501-a4cc-15e97acc6285 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:08.104646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 621/1252] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:22:08.110581 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c2f71-4fcc-4811-9c0c-ffef240c3d41 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:08.232574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c2f71-4fcc-4811-9c0c-ffef240c3d41 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:08.265521 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:08.275632 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a843a1-29ed-46b1-87d2-821574bde09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:08.276507 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a843a1-29ed-46b1-87d2-821574bde09d None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:08.277349 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a843a1-29ed-46b1-87d2-821574bde09d None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:08.277709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a843a1-29ed-46b1-87d2-821574bde09d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:08.286517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a843a1-29ed-46b1-87d2-821574bde09d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:08.288213 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a843a1-29ed-46b1-87d2-821574bde09d None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:08.305720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-95a843a1-29ed-46b1-87d2-821574bde09d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 15:22:08.305720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:22:08.305720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:22:08.305720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:22:08.305720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:22:08.305720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:22:08.305720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:22:08.305720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:22:08.305720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:22:08.305720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:22:08.305720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:22:08.305720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:22:08.305720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:22:08.305720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:22:08.305720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:22:08.305720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:22:08.307005 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:22:08.307005 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:22:08.307005 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:22:08.307005 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:22:08.307005 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:22:08.307005 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:22:08.307005 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:22:08.307005 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:22:08.307005 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:22:08.307005 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:22:08.307005 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:22:08.307005 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:22:08.307005 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:22:08.307005 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:22:08.307005 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:22:08.307005 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:22:08.307005 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:22:08.307005 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:22:08.308757 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:22:08.308757 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:22:08.308757 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:22:08.308757 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:22:08.308757 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:22:08.308757 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:22:08.308757 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:22:08.308757 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:22:08.308757 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 15:22:08.308757 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:22:08.308757 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 632/1253] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:22:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:22:08.313807 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f6a06-646c-4501-a4cc-15e97acc6285 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:08.381052 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:08.440784 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f6a06-646c-4501-a4cc-15e97acc6285 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:08.488246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b20710-589b-4bff-8193-52d10e1fe62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:08.489015 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b20710-589b-4bff-8193-52d10e1fe62c None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:08.489304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b20710-589b-4bff-8193-52d10e1fe62c None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:08.489626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b20710-589b-4bff-8193-52d10e1fe62c None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:08.490582 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b20710-589b-4bff-8193-52d10e1fe62c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:22:08.490950 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b20710-589b-4bff-8193-52d10e1fe62c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:08.492615 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b20710-589b-4bff-8193-52d10e1fe62c None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:08.513898 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 622/1254] 10.222.0.44 () {56 vars in 1143 bytes} [Tue Jul 19 15:22:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:22:08.521407 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a843a1-29ed-46b1-87d2-821574bde09d None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:08.637139 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a843a1-29ed-46b1-87d2-821574bde09d None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:08.676043 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edf8a8-fda2-4e82-b886-ded5ab1160f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:08.676773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edf8a8-fda2-4e82-b886-ded5ab1160f2 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:08.677086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edf8a8-fda2-4e82-b886-ded5ab1160f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:08.677418 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edf8a8-fda2-4e82-b886-ded5ab1160f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:08.738669 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:08.753103 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30edf8a8-fda2-4e82-b886-ded5ab1160f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:08.754711 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30edf8a8-fda2-4e82-b886-ded5ab1160f2 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:08.871711 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 633/1255] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:22:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:22:08.877378 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b20710-589b-4bff-8193-52d10e1fe62c None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:08.997183 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b20710-589b-4bff-8193-52d10e1fe62c None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:09.012907 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:09.047760 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12345c4-9e0e-4e0f-8a43-8da480bc38b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:09.048558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12345c4-9e0e-4e0f-8a43-8da480bc38b2 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:09.048838 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12345c4-9e0e-4e0f-8a43-8da480bc38b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:09.049115 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12345c4-9e0e-4e0f-8a43-8da480bc38b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:09.061483 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12345c4-9e0e-4e0f-8a43-8da480bc38b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:09.063121 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12345c4-9e0e-4e0f-8a43-8da480bc38b2 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:09.084561 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-b12345c4-9e0e-4e0f-8a43-8da480bc38b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:22:09.084561 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:22:09.084561 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:22:09.084561 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:22:09.084561 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:22:09.084561 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:22:09.084561 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:22:09.084561 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:22:09.084561 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:22:09.084561 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:22:09.084561 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:22:09.084561 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:22:09.084561 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:22:09.084561 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:22:09.084561 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:22:09.085946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:22:09.085946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:22:09.085946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:22:09.085946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:22:09.085946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:22:09.085946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:22:09.085946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:22:09.085946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:22:09.085946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:22:09.085946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:22:09.085946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:22:09.085946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:22:09.085946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:22:09.085946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:22:09.085946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:22:09.085946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:22:09.085946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:22:09.087470 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:22:09.087470 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:22:09.087470 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:22:09.087470 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:22:09.087470 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 623/1256] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:22:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:22:09.092546 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edf8a8-fda2-4e82-b886-ded5ab1160f2 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:09.195502 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:09.210500 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edf8a8-fda2-4e82-b886-ded5ab1160f2 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:09.248535 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac35a5-bde7-4299-b1a7-7803f1612246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:09.249202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac35a5-bde7-4299-b1a7-7803f1612246 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:09.249436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac35a5-bde7-4299-b1a7-7803f1612246 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:09.249749 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac35a5-bde7-4299-b1a7-7803f1612246 None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:09.250563 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac35a5-bde7-4299-b1a7-7803f1612246 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:22:09.250940 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac35a5-bde7-4299-b1a7-7803f1612246 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:09.252539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac35a5-bde7-4299-b1a7-7803f1612246 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:09.264969 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 634/1257] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:22:09.271136 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12345c4-9e0e-4e0f-8a43-8da480bc38b2 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:09.380662 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12345c4-9e0e-4e0f-8a43-8da480bc38b2 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:09.418162 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3018b00-0a93-4547-a094-f1faf29c3351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:09.418985 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3018b00-0a93-4547-a094-f1faf29c3351 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:09.419312 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3018b00-0a93-4547-a094-f1faf29c3351 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:09.419617 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3018b00-0a93-4547-a094-f1faf29c3351 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:09.427673 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3018b00-0a93-4547-a094-f1faf29c3351 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:09.429133 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3018b00-0a93-4547-a094-f1faf29c3351 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:09.446281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-e3018b00-0a93-4547-a094-f1faf29c3351 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:22:09.446281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:22:09.446281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:22:09.446281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:22:09.446281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:22:09.446281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:22:09.446281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:22:09.446281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:22:09.446281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:22:09.446281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:22:09.446281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:22:09.446281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:22:09.446281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:22:09.446281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:22:09.446281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:22:09.447439 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:22:09.447439 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:22:09.447439 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:22:09.447439 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:22:09.447439 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:22:09.447439 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:22:09.447439 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:22:09.447439 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:22:09.447439 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:22:09.447439 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:22:09.447439 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:22:09.447439 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:22:09.447439 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:22:09.447439 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:22:09.447439 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:22:09.447439 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:22:09.447439 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:22:09.448680 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:22:09.448680 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:22:09.448680 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:22:09.448680 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:22:09.448680 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:22:09.448680 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:22:09.448680 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:22:09.448680 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:22:09.448680 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 624/1258] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:22:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:22:09.454361 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac35a5-bde7-4299-b1a7-7803f1612246 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:09.565363 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac35a5-bde7-4299-b1a7-7803f1612246 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:09.601238 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ba780-c36f-4dfa-b9e8-931bf78a844e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:09.602019 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ba780-c36f-4dfa-b9e8-931bf78a844e None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:09.602310 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ba780-c36f-4dfa-b9e8-931bf78a844e None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:09.602590 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ba780-c36f-4dfa-b9e8-931bf78a844e None admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:09.603414 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ba780-c36f-4dfa-b9e8-931bf78a844e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:22:09.603737 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ba780-c36f-4dfa-b9e8-931bf78a844e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:09.605682 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ba780-c36f-4dfa-b9e8-931bf78a844e None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:09.618949 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 635/1259] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:22:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:22:09.626508 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3018b00-0a93-4547-a094-f1faf29c3351 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:09.660696 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:09.748888 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3018b00-0a93-4547-a094-f1faf29c3351 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:09.792932 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64445778-f285-43bd-92e1-0817c1796cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:09.793630 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64445778-f285-43bd-92e1-0817c1796cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:09.793933 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64445778-f285-43bd-92e1-0817c1796cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:09.794196 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64445778-f285-43bd-92e1-0817c1796cc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:09.795088 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64445778-f285-43bd-92e1-0817c1796cc1 None admin] RBAC: Adding query filter params (role.id=d884ddf33c1440d9b3a3351b85e83e76, scope.project.id=c54934775a86487295bdbc02ed3a0103, user.id=2a27fe78683743c397fe7929e9053c5e) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:22:09.795437 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64445778-f285-43bd-92e1-0817c1796cc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:09.796878 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64445778-f285-43bd-92e1-0817c1796cc1 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:09.803498 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 625/1260] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:22:09 2022] GET /identity/v3/role_assignments?user.id=2a27fe78683743c397fe7929e9053c5e&scope.project.id=c54934775a86487295bdbc02ed3a0103&role.id=d884ddf33c1440d9b3a3351b85e83e76 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:22:11.938406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cc0bf-38fb-4ff5-b2f2-285357c72c3d None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:11.938926 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cc0bf-38fb-4ff5-b2f2-285357c72c3d None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:11.939017 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cc0bf-38fb-4ff5-b2f2-285357c72c3d None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:11.940382 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 636/1261] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:22:11.945850 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b69540-f4be-4061-95b5-228fe4789df1 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:11.946333 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b69540-f4be-4061-95b5-228fe4789df1 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:11.946437 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b69540-f4be-4061-95b5-228fe4789df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:11.963452 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-25b69540-f4be-4061-95b5-228fe4789df1 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:22:11.965258 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-25b69540-f4be-4061-95b5-228fe4789df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:22:12.030046 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 626/1262] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:22:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:22:12.052017 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1cc0bf-38fb-4ff5-b2f2-285357c72c3d None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:12.062791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:12.150192 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1cc0bf-38fb-4ff5-b2f2-285357c72c3d None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:12.182810 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fae461-91ab-48ce-b44b-9b1a931fd7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:12.183612 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fae461-91ab-48ce-b44b-9b1a931fd7fd None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:12.183901 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fae461-91ab-48ce-b44b-9b1a931fd7fd None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:12.184180 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fae461-91ab-48ce-b44b-9b1a931fd7fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:12.193868 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fae461-91ab-48ce-b44b-9b1a931fd7fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:22:12.201965 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-10fae461-91ab-48ce-b44b-9b1a931fd7fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:22:12.201965 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:22:12.201965 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:22:12.201965 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:22:12.201965 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:22:12.201965 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:22:12.201965 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:22:12.201965 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:22:12.201965 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:22:12.201965 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:22:12.201965 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:22:12.201965 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:22:12.201965 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:22:12.201965 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:22:12.201965 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:22:12.201965 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:22:12.203059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:22:12.203059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:22:12.203059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:22:12.203059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:22:12.203059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:22:12.203059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:22:12.203059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:22:12.203059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:22:12.203059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:22:12.203059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:22:12.203059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:22:12.203059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:22:12.203059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:22:12.203059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:22:12.203059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:22:12.203059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:22:12.204290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:22:12.204290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:22:12.204290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:22:12.204290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:22:12.204290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:22:12.204290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:22:12.204290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:22:12.204290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:22:12.204290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:22:12.204290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:22:12.204290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:22:12.204290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:22:12.204290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 637/1263] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:22:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:22:12.209121 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b69540-f4be-4061-95b5-228fe4789df1 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:12.227656 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:12.310489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b69540-f4be-4061-95b5-228fe4789df1 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:12.344658 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4385d6c-71bf-4819-88fd-5a54ff76cdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:12.345313 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4385d6c-71bf-4819-88fd-5a54ff76cdfc None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:12.345596 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4385d6c-71bf-4819-88fd-5a54ff76cdfc None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:12.345870 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4385d6c-71bf-4819-88fd-5a54ff76cdfc None admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:12.346671 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4385d6c-71bf-4819-88fd-5a54ff76cdfc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:22:12.346915 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4385d6c-71bf-4819-88fd-5a54ff76cdfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:12.348313 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4385d6c-71bf-4819-88fd-5a54ff76cdfc None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:12.356347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 627/1264] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:22:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:22:12.362100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fae461-91ab-48ce-b44b-9b1a931fd7fd None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:12.432322 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:12.471602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fae461-91ab-48ce-b44b-9b1a931fd7fd None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:12.505500 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3859788-2ab2-4a5b-84f5-9b4192005695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:12.506293 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3859788-2ab2-4a5b-84f5-9b4192005695 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:12.506581 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3859788-2ab2-4a5b-84f5-9b4192005695 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:12.506857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3859788-2ab2-4a5b-84f5-9b4192005695 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:12.518115 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3859788-2ab2-4a5b-84f5-9b4192005695 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:12.519589 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3859788-2ab2-4a5b-84f5-9b4192005695 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:12.536909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-e3859788-2ab2-4a5b-84f5-9b4192005695 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:22:12.536909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:22:12.536909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:22:12.536909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:22:12.536909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:22:12.536909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:22:12.536909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:22:12.536909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:22:12.536909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:22:12.536909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:22:12.536909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:22:12.536909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:22:12.536909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:22:12.536909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:22:12.536909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:22:12.538138 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:22:12.538138 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:22:12.538138 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:22:12.538138 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:22:12.538138 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:22:12.538138 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:22:12.538138 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:22:12.538138 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:22:12.538138 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:22:12.538138 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:22:12.538138 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:22:12.538138 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:22:12.538138 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:22:12.538138 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:22:12.538138 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:22:12.538138 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:22:12.538138 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:22:12.539120 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:22:12.539120 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:22:12.539120 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:22:12.539120 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:22:12.539120 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 638/1265] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:22:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:22:12.544142 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4385d6c-71bf-4819-88fd-5a54ff76cdfc None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:12.626451 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:12.649223 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4385d6c-71bf-4819-88fd-5a54ff76cdfc None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:12.683183 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d1ad7-ce3f-4ff9-ba65-eaf253035682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:12.683809 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d1ad7-ce3f-4ff9-ba65-eaf253035682 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:12.684096 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d1ad7-ce3f-4ff9-ba65-eaf253035682 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:12.684376 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d1ad7-ce3f-4ff9-ba65-eaf253035682 None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:12.685095 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d1ad7-ce3f-4ff9-ba65-eaf253035682 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:22:12.685404 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d1ad7-ce3f-4ff9-ba65-eaf253035682 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:12.686792 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d1ad7-ce3f-4ff9-ba65-eaf253035682 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:12.698803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 628/1266] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:22:12.704567 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3859788-2ab2-4a5b-84f5-9b4192005695 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:12.805868 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3859788-2ab2-4a5b-84f5-9b4192005695 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:12.825366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:12.839999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aafe71-8dff-4ded-af68-831a5e6e13d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:12.840800 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aafe71-8dff-4ded-af68-831a5e6e13d3 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:12.841085 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aafe71-8dff-4ded-af68-831a5e6e13d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:12.841362 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aafe71-8dff-4ded-af68-831a5e6e13d3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:12.849469 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aafe71-8dff-4ded-af68-831a5e6e13d3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:12.850900 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aafe71-8dff-4ded-af68-831a5e6e13d3 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:12.865774 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-92aafe71-8dff-4ded-af68-831a5e6e13d3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 15:22:12.865774 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:22:12.865774 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:22:12.865774 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:22:12.865774 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:22:12.865774 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:22:12.865774 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:22:12.865774 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:22:12.865774 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:22:12.865774 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:22:12.865774 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:22:12.865774 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:22:12.865774 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:22:12.865774 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:22:12.865774 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:22:12.865774 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:22:12.866913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:22:12.866913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:22:12.866913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:22:12.866913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:22:12.866913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:22:12.866913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:22:12.866913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:22:12.866913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:22:12.866913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:22:12.866913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:22:12.866913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:22:12.866913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:22:12.866913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:22:12.866913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:22:12.866913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:22:12.866913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:22:12.866913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:22:12.866913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:22:12.868114 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:22:12.868114 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:22:12.868114 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:22:12.868114 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:22:12.868114 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:22:12.868114 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:22:12.868114 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:22:12.868114 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:22:12.868114 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 15:22:12.868114 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:22:12.868114 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 639/1267] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:22:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:22:12.873458 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d1ad7-ce3f-4ff9-ba65-eaf253035682 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:12.971541 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d1ad7-ce3f-4ff9-ba65-eaf253035682 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:13.004792 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997edbca-3580-4527-b791-d4f7455f7288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:13.005456 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997edbca-3580-4527-b791-d4f7455f7288 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:13.005742 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997edbca-3580-4527-b791-d4f7455f7288 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:13.006022 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997edbca-3580-4527-b791-d4f7455f7288 None admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:13.006851 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997edbca-3580-4527-b791-d4f7455f7288 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:22:13.007162 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997edbca-3580-4527-b791-d4f7455f7288 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:13.008594 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997edbca-3580-4527-b791-d4f7455f7288 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:13.017039 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:13.025438 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 629/1268] 10.222.0.44 () {56 vars in 1143 bytes} [Tue Jul 19 15:22:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:22:13.031859 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aafe71-8dff-4ded-af68-831a5e6e13d3 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:13.128321 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aafe71-8dff-4ded-af68-831a5e6e13d3 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:13.161229 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7c690-c0a2-4b6c-9473-bc6c548196e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:13.162025 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7c690-c0a2-4b6c-9473-bc6c548196e8 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:13.162309 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7c690-c0a2-4b6c-9473-bc6c548196e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:13.162587 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7c690-c0a2-4b6c-9473-bc6c548196e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:13.173777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7c690-c0a2-4b6c-9473-bc6c548196e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:13.175212 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7c690-c0a2-4b6c-9473-bc6c548196e8 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:13.192216 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-50f7c690-c0a2-4b6c-9473-bc6c548196e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:22:13.192216 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:22:13.192216 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:22:13.192216 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:22:13.192216 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:22:13.192216 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:22:13.192216 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:22:13.192216 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:22:13.192216 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:22:13.192216 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:22:13.192216 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:22:13.192216 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:22:13.192216 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:22:13.192216 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:22:13.192216 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:22:13.193344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:22:13.193344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:22:13.193344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:22:13.193344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:22:13.193344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:22:13.193344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:22:13.193344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:22:13.193344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:22:13.193344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:22:13.193344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:22:13.193344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:22:13.193344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:22:13.193344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:22:13.193344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:22:13.193344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:22:13.193344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:22:13.193344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:22:13.194610 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:22:13.194610 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:22:13.194610 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:22:13.194610 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:22:13.194610 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 640/1269] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:22:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:22:13.199193 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997edbca-3580-4527-b791-d4f7455f7288 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:13.299081 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997edbca-3580-4527-b791-d4f7455f7288 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:13.332108 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9112ec-75a6-4f42-b835-9276efabd9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:13.332767 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9112ec-75a6-4f42-b835-9276efabd9ba None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:13.333057 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9112ec-75a6-4f42-b835-9276efabd9ba None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:13.333339 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9112ec-75a6-4f42-b835-9276efabd9ba None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:13.334071 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9112ec-75a6-4f42-b835-9276efabd9ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:22:13.334382 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9112ec-75a6-4f42-b835-9276efabd9ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:13.335773 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9112ec-75a6-4f42-b835-9276efabd9ba None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:13.347357 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 630/1270] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:22:13.353115 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7c690-c0a2-4b6c-9473-bc6c548196e8 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:13.384269 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:13.462840 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7c690-c0a2-4b6c-9473-bc6c548196e8 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:13.498971 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a7859-19c2-4b86-b476-fff3c3448279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:13.499792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a7859-19c2-4b86-b476-fff3c3448279 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:13.500078 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a7859-19c2-4b86-b476-fff3c3448279 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:13.500358 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a7859-19c2-4b86-b476-fff3c3448279 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:13.506911 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a7859-19c2-4b86-b476-fff3c3448279 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:13.508372 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a7859-19c2-4b86-b476-fff3c3448279 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:13.522844 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-d67a7859-19c2-4b86-b476-fff3c3448279 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:22:13.522844 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:22:13.522844 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:22:13.522844 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:22:13.522844 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:22:13.522844 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:22:13.522844 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:22:13.522844 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:22:13.522844 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:22:13.522844 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:22:13.522844 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:22:13.522844 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:22:13.522844 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:22:13.522844 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:22:13.522844 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:22:13.523920 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:22:13.523920 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:22:13.523920 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:22:13.523920 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:22:13.523920 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:22:13.523920 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:22:13.523920 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:22:13.523920 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:22:13.523920 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:22:13.523920 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:22:13.523920 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:22:13.523920 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:22:13.523920 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:22:13.523920 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:22:13.523920 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:22:13.523920 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:22:13.523920 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:22:13.525105 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:22:13.525105 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:22:13.525105 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:22:13.525105 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:22:13.525105 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:22:13.525105 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:22:13.525105 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:22:13.525105 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:22:13.525105 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 641/1271] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:22:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:22:13.530724 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9112ec-75a6-4f42-b835-9276efabd9ba None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:13.591183 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:13.632094 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9112ec-75a6-4f42-b835-9276efabd9ba None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:13.665688 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74de53-d8e5-4401-abc9-876565b03e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:13.666349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74de53-d8e5-4401-abc9-876565b03e8e None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:13.666637 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74de53-d8e5-4401-abc9-876565b03e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:13.666917 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74de53-d8e5-4401-abc9-876565b03e8e None admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:13.667746 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74de53-d8e5-4401-abc9-876565b03e8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:22:13.668111 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74de53-d8e5-4401-abc9-876565b03e8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:13.669563 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74de53-d8e5-4401-abc9-876565b03e8e None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:13.682197 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 631/1272] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:22:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:22:13.688643 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a7859-19c2-4b86-b476-fff3c3448279 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:13.781417 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:13.793098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a7859-19c2-4b86-b476-fff3c3448279 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:13.829236 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc071f-4aff-4f06-8315-4fe680d9a6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:13.830126 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc071f-4aff-4f06-8315-4fe680d9a6c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:13.830407 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc071f-4aff-4f06-8315-4fe680d9a6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:13.830681 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc071f-4aff-4f06-8315-4fe680d9a6c5 None admin] PATH_INFO: `/v3/projects/c54934775a86487295bdbc02ed3a0103/users/2a27fe78683743c397fe7929e9053c5e/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:13.832711 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc071f-4aff-4f06-8315-4fe680d9a6c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c54934775a86487295bdbc02ed3a0103, user_id=2a27fe78683743c397fe7929e9053c5e, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:13.834110 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc071f-4aff-4f06-8315-4fe680d9a6c5 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:13.847685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 642/1273] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jul 19 15:22:13 2022] PUT /identity/v3/projects/c54934775a86487295bdbc02ed3a0103/users/2a27fe78683743c397fe7929e9053c5e/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:22:15.873277 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead8932-b9f5-42d0-b612-1503b04b1d29 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:15.873817 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead8932-b9f5-42d0-b612-1503b04b1d29 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:15.873817 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead8932-b9f5-42d0-b612-1503b04b1d29 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:15.875214 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 632/1274] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:22:15.880914 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1601a-503d-4ec0-9189-87c7ebfdbfc7 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:15.881383 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1601a-503d-4ec0-9189-87c7ebfdbfc7 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:15.881482 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1601a-503d-4ec0-9189-87c7ebfdbfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:15.898163 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-84e1601a-503d-4ec0-9189-87c7ebfdbfc7 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:22:15.899406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-84e1601a-503d-4ec0-9189-87c7ebfdbfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:22:15.968004 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 643/1275] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:22:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:22:15.991253 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead8932-b9f5-42d0-b612-1503b04b1d29 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:16.093996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead8932-b9f5-42d0-b612-1503b04b1d29 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:16.112020 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:16.128783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d0c40-c486-492c-a0b9-4bca272379ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:16.129560 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d0c40-c486-492c-a0b9-4bca272379ef None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:16.129837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d0c40-c486-492c-a0b9-4bca272379ef None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:16.130108 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d0c40-c486-492c-a0b9-4bca272379ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:16.140427 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d0c40-c486-492c-a0b9-4bca272379ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 15:22:16.148063 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-727d0c40-c486-492c-a0b9-4bca272379ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:22:16.148063 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:22:16.148063 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:22:16.148063 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:22:16.148063 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:22:16.148063 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:22:16.148063 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:22:16.148063 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:22:16.148063 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:22:16.148063 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:22:16.148063 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:22:16.148063 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:22:16.148063 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 15:22:16.148063 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 15:22:16.148063 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 15:22:16.148063 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 15:22:16.149188 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 15:22:16.149188 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 15:22:16.149188 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 15:22:16.149188 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 15:22:16.149188 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:22:16.149188 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:22:16.149188 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:22:16.149188 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:22:16.149188 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:22:16.149188 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:22:16.149188 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:22:16.149188 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:22:16.149188 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:22:16.149188 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:22:16.149188 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:22:16.149188 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:22:16.150082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:22:16.150082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:22:16.150082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:22:16.150082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:22:16.150082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 15:22:16.150082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 15:22:16.150082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 15:22:16.150082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 15:22:16.150082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 15:22:16.150082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 15:22:16.150082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 15:22:16.150082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:22:16.150082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 633/1276] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jul 19 15:22:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:22:16.156063 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1601a-503d-4ec0-9189-87c7ebfdbfc7 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:16.241074 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:16.260387 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1601a-503d-4ec0-9189-87c7ebfdbfc7 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:16.294763 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24eebd-f01c-44f9-8d7f-767c6faf99ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:16.295478 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24eebd-f01c-44f9-8d7f-767c6faf99ac None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:16.295771 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24eebd-f01c-44f9-8d7f-767c6faf99ac None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:16.296055 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24eebd-f01c-44f9-8d7f-767c6faf99ac None admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:16.296807 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24eebd-f01c-44f9-8d7f-767c6faf99ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:22:16.297120 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24eebd-f01c-44f9-8d7f-767c6faf99ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:16.298490 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24eebd-f01c-44f9-8d7f-767c6faf99ac None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:16.306526 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 644/1277] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jul 19 15:22:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:22:16.312271 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d0c40-c486-492c-a0b9-4bca272379ef None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:16.416068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d0c40-c486-492c-a0b9-4bca272379ef None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:16.456828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730c1d4-16a7-4a76-9b76-74ed0883d0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:16.457905 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730c1d4-16a7-4a76-9b76-74ed0883d0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:16.458740 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730c1d4-16a7-4a76-9b76-74ed0883d0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:16.459035 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730c1d4-16a7-4a76-9b76-74ed0883d0a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:16.474898 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730c1d4-16a7-4a76-9b76-74ed0883d0a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:16.476515 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730c1d4-16a7-4a76-9b76-74ed0883d0a1 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:16.498755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-5730c1d4-16a7-4a76-9b76-74ed0883d0a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:22:16.498755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:22:16.498755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:22:16.498755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:22:16.498755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:22:16.498755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:22:16.498755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:22:16.498755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:22:16.498755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:22:16.498755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:22:16.498755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:22:16.498755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:22:16.498755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:22:16.498755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:22:16.498755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:22:16.500058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:22:16.500058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:22:16.500058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:22:16.500058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:22:16.500058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:22:16.500058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:22:16.500058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:22:16.500058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:22:16.500058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:22:16.500058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:22:16.500058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:22:16.500058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:22:16.500058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:22:16.500058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:22:16.500058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:22:16.500058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:22:16.500058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:22:16.501301 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:22:16.501301 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:22:16.501301 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:22:16.501301 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:22:16.501301 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 634/1278] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:22:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 15:22:16.505929 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24eebd-f01c-44f9-8d7f-767c6faf99ac None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:16.606561 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24eebd-f01c-44f9-8d7f-767c6faf99ac None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:16.638932 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0948770-b0ac-4b02-83cf-c18e5443b9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:16.639617 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0948770-b0ac-4b02-83cf-c18e5443b9bf None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:16.639909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0948770-b0ac-4b02-83cf-c18e5443b9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:16.640192 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0948770-b0ac-4b02-83cf-c18e5443b9bf None admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:16.640910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0948770-b0ac-4b02-83cf-c18e5443b9bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:22:16.641223 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0948770-b0ac-4b02-83cf-c18e5443b9bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:16.642577 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0948770-b0ac-4b02-83cf-c18e5443b9bf None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:16.654963 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 645/1279] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:22:16.660668 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730c1d4-16a7-4a76-9b76-74ed0883d0a1 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:16.690674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:16.758600 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730c1d4-16a7-4a76-9b76-74ed0883d0a1 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:16.791470 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc13b3-c320-401e-b3fa-954992e01c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:16.792256 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc13b3-c320-401e-b3fa-954992e01c95 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:16.792535 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc13b3-c320-401e-b3fa-954992e01c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:16.792808 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc13b3-c320-401e-b3fa-954992e01c95 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:16.799988 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc13b3-c320-401e-b3fa-954992e01c95 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:16.801396 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc13b3-c320-401e-b3fa-954992e01c95 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:16.815704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-05dc13b3-c320-401e-b3fa-954992e01c95 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 15:22:16.815704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:22:16.815704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:22:16.815704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:22:16.815704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:22:16.815704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:22:16.815704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:22:16.815704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:22:16.815704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:22:16.815704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:22:16.815704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:22:16.815704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:22:16.815704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 15:22:16.815704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 15:22:16.815704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 15:22:16.815704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 15:22:16.816815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:22:16.816815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:22:16.816815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 15:22:16.816815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:22:16.816815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 15:22:16.816815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 15:22:16.816815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:22:16.816815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:22:16.816815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:22:16.816815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:22:16.816815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:22:16.816815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:22:16.816815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:22:16.816815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:22:16.816815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:22:16.816815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:22:16.816815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:22:16.816815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:22:16.818153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:22:16.818153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:22:16.818153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 15:22:16.818153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 15:22:16.818153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 15:22:16.818153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 15:22:16.818153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 15:22:16.818153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 15:22:16.818153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 15:22:16.818153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:22:16.818153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 635/1280] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:22:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:22:16.822844 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0948770-b0ac-4b02-83cf-c18e5443b9bf None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:16.830308 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:16.928713 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0948770-b0ac-4b02-83cf-c18e5443b9bf None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:16.963907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666a53a-2b7d-4420-83de-e56fa3458112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:16.964484 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666a53a-2b7d-4420-83de-e56fa3458112 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:16.964768 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666a53a-2b7d-4420-83de-e56fa3458112 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:16.965044 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666a53a-2b7d-4420-83de-e56fa3458112 None admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:16.965887 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666a53a-2b7d-4420-83de-e56fa3458112 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:22:16.966192 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666a53a-2b7d-4420-83de-e56fa3458112 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:16.967614 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666a53a-2b7d-4420-83de-e56fa3458112 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:16.984296 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 646/1281] 10.222.0.44 () {56 vars in 1143 bytes} [Tue Jul 19 15:22:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:22:16.990036 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc13b3-c320-401e-b3fa-954992e01c95 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:17.077477 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:17.087106 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc13b3-c320-401e-b3fa-954992e01c95 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:17.118999 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781aee7-dcbe-4ded-8609-0a8e85f303d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:17.120176 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781aee7-dcbe-4ded-8609-0a8e85f303d2 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:17.120470 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781aee7-dcbe-4ded-8609-0a8e85f303d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:17.120741 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781aee7-dcbe-4ded-8609-0a8e85f303d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:17.188871 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781aee7-dcbe-4ded-8609-0a8e85f303d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:17.190315 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781aee7-dcbe-4ded-8609-0a8e85f303d2 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:17.286200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:17.297596 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 636/1282] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jul 19 15:22:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 15:22:17.303776 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666a53a-2b7d-4420-83de-e56fa3458112 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:17.372398 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:17.415166 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666a53a-2b7d-4420-83de-e56fa3458112 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:17.449143 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b60dc-76dd-419b-8f3f-fd8b50af446b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:17.449928 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b60dc-76dd-419b-8f3f-fd8b50af446b None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:17.450211 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b60dc-76dd-419b-8f3f-fd8b50af446b None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:17.450486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b60dc-76dd-419b-8f3f-fd8b50af446b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:17.460082 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b60dc-76dd-419b-8f3f-fd8b50af446b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:17.461504 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b60dc-76dd-419b-8f3f-fd8b50af446b None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:17.478245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-250b60dc-76dd-419b-8f3f-fd8b50af446b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:22:17.478245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:22:17.478245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:22:17.478245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:22:17.478245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:22:17.478245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:22:17.478245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:22:17.478245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:22:17.478245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:22:17.478245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:22:17.478245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:22:17.478245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:22:17.478245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 15:22:17.478245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 15:22:17.478245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 15:22:17.479824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 15:22:17.479824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:22:17.479824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:22:17.479824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:22:17.479824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:22:17.479824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:22:17.479824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:22:17.479824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:22:17.479824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:22:17.479824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:22:17.479824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:22:17.479824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:22:17.479824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:22:17.479824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:22:17.479824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:22:17.479824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:22:17.479824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:22:17.481152 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 15:22:17.481152 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 15:22:17.481152 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 15:22:17.481152 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:22:17.481152 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 647/1283] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:22:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:22:17.485754 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781aee7-dcbe-4ded-8609-0a8e85f303d2 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:17.588079 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781aee7-dcbe-4ded-8609-0a8e85f303d2 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:17.622839 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f7a73-c8cf-4aeb-9d3f-34294fe0a1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:17.623571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f7a73-c8cf-4aeb-9d3f-34294fe0a1ff None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:17.623862 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f7a73-c8cf-4aeb-9d3f-34294fe0a1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:17.624142 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f7a73-c8cf-4aeb-9d3f-34294fe0a1ff None admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:17.624881 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f7a73-c8cf-4aeb-9d3f-34294fe0a1ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:22:17.625193 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f7a73-c8cf-4aeb-9d3f-34294fe0a1ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:17.626615 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f7a73-c8cf-4aeb-9d3f-34294fe0a1ff None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:17.638627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 637/1284] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jul 19 15:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:22:17.644387 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b60dc-76dd-419b-8f3f-fd8b50af446b None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:17.745355 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b60dc-76dd-419b-8f3f-fd8b50af446b None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:17.760202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:17.781503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b83d5f-4587-4338-91d2-67f951ff4556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:17.782427 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b83d5f-4587-4338-91d2-67f951ff4556 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:17.782715 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b83d5f-4587-4338-91d2-67f951ff4556 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:17.782993 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b83d5f-4587-4338-91d2-67f951ff4556 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:17.790226 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b83d5f-4587-4338-91d2-67f951ff4556 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:17.792341 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b83d5f-4587-4338-91d2-67f951ff4556 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:17.806369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application [None req-20b83d5f-4587-4338-91d2-67f951ff4556 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:22:17.806369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:22:17.806369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:22:17.806369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:22:17.806369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:22:17.806369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:22:17.806369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:22:17.806369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:22:17.806369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:22:17.806369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:22:17.806369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:22:17.806369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:22:17.806369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 15:22:17.806369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 15:22:17.806369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 15:22:17.807467 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 15:22:17.807467 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:22:17.807467 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:22:17.807467 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:22:17.807467 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:22:17.807467 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:22:17.807467 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:22:17.807467 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:22:17.807467 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application with Lock( Jul 19 15:22:17.807467 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:22:17.807467 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:22:17.807467 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:22:17.807467 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:22:17.807467 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:22:17.807467 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:22:17.807467 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:22:17.807467 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:22:17.808407 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 15:22:17.808407 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 15:22:17.808407 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:22:17.808407 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:22:17.808407 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:22:17.808407 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:22:17.808407 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 15:22:17.808407 dv-cinder-849846-2-smb devstack@keystone.service[80304]: ERROR keystone.server.flask.application Jul 19 15:22:17.808407 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 648/1285] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jul 19 15:22:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:22:17.813528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f7a73-c8cf-4aeb-9d3f-34294fe0a1ff None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:17.864702 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:17.918466 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f7a73-c8cf-4aeb-9d3f-34294fe0a1ff None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:17.954375 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62bd71-1129-4e47-a310-8404503da569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:17.955034 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62bd71-1129-4e47-a310-8404503da569 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:17.955347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62bd71-1129-4e47-a310-8404503da569 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:17.955626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62bd71-1129-4e47-a310-8404503da569 None admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:17.956409 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62bd71-1129-4e47-a310-8404503da569 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:22:17.956716 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62bd71-1129-4e47-a310-8404503da569 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:17.958407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62bd71-1129-4e47-a310-8404503da569 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:17.971279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 638/1286] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jul 19 15:22:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:22:17.977372 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b83d5f-4587-4338-91d2-67f951ff4556 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:18.078238 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b83d5f-4587-4338-91d2-67f951ff4556 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:18.111087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21873f-4428-4a25-aa88-1ccfb2ce02e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:18.111686 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21873f-4428-4a25-aa88-1ccfb2ce02e6 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:18.111970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21873f-4428-4a25-aa88-1ccfb2ce02e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:18.112248 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21873f-4428-4a25-aa88-1ccfb2ce02e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:18.113070 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21873f-4428-4a25-aa88-1ccfb2ce02e6 None admin] RBAC: Adding query filter params (role.id=d884ddf33c1440d9b3a3351b85e83e76, scope.project.id=c54934775a86487295bdbc02ed3a0103, user.id=2a27fe78683743c397fe7929e9053c5e) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:22:18.113383 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21873f-4428-4a25-aa88-1ccfb2ce02e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:18.114785 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21873f-4428-4a25-aa88-1ccfb2ce02e6 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:18.120735 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 649/1287] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jul 19 15:22:17 2022] GET /identity/v3/role_assignments?user.id=2a27fe78683743c397fe7929e9053c5e&scope.project.id=c54934775a86487295bdbc02ed3a0103&role.id=d884ddf33c1440d9b3a3351b85e83e76 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:22:20.186626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115587e-8090-4a01-9374-22b8baf7b535 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:20.187166 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115587e-8090-4a01-9374-22b8baf7b535 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:20.187166 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115587e-8090-4a01-9374-22b8baf7b535 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:20.188515 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 639/1288] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:22:20.193926 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca968bd-2aa5-4afa-b3da-153c71ed9e6c None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:20.194384 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca968bd-2aa5-4afa-b3da-153c71ed9e6c None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:20.194489 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca968bd-2aa5-4afa-b3da-153c71ed9e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:20.211475 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-5ca968bd-2aa5-4afa-b3da-153c71ed9e6c None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:22:20.212666 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-5ca968bd-2aa5-4afa-b3da-153c71ed9e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:22:20.241811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:20.283850 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 650/1289] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:22:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:22:20.306726 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115587e-8090-4a01-9374-22b8baf7b535 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:20.416239 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115587e-8090-4a01-9374-22b8baf7b535 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:20.429958 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:20.460250 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b8a6f-83c5-4a30-b763-83e6f4e49075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:20.461589 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b8a6f-83c5-4a30-b763-83e6f4e49075 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:20.461879 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b8a6f-83c5-4a30-b763-83e6f4e49075 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:20.462229 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b8a6f-83c5-4a30-b763-83e6f4e49075 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:20.462844 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b8a6f-83c5-4a30-b763-83e6f4e49075 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:20.464808 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b8a6f-83c5-4a30-b763-83e6f4e49075 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:20.479455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-6b1b8a6f-83c5-4a30-b763-83e6f4e49075 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 15:22:20.479455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:22:20.479455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:22:20.479455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:22:20.479455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:22:20.479455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:22:20.479455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:22:20.479455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:22:20.479455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 15:22:20.479455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:22:20.479455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:22:20.479455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:22:20.479455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:22:20.479455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:22:20.479455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:22:20.479455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:22:20.479455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:22:20.480574 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:22:20.480574 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:22:20.480574 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:22:20.480574 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:22:20.480574 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:22:20.480574 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:22:20.480574 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:22:20.480574 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:22:20.480574 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:22:20.480574 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:22:20.480574 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:22:20.480574 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:22:20.480574 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:22:20.480574 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:22:20.480574 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:22:20.480574 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:22:20.481645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:22:20.481645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:22:20.481645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:22:20.481645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:22:20.481645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:22:20.481645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:22:20.481645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:22:20.481645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:22:20.481645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:22:20.481645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:22:20.481645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:22:20.481645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:22:20.481645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 15:22:20.481645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:22:20.481645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 640/1290] 10.222.0.44 () {56 vars in 1117 bytes} [Tue Jul 19 15:22:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:22:20.486911 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca968bd-2aa5-4afa-b3da-153c71ed9e6c None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:20.586732 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca968bd-2aa5-4afa-b3da-153c71ed9e6c None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:20.622901 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccf7e9-7b22-4e9b-9450-3a485867202b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:20.623601 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccf7e9-7b22-4e9b-9450-3a485867202b None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:20.623891 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccf7e9-7b22-4e9b-9450-3a485867202b None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:20.624172 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccf7e9-7b22-4e9b-9450-3a485867202b None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:20.624885 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ccf7e9-7b22-4e9b-9450-3a485867202b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:22:20.625198 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ccf7e9-7b22-4e9b-9450-3a485867202b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:20.626560 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ccf7e9-7b22-4e9b-9450-3a485867202b None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:20.631842 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 651/1291] 10.222.0.44 () {56 vars in 1116 bytes} [Tue Jul 19 15:22:20 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:22:20.638262 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b8a6f-83c5-4a30-b763-83e6f4e49075 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:20.746667 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b8a6f-83c5-4a30-b763-83e6f4e49075 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:20.781870 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89421b70-2d20-4e67-9a9f-cba4a34825e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:20.782542 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89421b70-2d20-4e67-9a9f-cba4a34825e4 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:20.782824 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89421b70-2d20-4e67-9a9f-cba4a34825e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:20.783101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89421b70-2d20-4e67-9a9f-cba4a34825e4 None admin] PATH_INFO: `/v3/services` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:20.783853 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89421b70-2d20-4e67-9a9f-cba4a34825e4 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:22:20.784161 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89421b70-2d20-4e67-9a9f-cba4a34825e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:20.785532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89421b70-2d20-4e67-9a9f-cba4a34825e4 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:20.790645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 641/1292] 10.222.0.44 () {56 vars in 1116 bytes} [Tue Jul 19 15:22:20 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:22:22.857834 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f46eb1-3e9e-4ba9-91d9-dd4412ba77f5 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:22.858219 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f46eb1-3e9e-4ba9-91d9-dd4412ba77f5 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:22.858422 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f46eb1-3e9e-4ba9-91d9-dd4412ba77f5 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:22.859876 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 652/1293] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:22:22.865249 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1ad7a-cc5c-4335-937a-764e40de487b None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:22.865904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1ad7a-cc5c-4335-937a-764e40de487b None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:22.865904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1ad7a-cc5c-4335-937a-764e40de487b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:22.884282 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-cda1ad7a-cc5c-4335-937a-764e40de487b None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:22:22.885711 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-cda1ad7a-cc5c-4335-937a-764e40de487b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:22:22.932468 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:22.973560 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 642/1294] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:22:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:22:22.997228 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f46eb1-3e9e-4ba9-91d9-dd4412ba77f5 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:23.029207 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:23.109117 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f46eb1-3e9e-4ba9-91d9-dd4412ba77f5 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:23.145973 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a94f5-fc3d-4a64-84d3-113f78cd823d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:23.146650 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a94f5-fc3d-4a64-84d3-113f78cd823d None admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:23.146935 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a94f5-fc3d-4a64-84d3-113f78cd823d None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:23.147215 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a94f5-fc3d-4a64-84d3-113f78cd823d None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:23.147980 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a94f5-fc3d-4a64-84d3-113f78cd823d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:23.149357 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a94f5-fc3d-4a64-84d3-113f78cd823d None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:23.165427 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 653/1295] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jul 19 15:22:22 2022] POST /identity/v3/services => generated 246 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:22:25.256726 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68fbf9-4de0-43cb-b811-8ef8177192c4 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:25.257258 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68fbf9-4de0-43cb-b811-8ef8177192c4 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:25.257258 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68fbf9-4de0-43cb-b811-8ef8177192c4 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:25.258585 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 643/1296] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:22:25.263965 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6367324-fc04-46ba-986c-ac534bbc531f None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:25.264407 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6367324-fc04-46ba-986c-ac534bbc531f None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:25.264516 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6367324-fc04-46ba-986c-ac534bbc531f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:25.281753 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-e6367324-fc04-46ba-986c-ac534bbc531f None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:22:25.282940 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-e6367324-fc04-46ba-986c-ac534bbc531f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:22:25.353610 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 654/1297] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:22:25 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:22:25.376575 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68fbf9-4de0-43cb-b811-8ef8177192c4 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:25.485366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68fbf9-4de0-43cb-b811-8ef8177192c4 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:25.521602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfcabf-d87f-4f26-934c-9e17a4416372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:25.522306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfcabf-d87f-4f26-934c-9e17a4416372 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:25.522585 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfcabf-d87f-4f26-934c-9e17a4416372 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:25.522859 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfcabf-d87f-4f26-934c-9e17a4416372 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:25.523545 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdfcabf-d87f-4f26-934c-9e17a4416372 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:25.524924 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdfcabf-d87f-4f26-934c-9e17a4416372 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:25.538085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-bbdfcabf-d87f-4f26-934c-9e17a4416372 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 15:22:25.538085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:22:25.538085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:22:25.538085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:22:25.538085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:22:25.538085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:22:25.538085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:22:25.538085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:22:25.538085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 15:22:25.538085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:22:25.538085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:22:25.538085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:22:25.538085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:22:25.538085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:22:25.538085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:22:25.538085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:22:25.538085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:22:25.539279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:22:25.539279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:22:25.539279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:22:25.539279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:22:25.539279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:22:25.539279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:22:25.539279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:22:25.539279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:22:25.539279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:22:25.539279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:22:25.539279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:22:25.539279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:22:25.539279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:22:25.539279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:22:25.539279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:22:25.539279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:22:25.540236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:22:25.540236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:22:25.540236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:22:25.540236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:22:25.540236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:22:25.540236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:22:25.540236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:22:25.540236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:22:25.540236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:22:25.540236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:22:25.540236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:22:25.540236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:22:25.540236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 15:22:25.540236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:22:25.540236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 644/1298] 10.222.0.44 () {56 vars in 1117 bytes} [Tue Jul 19 15:22:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:22:25.545497 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6367324-fc04-46ba-986c-ac534bbc531f None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:25.563778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:25.647870 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6367324-fc04-46ba-986c-ac534bbc531f None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:25.682404 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b8b7e-decc-4ad5-a6e2-4878d8507735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:25.683066 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b8b7e-decc-4ad5-a6e2-4878d8507735 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:25.683386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b8b7e-decc-4ad5-a6e2-4878d8507735 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:25.683669 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b8b7e-decc-4ad5-a6e2-4878d8507735 None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:25.684371 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b8b7e-decc-4ad5-a6e2-4878d8507735 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:22:25.684681 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b8b7e-decc-4ad5-a6e2-4878d8507735 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:25.686034 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b8b7e-decc-4ad5-a6e2-4878d8507735 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:25.691188 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 655/1299] 10.222.0.44 () {56 vars in 1116 bytes} [Tue Jul 19 15:22:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:22:25.697221 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfcabf-d87f-4f26-934c-9e17a4416372 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:25.729100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:25.810106 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfcabf-d87f-4f26-934c-9e17a4416372 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:25.842977 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f8f9e-54af-49a6-93d0-b72b834b9bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:25.843669 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f8f9e-54af-49a6-93d0-b72b834b9bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:25.843954 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f8f9e-54af-49a6-93d0-b72b834b9bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:25.844228 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f8f9e-54af-49a6-93d0-b72b834b9bc8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:25.845018 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f8f9e-54af-49a6-93d0-b72b834b9bc8 None admin] RBAC: Adding query filter params (interface=public, service_id=b59df4e948fc437c940f392f32a65503, region_id=RegionOne) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:22:25.845327 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f8f9e-54af-49a6-93d0-b72b834b9bc8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:25.846694 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f8f9e-54af-49a6-93d0-b72b834b9bc8 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:25.851876 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 645/1300] 10.222.0.44 () {56 vars in 1251 bytes} [Tue Jul 19 15:22:25 2022] GET /identity/v3/endpoints?service_id=b59df4e948fc437c940f392f32a65503&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:22:25.857539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b8b7e-decc-4ad5-a6e2-4878d8507735 None admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:25.956817 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:25.975616 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b8b7e-decc-4ad5-a6e2-4878d8507735 None admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:26.009426 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5a68a-d102-4a7f-a0ae-4fc410f4be46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:26.010682 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5a68a-d102-4a7f-a0ae-4fc410f4be46 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:26.010968 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5a68a-d102-4a7f-a0ae-4fc410f4be46 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:26.011266 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5a68a-d102-4a7f-a0ae-4fc410f4be46 None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:26.011961 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5a68a-d102-4a7f-a0ae-4fc410f4be46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:26.013318 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5a68a-d102-4a7f-a0ae-4fc410f4be46 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:26.020638 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 656/1301] 10.222.0.44 () {56 vars in 1087 bytes} [Tue Jul 19 15:22:25 2022] GET /identity/v3/services => generated 2191 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:22:28.059156 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd6738-c383-4ce5-832a-3b09fce82d52 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:28.059711 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd6738-c383-4ce5-832a-3b09fce82d52 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:28.059805 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd6738-c383-4ce5-832a-3b09fce82d52 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:28.061117 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 646/1302] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:22:28.066323 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e25bc3-6cfa-456a-a58f-f062113cf35c None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:28.066758 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e25bc3-6cfa-456a-a58f-f062113cf35c None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:28.066902 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e25bc3-6cfa-456a-a58f-f062113cf35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:28.083732 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-06e25bc3-6cfa-456a-a58f-f062113cf35c None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:22:28.084913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-06e25bc3-6cfa-456a-a58f-f062113cf35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:22:28.148909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 657/1303] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:22:28 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:22:28.171954 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd6738-c383-4ce5-832a-3b09fce82d52 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:28.265885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:28.273150 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd6738-c383-4ce5-832a-3b09fce82d52 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:28.307957 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84988941-76b7-4e46-a28b-f6048c81c362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:28.308763 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84988941-76b7-4e46-a28b-f6048c81c362 None admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:28.309047 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84988941-76b7-4e46-a28b-f6048c81c362 None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:28.309322 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84988941-76b7-4e46-a28b-f6048c81c362 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:28.309986 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84988941-76b7-4e46-a28b-f6048c81c362 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:28.311389 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84988941-76b7-4e46-a28b-f6048c81c362 None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:28.324249 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application [None req-84988941-76b7-4e46-a28b-f6048c81c362 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 15:22:28.324249 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:22:28.324249 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 15:22:28.324249 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 15:22:28.324249 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 15:22:28.324249 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 15:22:28.324249 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 15:22:28.324249 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:22:28.324249 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 15:22:28.324249 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:22:28.324249 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 15:22:28.324249 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:22:28.324249 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:22:28.324249 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:22:28.324249 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:22:28.324249 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:22:28.324249 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:22:28.325542 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:22:28.325542 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:22:28.325542 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:22:28.325542 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:22:28.325542 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:22:28.325542 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:22:28.325542 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 15:22:28.325542 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 15:22:28.325542 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 15:22:28.325542 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 15:22:28.325542 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:22:28.325542 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:22:28.325542 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 15:22:28.325542 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 15:22:28.325542 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 15:22:28.325542 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 15:22:28.326615 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 15:22:28.326615 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application with Lock( Jul 19 15:22:28.326615 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 15:22:28.326615 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self._enter() Jul 19 15:22:28.326615 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 15:22:28.326615 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 15:22:28.326615 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 15:22:28.326615 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application return self.creator() Jul 19 15:22:28.326615 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 15:22:28.326615 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application created_value = creator( Jul 19 15:22:28.326615 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 15:22:28.326615 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 15:22:28.326615 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 15:22:28.326615 dv-cinder-849846-2-smb devstack@keystone.service[80305]: ERROR keystone.server.flask.application Jul 19 15:22:28.326615 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 647/1304] 10.222.0.44 () {56 vars in 1117 bytes} [Tue Jul 19 15:22:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:22:28.331906 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e25bc3-6cfa-456a-a58f-f062113cf35c None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:28.411594 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:28.435076 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e25bc3-6cfa-456a-a58f-f062113cf35c None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:28.471435 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e1ca7-03a1-4cff-abfe-1bac3f39d627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:28.472112 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e1ca7-03a1-4cff-abfe-1bac3f39d627 None admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:28.472402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e1ca7-03a1-4cff-abfe-1bac3f39d627 None admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:28.472694 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e1ca7-03a1-4cff-abfe-1bac3f39d627 None admin] PATH_INFO: `/v3/services` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:28.473416 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e1ca7-03a1-4cff-abfe-1bac3f39d627 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:22:28.473732 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e1ca7-03a1-4cff-abfe-1bac3f39d627 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:28.475103 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e1ca7-03a1-4cff-abfe-1bac3f39d627 None admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:28.480789 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 658/1305] 10.222.0.44 () {56 vars in 1116 bytes} [Tue Jul 19 15:22:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:22:28.486625 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84988941-76b7-4e46-a28b-f6048c81c362 None admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:28.590301 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84988941-76b7-4e46-a28b-f6048c81c362 None admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:28.626934 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da982ef-9864-45e9-ad93-d1a8154cdc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:28.627635 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da982ef-9864-45e9-ad93-d1a8154cdc9e None admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:28.627926 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da982ef-9864-45e9-ad93-d1a8154cdc9e None admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:28.628212 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da982ef-9864-45e9-ad93-d1a8154cdc9e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:28.628980 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da982ef-9864-45e9-ad93-d1a8154cdc9e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:28.631464 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da982ef-9864-45e9-ad93-d1a8154cdc9e None admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:28.652642 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 648/1306] 10.222.0.44 () {60 vars in 1144 bytes} [Tue Jul 19 15:22:28 2022] POST /identity/v3/endpoints => generated 331 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:22:38.477617 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=30 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:38.647414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:23:34.263894 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbe835-254c-403d-bd1d-72031ce71ae0 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:23:34.264796 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbe835-254c-403d-bd1d-72031ce71ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:23:34.265482 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbe835-254c-403d-bd1d-72031ce71ae0 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:23:34.271068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 659/1307] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:23:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:23:34.272533 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead1074-68b2-45d7-a3b2-acaf48d36646 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:23:34.272981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead1074-68b2-45d7-a3b2-acaf48d36646 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:23:34.273187 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead1074-68b2-45d7-a3b2-acaf48d36646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:23:34.461006 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-7ead1074-68b2-45d7-a3b2-acaf48d36646 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:23:34.464439 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-7ead1074-68b2-45d7-a3b2-acaf48d36646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:23:34.647196 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 649/1308] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:23:34.697608 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f827dd-cf78-45f9-b937-93c59b26f342 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:23:34.698280 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f827dd-cf78-45f9-b937-93c59b26f342 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:23:34.698806 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f827dd-cf78-45f9-b937-93c59b26f342 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:23:34.700784 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 660/1309] 10.222.0.44 () {54 vars in 965 bytes} [Tue Jul 19 15:23:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:23:34.706522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1f6ab-d6c6-4aaf-9f79-c7cf322f8412 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:23:34.706821 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1f6ab-d6c6-4aaf-9f79-c7cf322f8412 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:23:34.707109 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1f6ab-d6c6-4aaf-9f79-c7cf322f8412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:23:34.795089 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-41f1f6ab-d6c6-4aaf-9f79-c7cf322f8412 None None] MFA Rules not processed for user `c89e7fbcc22c478c98d74b802f4bf8f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:23:34.796784 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-41f1f6ab-d6c6-4aaf-9f79-c7cf322f8412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:23:34.825772 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:23:34.889571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 650/1310] 10.222.0.44 () {58 vars in 1062 bytes} [Tue Jul 19 15:23:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:23:34.898894 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f827dd-cf78-45f9-b937-93c59b26f342 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:23:34.901195 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-b4f827dd-cf78-45f9-b937-93c59b26f342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:23:35.051946 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f827dd-cf78-45f9-b937-93c59b26f342 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:23:35.143981 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab88d2-c2c7-4093-8332-97ed8bf2d872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:23:35.144639 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab88d2-c2c7-4093-8332-97ed8bf2d872 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:23:35.144922 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab88d2-c2c7-4093-8332-97ed8bf2d872 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:23:35.145235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab88d2-c2c7-4093-8332-97ed8bf2d872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:23:35.147650 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-0aab88d2-c2c7-4093-8332-97ed8bf2d872 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:23:35.208650 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:23:35.271149 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab88d2-c2c7-4093-8332-97ed8bf2d872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:23:35.273970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab88d2-c2c7-4093-8332-97ed8bf2d872 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:23:35.295424 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 661/1311] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:23:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:23:37.753015 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16654d-a117-4cf6-8d73-b658d18ea5d0 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:23:37.753786 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16654d-a117-4cf6-8d73-b658d18ea5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:23:37.753786 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16654d-a117-4cf6-8d73-b658d18ea5d0 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:23:37.754996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 651/1312] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:23:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:23:37.760957 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d7876-e321-4b54-b420-624ab5fbc7da None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:23:37.761508 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d7876-e321-4b54-b420-624ab5fbc7da None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:23:37.761650 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d7876-e321-4b54-b420-624ab5fbc7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:23:37.859474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-041d7876-e321-4b54-b420-624ab5fbc7da None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:23:37.860832 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-041d7876-e321-4b54-b420-624ab5fbc7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:23:37.985272 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 662/1313] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:23:38.042639 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55175e7-b236-400f-947f-f6afb64adb8a None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:23:38.042934 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55175e7-b236-400f-947f-f6afb64adb8a None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:23:38.043196 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55175e7-b236-400f-947f-f6afb64adb8a None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:23:38.044649 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 652/1314] 10.222.0.44 () {54 vars in 965 bytes} [Tue Jul 19 15:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:23:38.051889 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac05b88-b83d-4dde-b639-b5b5abac2c52 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:23:38.052329 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac05b88-b83d-4dde-b639-b5b5abac2c52 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:23:38.052788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac05b88-b83d-4dde-b639-b5b5abac2c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:23:38.066140 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:23:38.152411 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-4ac05b88-b83d-4dde-b639-b5b5abac2c52 None None] MFA Rules not processed for user `c89e7fbcc22c478c98d74b802f4bf8f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:23:38.153726 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-4ac05b88-b83d-4dde-b639-b5b5abac2c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:23:38.242831 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 663/1315] 10.222.0.44 () {58 vars in 1062 bytes} [Tue Jul 19 15:23:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:23:38.261219 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55175e7-b236-400f-947f-f6afb64adb8a None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:23:38.262995 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-d55175e7-b236-400f-947f-f6afb64adb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:23:38.388737 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55175e7-b236-400f-947f-f6afb64adb8a None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:23:38.482003 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:23:38.485039 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b5a4e-03d6-405e-92f7-08331d424018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:23:38.485904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b5a4e-03d6-405e-92f7-08331d424018 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:23:38.486418 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b5a4e-03d6-405e-92f7-08331d424018 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:23:38.486763 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b5a4e-03d6-405e-92f7-08331d424018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:23:38.488803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-9c3b5a4e-03d6-405e-92f7-08331d424018 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:23:38.629193 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b5a4e-03d6-405e-92f7-08331d424018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:23:38.630640 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b5a4e-03d6-405e-92f7-08331d424018 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:23:38.654872 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 653/1316] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:23:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:23:41.380983 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37ea66-53eb-44ed-814e-b52ddb0196e1 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:23:41.381661 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37ea66-53eb-44ed-814e-b52ddb0196e1 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:23:41.381661 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37ea66-53eb-44ed-814e-b52ddb0196e1 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:23:41.383007 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 664/1317] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:23:41.390955 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e5970-99d1-4878-a76b-0c132b37e37e None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:23:41.391551 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e5970-99d1-4878-a76b-0c132b37e37e None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:23:41.391551 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e5970-99d1-4878-a76b-0c132b37e37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:23:41.467978 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-967e5970-99d1-4878-a76b-0c132b37e37e None None] MFA Rules not processed for user `f1ce8f6287214ffbb9b21e5891234a01`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:23:41.469316 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-967e5970-99d1-4878-a76b-0c132b37e37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:23:41.530876 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:23:41.581323 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 654/1318] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:23:41 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:23:41.627466 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37ea66-53eb-44ed-814e-b52ddb0196e1 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:23:41.629054 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-bc37ea66-53eb-44ed-814e-b52ddb0196e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:23:41.751498 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37ea66-53eb-44ed-814e-b52ddb0196e1 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:23:41.754357 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:23:41.832342 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d064eb2-ad44-43d8-b0c6-49244bc1769b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:23:41.833004 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d064eb2-ad44-43d8-b0c6-49244bc1769b service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:23:41.833293 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d064eb2-ad44-43d8-b0c6-49244bc1769b service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:23:41.834113 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d064eb2-ad44-43d8-b0c6-49244bc1769b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:23:41.836027 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-4d064eb2-ad44-43d8-b0c6-49244bc1769b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:23:42.020611 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d064eb2-ad44-43d8-b0c6-49244bc1769b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:23:42.023438 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d064eb2-ad44-43d8-b0c6-49244bc1769b service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:23:42.044215 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 665/1319] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:23:41 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:23:44.843863 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2d6a0-e61e-49ef-83df-aee3175b18ab None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:23:44.844557 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2d6a0-e61e-49ef-83df-aee3175b18ab None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:23:44.844557 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2d6a0-e61e-49ef-83df-aee3175b18ab None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:23:44.845794 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 655/1320] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:23:44.851630 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07decd6c-8134-427c-bccf-9f17ae1748b9 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:23:44.852259 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07decd6c-8134-427c-bccf-9f17ae1748b9 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:23:44.852259 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07decd6c-8134-427c-bccf-9f17ae1748b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:23:44.894459 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:23:44.921390 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-07decd6c-8134-427c-bccf-9f17ae1748b9 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:23:44.922632 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-07decd6c-8134-427c-bccf-9f17ae1748b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:23:45.024533 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 666/1321] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:23:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:23:45.064977 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2d6a0-e61e-49ef-83df-aee3175b18ab None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:23:45.066573 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-f8f2d6a0-e61e-49ef-83df-aee3175b18ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:23:45.174654 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2d6a0-e61e-49ef-83df-aee3175b18ab None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:23:45.249379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa351f-de3f-4bd8-83bd-108332db30f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:23:45.250032 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa351f-de3f-4bd8-83bd-108332db30f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:23:45.250317 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa351f-de3f-4bd8-83bd-108332db30f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:23:45.250596 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa351f-de3f-4bd8-83bd-108332db30f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:23:45.252324 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-91aa351f-de3f-4bd8-83bd-108332db30f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:23:45.260234 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:23:45.365852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa351f-de3f-4bd8-83bd-108332db30f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:23:45.367312 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa351f-de3f-4bd8-83bd-108332db30f2 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:23:45.387386 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 656/1322] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:23:45 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:23:48.251795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42da8f9-915e-463a-aa04-e4cb672a11f8 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:23:48.252337 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42da8f9-915e-463a-aa04-e4cb672a11f8 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:23:48.252517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42da8f9-915e-463a-aa04-e4cb672a11f8 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:23:48.253949 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 667/1323] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:23:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:23:48.260275 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9ad7b-c039-4218-96e9-7ed7336683a6 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:23:48.261102 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9ad7b-c039-4218-96e9-7ed7336683a6 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:23:48.261263 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9ad7b-c039-4218-96e9-7ed7336683a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:23:48.342192 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-6cf9ad7b-c039-4218-96e9-7ed7336683a6 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:23:48.343490 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-6cf9ad7b-c039-4218-96e9-7ed7336683a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:23:48.419520 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:23:48.507046 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 657/1324] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:23:48.553521 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42da8f9-915e-463a-aa04-e4cb672a11f8 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:23:48.555126 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-f42da8f9-915e-463a-aa04-e4cb672a11f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:23:48.689995 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42da8f9-915e-463a-aa04-e4cb672a11f8 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:23:48.703617 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:23:48.771974 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e3717-7f33-4cc2-aafa-08ce80caaf22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:23:48.772626 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e3717-7f33-4cc2-aafa-08ce80caaf22 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:23:48.772918 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e3717-7f33-4cc2-aafa-08ce80caaf22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:23:48.773196 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e3717-7f33-4cc2-aafa-08ce80caaf22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:23:48.775199 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-820e3717-7f33-4cc2-aafa-08ce80caaf22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:23:48.902707 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e3717-7f33-4cc2-aafa-08ce80caaf22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:23:48.902707 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e3717-7f33-4cc2-aafa-08ce80caaf22 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:23:48.928999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 668/1325] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:23:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:23:51.137294 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3abd66-b8d2-4422-babf-08b4085ea278 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:23:51.137848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3abd66-b8d2-4422-babf-08b4085ea278 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:23:51.137848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3abd66-b8d2-4422-babf-08b4085ea278 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:23:51.139324 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 658/1326] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:23:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:23:51.148561 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6219ed6-a004-4fb0-9117-2264cdaeed45 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:23:51.149382 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6219ed6-a004-4fb0-9117-2264cdaeed45 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:23:51.149501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6219ed6-a004-4fb0-9117-2264cdaeed45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:23:51.208883 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:23:51.227714 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-e6219ed6-a004-4fb0-9117-2264cdaeed45 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:23:51.228929 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-e6219ed6-a004-4fb0-9117-2264cdaeed45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:23:51.332427 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 669/1327] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:23:51.374616 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3abd66-b8d2-4422-babf-08b4085ea278 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:23:51.376269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-6c3abd66-b8d2-4422-babf-08b4085ea278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:23:51.492160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3abd66-b8d2-4422-babf-08b4085ea278 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:23:51.573351 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8adfa-2279-4c2c-9e92-432346cd7248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:23:51.574014 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8adfa-2279-4c2c-9e92-432346cd7248 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:23:51.574287 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8adfa-2279-4c2c-9e92-432346cd7248 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:23:51.574565 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8adfa-2279-4c2c-9e92-432346cd7248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:23:51.576281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-97f8adfa-2279-4c2c-9e92-432346cd7248 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:23:51.593819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:23:51.702445 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f8adfa-2279-4c2c-9e92-432346cd7248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:23:51.703962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f8adfa-2279-4c2c-9e92-432346cd7248 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:23:51.728385 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 659/1328] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:23:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:23:53.876705 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7aa7e-60f6-42bd-ae75-103bd0bef8ac None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:23:53.877627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7aa7e-60f6-42bd-ae75-103bd0bef8ac None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:23:53.877627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7aa7e-60f6-42bd-ae75-103bd0bef8ac None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:23:53.878955 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 670/1329] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:23:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:23:53.885312 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddf0e1-451c-433d-97fd-388a57ea3853 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:23:53.885931 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddf0e1-451c-433d-97fd-388a57ea3853 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:23:53.885931 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddf0e1-451c-433d-97fd-388a57ea3853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:23:53.965565 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-d0ddf0e1-451c-433d-97fd-388a57ea3853 None None] MFA Rules not processed for user `f1ce8f6287214ffbb9b21e5891234a01`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:23:53.966818 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-d0ddf0e1-451c-433d-97fd-388a57ea3853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:23:54.039995 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:23:54.089167 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 660/1330] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:23:53 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:23:54.128990 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7aa7e-60f6-42bd-ae75-103bd0bef8ac None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:23:54.130560 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-57f7aa7e-60f6-42bd-ae75-103bd0bef8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:23:54.252526 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7aa7e-60f6-42bd-ae75-103bd0bef8ac None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:23:54.275763 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:23:54.343792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84a0b2-dfe7-4eaa-b795-36bd379fefff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:23:54.344373 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84a0b2-dfe7-4eaa-b795-36bd379fefff service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:23:54.344663 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84a0b2-dfe7-4eaa-b795-36bd379fefff service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:23:54.344945 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84a0b2-dfe7-4eaa-b795-36bd379fefff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:23:54.346690 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-bc84a0b2-dfe7-4eaa-b795-36bd379fefff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:23:54.481723 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84a0b2-dfe7-4eaa-b795-36bd379fefff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:23:54.483203 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84a0b2-dfe7-4eaa-b795-36bd379fefff service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:23:54.504562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 671/1331] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:23:54 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:23:56.896321 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf0ee0-6765-47ed-8eb3-93137b8fe3e9 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:23:56.896886 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf0ee0-6765-47ed-8eb3-93137b8fe3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:23:56.896886 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf0ee0-6765-47ed-8eb3-93137b8fe3e9 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:23:56.898374 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 661/1332] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:23:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:23:56.904528 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9b084-b9e0-4709-b005-ccbf88fd3314 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:23:56.905077 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9b084-b9e0-4709-b005-ccbf88fd3314 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:23:56.905077 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9b084-b9e0-4709-b005-ccbf88fd3314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:23:56.976756 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:23:56.980092 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-b8d9b084-b9e0-4709-b005-ccbf88fd3314 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:23:56.982020 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-b8d9b084-b9e0-4709-b005-ccbf88fd3314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:23:57.091838 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 672/1333] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:23:57.128602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf0ee0-6765-47ed-8eb3-93137b8fe3e9 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:23:57.130727 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-81cf0ee0-6765-47ed-8eb3-93137b8fe3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:23:57.246014 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf0ee0-6765-47ed-8eb3-93137b8fe3e9 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:23:57.327929 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40219f28-7e3a-402e-94c9-4f898d69e761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:23:57.328590 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40219f28-7e3a-402e-94c9-4f898d69e761 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:23:57.328874 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40219f28-7e3a-402e-94c9-4f898d69e761 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:23:57.329149 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40219f28-7e3a-402e-94c9-4f898d69e761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:23:57.330883 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-40219f28-7e3a-402e-94c9-4f898d69e761 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:23:57.360108 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:23:57.448335 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40219f28-7e3a-402e-94c9-4f898d69e761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:23:57.449947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40219f28-7e3a-402e-94c9-4f898d69e761 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:23:57.471356 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 662/1334] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:23:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:23:59.668615 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5493ae-da58-40f9-938e-5722c06d0298 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:23:59.669184 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5493ae-da58-40f9-938e-5722c06d0298 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:23:59.669184 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5493ae-da58-40f9-938e-5722c06d0298 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:23:59.670552 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 673/1335] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:23:59.676110 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb6ff5-1fe9-493d-b358-48eb82470652 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:23:59.677176 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb6ff5-1fe9-493d-b358-48eb82470652 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:23:59.677310 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb6ff5-1fe9-493d-b358-48eb82470652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:23:59.748470 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-d1bb6ff5-1fe9-493d-b358-48eb82470652 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:23:59.749703 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-d1bb6ff5-1fe9-493d-b358-48eb82470652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:23:59.836952 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:23:59.863612 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 663/1336] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:23:59.906723 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5493ae-da58-40f9-938e-5722c06d0298 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:23:59.908370 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-1b5493ae-da58-40f9-938e-5722c06d0298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:00.029471 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5493ae-da58-40f9-938e-5722c06d0298 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:24:00.072251 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:00.126022 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd03396-ba70-493a-baa7-74ddd95f48ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:24:00.126722 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd03396-ba70-493a-baa7-74ddd95f48ab service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:00.127010 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd03396-ba70-493a-baa7-74ddd95f48ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:00.127335 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd03396-ba70-493a-baa7-74ddd95f48ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:00.129161 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-0fd03396-ba70-493a-baa7-74ddd95f48ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:00.258441 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd03396-ba70-493a-baa7-74ddd95f48ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:24:00.259923 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd03396-ba70-493a-baa7-74ddd95f48ab service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:24:00.281438 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 674/1337] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:23:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:24:02.858767 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7e478-85c3-4803-b49e-143f17a6c4b4 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:02.859513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7e478-85c3-4803-b49e-143f17a6c4b4 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:02.859513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7e478-85c3-4803-b49e-143f17a6c4b4 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:02.860760 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 664/1338] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:24:02.867265 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e7b33-e2ed-40b1-b453-5f73f7c6db82 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:02.868082 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e7b33-e2ed-40b1-b453-5f73f7c6db82 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:02.868082 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e7b33-e2ed-40b1-b453-5f73f7c6db82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:02.944932 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-df9e7b33-e2ed-40b1-b453-5f73f7c6db82 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:24:02.946252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-df9e7b33-e2ed-40b1-b453-5f73f7c6db82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:02.957145 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:03.070325 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 675/1339] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:24:02 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:24:03.112154 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7e478-85c3-4803-b49e-143f17a6c4b4 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:24:03.114382 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-44b7e478-85c3-4803-b49e-143f17a6c4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:03.240687 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7e478-85c3-4803-b49e-143f17a6c4b4 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:24:03.322863 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d5bcc-6548-431e-b51a-1ff791d9351a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:24:03.323578 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d5bcc-6548-431e-b51a-1ff791d9351a service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:03.323868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d5bcc-6548-431e-b51a-1ff791d9351a service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:03.324149 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d5bcc-6548-431e-b51a-1ff791d9351a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:03.325881 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-787d5bcc-6548-431e-b51a-1ff791d9351a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:03.364103 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:03.441782 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d5bcc-6548-431e-b51a-1ff791d9351a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:24:03.443211 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d5bcc-6548-431e-b51a-1ff791d9351a service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:24:03.462025 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 665/1340] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:24:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:24:08.259203 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4663e6-42ca-4728-bf29-33aa8894f4cf None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:08.259892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4663e6-42ca-4728-bf29-33aa8894f4cf None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:08.259892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4663e6-42ca-4728-bf29-33aa8894f4cf None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:08.261422 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 676/1341] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:24:08.267181 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff97edd-c515-4658-ba35-cc8a6f0642f2 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:08.268074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff97edd-c515-4658-ba35-cc8a6f0642f2 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:08.268074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff97edd-c515-4658-ba35-cc8a6f0642f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:08.373599 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-bff97edd-c515-4658-ba35-cc8a6f0642f2 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:24:08.374761 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-bff97edd-c515-4658-ba35-cc8a6f0642f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:08.484299 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:08.497812 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 666/1342] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:24:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:24:08.538238 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4663e6-42ca-4728-bf29-33aa8894f4cf None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:24:08.540197 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-fc4663e6-42ca-4728-bf29-33aa8894f4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:08.679779 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4663e6-42ca-4728-bf29-33aa8894f4cf None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:24:08.740186 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:08.797161 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148924d-b667-489d-abe3-8c8ad0500be1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:24:08.797822 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148924d-b667-489d-abe3-8c8ad0500be1 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:08.798118 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148924d-b667-489d-abe3-8c8ad0500be1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:08.798398 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148924d-b667-489d-abe3-8c8ad0500be1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:08.800182 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-8148924d-b667-489d-abe3-8c8ad0500be1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:08.926607 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148924d-b667-489d-abe3-8c8ad0500be1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:24:08.928063 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148924d-b667-489d-abe3-8c8ad0500be1 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:24:08.951908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 677/1343] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:24:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:24:11.689994 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d698c28-f381-4421-b181-568be1025fce None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:11.690570 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d698c28-f381-4421-b181-568be1025fce None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:11.690663 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d698c28-f381-4421-b181-568be1025fce None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:11.692153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 667/1344] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:24:11.697701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346fe58-34e2-4761-83ea-ece0a528c531 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:11.698178 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346fe58-34e2-4761-83ea-ece0a528c531 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:11.698285 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346fe58-34e2-4761-83ea-ece0a528c531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:11.778768 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-a346fe58-34e2-4761-83ea-ece0a528c531 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:24:11.780038 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-a346fe58-34e2-4761-83ea-ece0a528c531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:11.802015 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:11.909187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 678/1345] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:24:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:24:11.951679 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d698c28-f381-4421-b181-568be1025fce None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:24:11.953306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-0d698c28-f381-4421-b181-568be1025fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:12.077714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d698c28-f381-4421-b181-568be1025fce None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:24:12.173825 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014686b5-e264-41b7-ad21-5299b8bdc8a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:24:12.174400 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014686b5-e264-41b7-ad21-5299b8bdc8a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:12.174689 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014686b5-e264-41b7-ad21-5299b8bdc8a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:12.174962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014686b5-e264-41b7-ad21-5299b8bdc8a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:12.177278 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-014686b5-e264-41b7-ad21-5299b8bdc8a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:12.227848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:12.304904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014686b5-e264-41b7-ad21-5299b8bdc8a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:24:12.306339 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014686b5-e264-41b7-ad21-5299b8bdc8a0 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:24:12.324709 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 668/1346] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:24:11 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:24:16.431127 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197a163-5b96-47d1-8fe5-7c192095eca0 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:16.431770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197a163-5b96-47d1-8fe5-7c192095eca0 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:16.431770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197a163-5b96-47d1-8fe5-7c192095eca0 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:16.433202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 679/1347] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:24:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:24:16.441933 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db498027-0906-48e5-b78d-aaec9c658076 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:16.442527 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db498027-0906-48e5-b78d-aaec9c658076 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:16.442925 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db498027-0906-48e5-b78d-aaec9c658076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:16.516467 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-db498027-0906-48e5-b78d-aaec9c658076 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:24:16.517296 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-db498027-0906-48e5-b78d-aaec9c658076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:16.618902 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:16.621818 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 669/1348] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:24:16.661229 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197a163-5b96-47d1-8fe5-7c192095eca0 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:24:16.662805 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-f197a163-5b96-47d1-8fe5-7c192095eca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:16.812171 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197a163-5b96-47d1-8fe5-7c192095eca0 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:24:16.867035 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:16.895835 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febf611-1120-4368-bc53-a9762b726b6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:24:16.896497 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febf611-1120-4368-bc53-a9762b726b6a service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:16.896787 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febf611-1120-4368-bc53-a9762b726b6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:16.897069 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febf611-1120-4368-bc53-a9762b726b6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:16.899052 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-2febf611-1120-4368-bc53-a9762b726b6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:17.024137 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2febf611-1120-4368-bc53-a9762b726b6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:24:17.025672 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2febf611-1120-4368-bc53-a9762b726b6a service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:24:17.044732 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 680/1349] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:24:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:24:22.096973 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c8905-e2ab-4d78-9dec-dfa6d6e4421c None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:22.098601 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c8905-e2ab-4d78-9dec-dfa6d6e4421c None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:22.099107 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c8905-e2ab-4d78-9dec-dfa6d6e4421c None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:22.101324 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 670/1350] 10.222.0.44 () {54 vars in 921 bytes} [Tue Jul 19 15:24:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:24:22.108155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fb5ae-2bd7-430d-ac2e-5a06b4207097 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:22.108951 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fb5ae-2bd7-430d-ac2e-5a06b4207097 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:22.109488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fb5ae-2bd7-430d-ac2e-5a06b4207097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:22.230747 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-301fb5ae-2bd7-430d-ac2e-5a06b4207097 None None] MFA Rules not processed for user `2a27fe78683743c397fe7929e9053c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:24:22.232209 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-301fb5ae-2bd7-430d-ac2e-5a06b4207097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:22.252812 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:22.355164 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 681/1351] 10.222.0.44 () {58 vars in 1018 bytes} [Tue Jul 19 15:24:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:24:26.700057 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221de2e-a455-424a-b363-fa5613e89fc3 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:26.701478 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221de2e-a455-424a-b363-fa5613e89fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:26.702080 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221de2e-a455-424a-b363-fa5613e89fc3 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:26.704245 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 671/1352] 10.222.0.44 () {54 vars in 921 bytes} [Tue Jul 19 15:24:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:24:26.709207 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae45cf-9e91-4af6-9aef-a4a77c191899 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:26.709651 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae45cf-9e91-4af6-9aef-a4a77c191899 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:26.709859 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae45cf-9e91-4af6-9aef-a4a77c191899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:26.790975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-c1ae45cf-9e91-4af6-9aef-a4a77c191899 None None] MFA Rules not processed for user `2a27fe78683743c397fe7929e9053c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:24:26.792215 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-c1ae45cf-9e91-4af6-9aef-a4a77c191899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:26.882286 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:26.931306 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 682/1353] 10.222.0.44 () {58 vars in 1018 bytes} [Tue Jul 19 15:24:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:24:28.160487 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58337a-2de6-4949-8e59-a2fb41461ee0 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:28.161019 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58337a-2de6-4949-8e59-a2fb41461ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:28.161019 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58337a-2de6-4949-8e59-a2fb41461ee0 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:28.162401 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 672/1354] 10.222.0.44 () {54 vars in 921 bytes} [Tue Jul 19 15:24:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:24:28.167849 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ae58c-b562-4cf4-b4c6-72b75d99682f None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:28.168326 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ae58c-b562-4cf4-b4c6-72b75d99682f None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:28.168415 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ae58c-b562-4cf4-b4c6-72b75d99682f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:28.246383 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-a82ae58c-b562-4cf4-b4c6-72b75d99682f None None] MFA Rules not processed for user `2a27fe78683743c397fe7929e9053c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:24:28.247642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-a82ae58c-b562-4cf4-b4c6-72b75d99682f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:28.359832 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 683/1355] 10.222.0.44 () {58 vars in 1018 bytes} [Tue Jul 19 15:24:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:24:32.145215 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ed451-39fb-4454-8293-83f8116726b0 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:32.146197 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ed451-39fb-4454-8293-83f8116726b0 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:32.146654 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ed451-39fb-4454-8293-83f8116726b0 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:32.154185 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 673/1356] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:24:32 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:24:32.155818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f7755-909c-4600-8bae-284577517a5d None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:32.156864 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f7755-909c-4600-8bae-284577517a5d None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:32.157392 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f7755-909c-4600-8bae-284577517a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:32.203305 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:32.255414 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-c92f7755-909c-4600-8bae-284577517a5d None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:24:32.256839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-c92f7755-909c-4600-8bae-284577517a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:32.378977 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 684/1357] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:24:32.436661 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb56b5-1a4e-4019-b68f-0c4f35e67c03 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:32.437313 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb56b5-1a4e-4019-b68f-0c4f35e67c03 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:32.437959 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb56b5-1a4e-4019-b68f-0c4f35e67c03 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:32.439772 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 674/1358] 10.222.0.44 () {54 vars in 962 bytes} [Tue Jul 19 15:24:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:24:32.450228 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0685166-e0b8-45f5-b850-889b759b0175 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:32.451191 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0685166-e0b8-45f5-b850-889b759b0175 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:32.452092 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0685166-e0b8-45f5-b850-889b759b0175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:32.558467 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-e0685166-e0b8-45f5-b850-889b759b0175 None None] MFA Rules not processed for user `fef0511f56144ca9945b2dddfa2601a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:24:32.559737 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-e0685166-e0b8-45f5-b850-889b759b0175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:32.630216 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:32.705054 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 685/1359] 10.222.0.44 () {58 vars in 1059 bytes} [Tue Jul 19 15:24:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:24:32.713784 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb56b5-1a4e-4019-b68f-0c4f35e67c03 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:24:32.715476 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-4fdb56b5-1a4e-4019-b68f-0c4f35e67c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:32.875549 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb56b5-1a4e-4019-b68f-0c4f35e67c03 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:24:32.968261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:33.014619 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04007d-8668-4538-a05d-ce256743820c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:24:33.015479 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04007d-8668-4538-a05d-ce256743820c service nova] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:33.015862 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04007d-8668-4538-a05d-ce256743820c service nova] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:33.016243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04007d-8668-4538-a05d-ce256743820c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:33.018050 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-cf04007d-8668-4538-a05d-ce256743820c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:33.121359 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04007d-8668-4538-a05d-ce256743820c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:24:33.123145 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04007d-8668-4538-a05d-ce256743820c service nova] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:24:33.144620 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 675/1360] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:24:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:24:35.477326 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788534d-c1fe-4cf4-a9bc-db611904ea83 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:35.477924 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788534d-c1fe-4cf4-a9bc-db611904ea83 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:35.477924 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788534d-c1fe-4cf4-a9bc-db611904ea83 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:35.479262 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 686/1361] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:24:35.484543 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041bf6b-24ed-4112-b57c-c8505439d887 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:35.485023 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041bf6b-24ed-4112-b57c-c8505439d887 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:35.485107 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041bf6b-24ed-4112-b57c-c8505439d887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:35.559164 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-d041bf6b-24ed-4112-b57c-c8505439d887 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:24:35.560576 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-d041bf6b-24ed-4112-b57c-c8505439d887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:35.603438 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:35.676739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 676/1362] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:24:35.732222 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788534d-c1fe-4cf4-a9bc-db611904ea83 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:24:35.733932 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-8788534d-c1fe-4cf4-a9bc-db611904ea83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:36.012590 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788534d-c1fe-4cf4-a9bc-db611904ea83 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:24:36.025813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:36.155016 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c5a99-50fa-4947-9089-7a768806f5ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:24:36.155706 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c5a99-50fa-4947-9089-7a768806f5ec service nova] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:36.155991 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c5a99-50fa-4947-9089-7a768806f5ec service nova] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:36.156267 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c5a99-50fa-4947-9089-7a768806f5ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:36.157956 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-373c5a99-50fa-4947-9089-7a768806f5ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:36.261609 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c5a99-50fa-4947-9089-7a768806f5ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:24:36.263631 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c5a99-50fa-4947-9089-7a768806f5ec service nova] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:24:36.287000 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 687/1363] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:24:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:24:38.693720 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded0983-4376-49e1-9caa-53f9d7e71bad None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:38.694247 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded0983-4376-49e1-9caa-53f9d7e71bad None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:38.694362 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded0983-4376-49e1-9caa-53f9d7e71bad None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:38.695842 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 677/1364] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:24:38.701228 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468da3a2-f3aa-42ef-acbb-15688fb347af None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:38.701658 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468da3a2-f3aa-42ef-acbb-15688fb347af None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:38.701835 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468da3a2-f3aa-42ef-acbb-15688fb347af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:38.717565 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:38.773918 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-468da3a2-f3aa-42ef-acbb-15688fb347af None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:24:38.775148 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-468da3a2-f3aa-42ef-acbb-15688fb347af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:38.893760 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 688/1365] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:24:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:24:38.944512 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735cefc-67da-4929-b141-24b35811b87f None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:38.944844 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735cefc-67da-4929-b141-24b35811b87f None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:38.945130 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735cefc-67da-4929-b141-24b35811b87f None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:38.946502 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 678/1366] 10.222.0.44 () {54 vars in 962 bytes} [Tue Jul 19 15:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:24:38.952443 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f4860-9750-4878-8e08-3d25aee1a125 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:38.952880 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f4860-9750-4878-8e08-3d25aee1a125 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:38.953234 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f4860-9750-4878-8e08-3d25aee1a125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:39.041190 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-262f4860-9750-4878-8e08-3d25aee1a125 None None] MFA Rules not processed for user `fef0511f56144ca9945b2dddfa2601a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:24:39.042419 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-262f4860-9750-4878-8e08-3d25aee1a125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:39.079882 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:39.172169 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 689/1367] 10.222.0.44 () {58 vars in 1059 bytes} [Tue Jul 19 15:24:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:24:39.180038 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735cefc-67da-4929-b141-24b35811b87f None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:24:39.181601 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-9735cefc-67da-4929-b141-24b35811b87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:39.354241 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735cefc-67da-4929-b141-24b35811b87f None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:24:39.379056 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:39.491693 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95070480-62c3-4b00-a837-848fb4925527 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:24:39.492271 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95070480-62c3-4b00-a837-848fb4925527 service nova] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:39.492564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95070480-62c3-4b00-a837-848fb4925527 service nova] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:39.492846 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95070480-62c3-4b00-a837-848fb4925527 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:39.494686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-95070480-62c3-4b00-a837-848fb4925527 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:39.615249 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95070480-62c3-4b00-a837-848fb4925527 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:24:39.615249 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95070480-62c3-4b00-a837-848fb4925527 service nova] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:24:39.643029 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 679/1368] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:24:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:24:40.608632 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a08617-c5c5-4fc1-a913-053019505f90 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:40.609216 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a08617-c5c5-4fc1-a913-053019505f90 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:40.609216 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a08617-c5c5-4fc1-a913-053019505f90 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:40.610780 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 690/1369] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:24:40.616041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c87b7d-eec0-424c-9244-83126193e168 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:40.616540 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c87b7d-eec0-424c-9244-83126193e168 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:40.616651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c87b7d-eec0-424c-9244-83126193e168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:40.652657 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:40.695322 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-f9c87b7d-eec0-424c-9244-83126193e168 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:24:40.696791 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-f9c87b7d-eec0-424c-9244-83126193e168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:40.821427 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 680/1370] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:24:41.177072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d33615-7b20-4da9-b57e-5894722390c5 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:41.177072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d33615-7b20-4da9-b57e-5894722390c5 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:41.177072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d33615-7b20-4da9-b57e-5894722390c5 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:41.177569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 691/1371] 10.222.0.44 () {54 vars in 964 bytes} [Tue Jul 19 15:24:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:24:41.182386 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352cfa4-2db6-4800-b2c9-e89662256b90 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:41.182686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352cfa4-2db6-4800-b2c9-e89662256b90 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:41.182974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352cfa4-2db6-4800-b2c9-e89662256b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:41.265657 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-e352cfa4-2db6-4800-b2c9-e89662256b90 None None] MFA Rules not processed for user `fcf1f5f0ccf8449191a8660e5b1906d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:24:41.267000 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-e352cfa4-2db6-4800-b2c9-e89662256b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:41.338989 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:41.391534 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 681/1372] 10.222.0.44 () {58 vars in 1061 bytes} [Tue Jul 19 15:24:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:24:41.406280 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d33615-7b20-4da9-b57e-5894722390c5 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:24:41.410208 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-58d33615-7b20-4da9-b57e-5894722390c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:41.587074 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d33615-7b20-4da9-b57e-5894722390c5 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:24:41.636582 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:41.674917 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370255e-4d77-4cdc-88e4-f0688dd6f02b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:24:41.676171 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370255e-4d77-4cdc-88e4-f0688dd6f02b service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:41.677008 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370255e-4d77-4cdc-88e4-f0688dd6f02b service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:41.677473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370255e-4d77-4cdc-88e4-f0688dd6f02b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:41.679479 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-8370255e-4d77-4cdc-88e4-f0688dd6f02b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:41.815528 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8370255e-4d77-4cdc-88e4-f0688dd6f02b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:24:41.816862 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8370255e-4d77-4cdc-88e4-f0688dd6f02b service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:24:41.824915 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6afd92-4c74-4049-8495-3656f1f57695 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:41.825358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6afd92-4c74-4049-8495-3656f1f57695 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:41.825853 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6afd92-4c74-4049-8495-3656f1f57695 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:41.827764 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 682/1373] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:24:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:24:41.833791 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad250dc-2d54-446f-bd26-513636711040 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:41.834166 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad250dc-2d54-446f-bd26-513636711040 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:41.834528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad250dc-2d54-446f-bd26-513636711040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:41.847400 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 692/1374] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:24:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:24:41.940327 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-bad250dc-2d54-446f-bd26-513636711040 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:24:41.942541 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-bad250dc-2d54-446f-bd26-513636711040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:42.102852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 683/1375] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:24:42.148409 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370255e-4d77-4cdc-88e4-f0688dd6f02b service cinder] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:24:42.149650 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-8370255e-4d77-4cdc-88e4-f0688dd6f02b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:42.228828 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:42.274792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370255e-4d77-4cdc-88e4-f0688dd6f02b service cinder] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:24:42.402534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306cc3c-5994-40d0-ba2f-f328d68d0d2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:24:42.403186 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306cc3c-5994-40d0-ba2f-f328d68d0d2e service nova] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:42.403499 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306cc3c-5994-40d0-ba2f-f328d68d0d2e service nova] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:42.403778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306cc3c-5994-40d0-ba2f-f328d68d0d2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:42.405446 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-d306cc3c-5994-40d0-ba2f-f328d68d0d2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:42.500244 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:42.513070 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306cc3c-5994-40d0-ba2f-f328d68d0d2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:24:42.514700 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306cc3c-5994-40d0-ba2f-f328d68d0d2e service nova] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:24:42.543403 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 693/1376] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:24:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:24:44.671400 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268faa0-3787-4b93-85a9-66f58c6b577f None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:44.671951 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268faa0-3787-4b93-85a9-66f58c6b577f None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:44.671951 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268faa0-3787-4b93-85a9-66f58c6b577f None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:44.673407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 684/1377] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:24:44.679270 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eeac32-d6b6-4d34-8f34-8b4d83fbcce7 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:44.680062 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eeac32-d6b6-4d34-8f34-8b4d83fbcce7 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:44.680344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eeac32-d6b6-4d34-8f34-8b4d83fbcce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:44.759001 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-77eeac32-d6b6-4d34-8f34-8b4d83fbcce7 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:24:44.760245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-77eeac32-d6b6-4d34-8f34-8b4d83fbcce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:44.884021 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 694/1378] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:24:44.943910 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268faa0-3787-4b93-85a9-66f58c6b577f None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:24:44.947313 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-7268faa0-3787-4b93-85a9-66f58c6b577f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:45.006322 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:45.117589 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268faa0-3787-4b93-85a9-66f58c6b577f None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:24:45.231202 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcca802-a3ff-47b2-95e0-e3495f978f82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:24:45.231888 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcca802-a3ff-47b2-95e0-e3495f978f82 service nova] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:45.232178 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcca802-a3ff-47b2-95e0-e3495f978f82 service nova] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:45.232459 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcca802-a3ff-47b2-95e0-e3495f978f82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:45.234145 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-edcca802-a3ff-47b2-95e0-e3495f978f82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:45.245875 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:45.340855 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcca802-a3ff-47b2-95e0-e3495f978f82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:24:45.342539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcca802-a3ff-47b2-95e0-e3495f978f82 service nova] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:24:45.360447 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 685/1379] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:24:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:24:47.524906 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d4275-a1d9-4fb9-9d7d-9c3ef2e9a71e None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:47.525523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d4275-a1d9-4fb9-9d7d-9c3ef2e9a71e None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:47.525523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d4275-a1d9-4fb9-9d7d-9c3ef2e9a71e None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:47.527291 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 695/1380] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:24:47.533862 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6db800-60ec-4da7-9a87-c24fb9c89fe8 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:47.534461 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6db800-60ec-4da7-9a87-c24fb9c89fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:47.534461 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6db800-60ec-4da7-9a87-c24fb9c89fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:47.611817 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-4a6db800-60ec-4da7-9a87-c24fb9c89fe8 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:24:47.613007 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-4a6db800-60ec-4da7-9a87-c24fb9c89fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:47.709928 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:47.727328 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 686/1381] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:24:47.771935 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d4275-a1d9-4fb9-9d7d-9c3ef2e9a71e None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:24:47.773965 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-5e1d4275-a1d9-4fb9-9d7d-9c3ef2e9a71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:47.874132 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:47.978489 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d4275-a1d9-4fb9-9d7d-9c3ef2e9a71e None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:24:48.134971 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdeb2b6-41d8-47f6-8fbe-d85880517f0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:24:48.135780 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdeb2b6-41d8-47f6-8fbe-d85880517f0c service nova] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:48.136239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdeb2b6-41d8-47f6-8fbe-d85880517f0c service nova] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:48.136754 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdeb2b6-41d8-47f6-8fbe-d85880517f0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:48.139501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-dbdeb2b6-41d8-47f6-8fbe-d85880517f0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:48.175051 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:48.278841 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdeb2b6-41d8-47f6-8fbe-d85880517f0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:24:48.280945 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdeb2b6-41d8-47f6-8fbe-d85880517f0c service nova] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:24:48.306035 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 696/1382] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:24:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:24:50.427267 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05eed1f-ca7d-47bb-a782-1d0fa48863dc None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:50.427941 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05eed1f-ca7d-47bb-a782-1d0fa48863dc None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:50.427941 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05eed1f-ca7d-47bb-a782-1d0fa48863dc None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:50.429162 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 687/1383] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:24:50.436843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c466e-d89f-47c9-9f2b-27ca7008c58e None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:50.437797 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c466e-d89f-47c9-9f2b-27ca7008c58e None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:50.437797 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c466e-d89f-47c9-9f2b-27ca7008c58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:50.518263 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-7e9c466e-d89f-47c9-9f2b-27ca7008c58e None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:24:50.519599 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-7e9c466e-d89f-47c9-9f2b-27ca7008c58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:50.624648 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:50.632852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 697/1384] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:24:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:24:50.704304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05eed1f-ca7d-47bb-a782-1d0fa48863dc None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:24:50.705948 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-d05eed1f-ca7d-47bb-a782-1d0fa48863dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:50.886862 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05eed1f-ca7d-47bb-a782-1d0fa48863dc None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:24:50.959423 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:51.025583 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7490d9-22c7-4186-9613-4438c427fd9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:24:51.026296 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7490d9-22c7-4186-9613-4438c427fd9c service nova] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:51.026532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7490d9-22c7-4186-9613-4438c427fd9c service nova] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:51.026807 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7490d9-22c7-4186-9613-4438c427fd9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:51.028537 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-ff7490d9-22c7-4186-9613-4438c427fd9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:51.138515 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7490d9-22c7-4186-9613-4438c427fd9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:24:51.140179 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7490d9-22c7-4186-9613-4438c427fd9c service nova] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:24:51.161608 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 688/1385] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:24:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:24:53.492488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ec2d5-3b99-493a-b71a-7487091042bd None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:53.493186 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ec2d5-3b99-493a-b71a-7487091042bd None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:53.493186 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ec2d5-3b99-493a-b71a-7487091042bd None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:53.494465 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 698/1386] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:24:53.500586 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6717907-3dc1-4ca0-b7a0-c81d8c826b8b None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:53.501090 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6717907-3dc1-4ca0-b7a0-c81d8c826b8b None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:53.501318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6717907-3dc1-4ca0-b7a0-c81d8c826b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:53.570504 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-c6717907-3dc1-4ca0-b7a0-c81d8c826b8b None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:24:53.571773 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-c6717907-3dc1-4ca0-b7a0-c81d8c826b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:53.605147 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:53.696711 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 689/1387] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:24:53.744625 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ec2d5-3b99-493a-b71a-7487091042bd None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:24:53.746214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-3a0ec2d5-3b99-493a-b71a-7487091042bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:53.908740 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ec2d5-3b99-493a-b71a-7487091042bd None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:24:53.986486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:54.039156 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1de0f-7d22-492a-a763-3cd5b1ff7cfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:24:54.039846 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1de0f-7d22-492a-a763-3cd5b1ff7cfa service nova] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:54.040132 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1de0f-7d22-492a-a763-3cd5b1ff7cfa service nova] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:54.040414 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1de0f-7d22-492a-a763-3cd5b1ff7cfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:54.042159 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-6db1de0f-7d22-492a-a763-3cd5b1ff7cfa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:54.137382 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db1de0f-7d22-492a-a763-3cd5b1ff7cfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:24:54.138978 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db1de0f-7d22-492a-a763-3cd5b1ff7cfa service nova] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:24:54.158949 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 699/1388] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:24:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:24:56.468611 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f2864-5225-4835-8957-91cdda08944a None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:56.469606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f2864-5225-4835-8957-91cdda08944a None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:56.469606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f2864-5225-4835-8957-91cdda08944a None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:56.471887 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 690/1389] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:24:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:24:56.477556 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e9a11-2199-4525-b5a0-cecb57ef516b None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:56.478086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e9a11-2199-4525-b5a0-cecb57ef516b None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:56.478346 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e9a11-2199-4525-b5a0-cecb57ef516b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:56.545395 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-fd0e9a11-2199-4525-b5a0-cecb57ef516b None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:24:56.546630 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-fd0e9a11-2199-4525-b5a0-cecb57ef516b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:56.585074 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:56.652945 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 700/1390] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:24:56.698458 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f2864-5225-4835-8957-91cdda08944a None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:24:56.700064 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-0a2f2864-5225-4835-8957-91cdda08944a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:56.869253 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f2864-5225-4835-8957-91cdda08944a None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:24:56.879979 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:56.991473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664c631-5890-4865-9f8c-ae871dd174a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:24:56.992130 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664c631-5890-4865-9f8c-ae871dd174a8 service nova] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:56.992440 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664c631-5890-4865-9f8c-ae871dd174a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:56.992785 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664c631-5890-4865-9f8c-ae871dd174a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:56.995522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-b664c631-5890-4865-9f8c-ae871dd174a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:57.097672 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664c631-5890-4865-9f8c-ae871dd174a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:24:57.099312 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664c631-5890-4865-9f8c-ae871dd174a8 service nova] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:24:57.120344 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 691/1391] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:24:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:24:57.221151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7df6a6-3d8a-46ec-bf4e-1b6ebb520181 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:57.221151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7df6a6-3d8a-46ec-bf4e-1b6ebb520181 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:57.221151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7df6a6-3d8a-46ec-bf4e-1b6ebb520181 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:57.222649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 701/1392] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:24:57.228491 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a44166-dfa2-40dc-aedd-20023b46a802 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:57.228824 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a44166-dfa2-40dc-aedd-20023b46a802 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:57.229082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a44166-dfa2-40dc-aedd-20023b46a802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:57.246876 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:57.312082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-92a44166-dfa2-40dc-aedd-20023b46a802 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:24:57.313350 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-92a44166-dfa2-40dc-aedd-20023b46a802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:57.417386 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 692/1393] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:24:57.475413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455f9ee-c1eb-4409-9a88-750cbf2c69ee None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:57.475711 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455f9ee-c1eb-4409-9a88-750cbf2c69ee None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:57.475999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455f9ee-c1eb-4409-9a88-750cbf2c69ee None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:57.477521 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 702/1394] 10.222.0.44 () {54 vars in 961 bytes} [Tue Jul 19 15:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:24:57.482559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca02dc-b260-4697-ac62-c13d818607ee None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:57.483076 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca02dc-b260-4697-ac62-c13d818607ee None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:57.483488 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca02dc-b260-4697-ac62-c13d818607ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:57.560872 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-5dca02dc-b260-4697-ac62-c13d818607ee None None] MFA Rules not processed for user `3e66abbda1744a71b4d26677dcef76be`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:24:57.562102 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-5dca02dc-b260-4697-ac62-c13d818607ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:57.597830 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:57.640060 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 693/1395] 10.222.0.44 () {58 vars in 1058 bytes} [Tue Jul 19 15:24:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:24:57.648501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455f9ee-c1eb-4409-9a88-750cbf2c69ee None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:24:57.650028 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-1455f9ee-c1eb-4409-9a88-750cbf2c69ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:57.753560 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455f9ee-c1eb-4409-9a88-750cbf2c69ee None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:24:57.818022 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:57.833033 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a1127-b369-473d-b4c7-61528188d372 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e66abbda1744a71b4d26677dcef76be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:24:57.833702 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a1127-b369-473d-b4c7-61528188d372 service glance] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:57.833987 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a1127-b369-473d-b4c7-61528188d372 service glance] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:57.834312 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a1127-b369-473d-b4c7-61528188d372 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:57.839605 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-ff8a1127-b369-473d-b4c7-61528188d372 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:57.955921 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a1127-b369-473d-b4c7-61528188d372 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:24:57.957352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a1127-b369-473d-b4c7-61528188d372 service glance] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:24:57.975755 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 703/1396] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:24:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:24:58.721003 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c3508-9548-4f38-837e-0502fa5047ea None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:58.721519 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c3508-9548-4f38-837e-0502fa5047ea None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:58.721635 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c3508-9548-4f38-837e-0502fa5047ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:58.787740 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-389c3508-9548-4f38-837e-0502fa5047ea None None] MFA Rules not processed for user `cea1d8409c754ec797d6c694481a3112`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:24:58.788961 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-389c3508-9548-4f38-837e-0502fa5047ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:58.877613 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 694/1397] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jul 19 15:24:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:24:58.919629 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c99a5b-53b3-4524-b549-571cc3726589 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:58.920176 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c99a5b-53b3-4524-b549-571cc3726589 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:58.920334 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c99a5b-53b3-4524-b549-571cc3726589 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:58.921819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 704/1398] 10.222.0.44 () {54 vars in 943 bytes} [Tue Jul 19 15:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:24:58.929240 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfa7df-ab9c-4e2d-9c83-ff544fbb26c0 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:58.929630 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfa7df-ab9c-4e2d-9c83-ff544fbb26c0 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:58.929984 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfa7df-ab9c-4e2d-9c83-ff544fbb26c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:58.988777 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:59.009494 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-6abfa7df-ab9c-4e2d-9c83-ff544fbb26c0 None None] MFA Rules not processed for user `bd1dceaddb6e414faef0e0448cdf1be8`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:24:59.010702 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-6abfa7df-ab9c-4e2d-9c83-ff544fbb26c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:59.116289 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 695/1399] 10.222.0.44 () {58 vars in 1040 bytes} [Tue Jul 19 15:24:58 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:24:59.125502 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c99a5b-53b3-4524-b549-571cc3726589 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:24:59.127709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-39c99a5b-53b3-4524-b549-571cc3726589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:59.216239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:59.243925 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21e897-96cc-49cd-8bea-1a23a65e4de7 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:59.244221 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21e897-96cc-49cd-8bea-1a23a65e4de7 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:59.244509 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21e897-96cc-49cd-8bea-1a23a65e4de7 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:59.245907 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 696/1400] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:24:59.250983 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53497f-2a7b-4291-8ddb-ed1c0e8f7545 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:59.251297 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53497f-2a7b-4291-8ddb-ed1c0e8f7545 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:59.251580 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53497f-2a7b-4291-8ddb-ed1c0e8f7545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:59.265266 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c99a5b-53b3-4524-b549-571cc3726589 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:24:59.318900 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-9b53497f-2a7b-4291-8ddb-ed1c0e8f7545 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:24:59.320206 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-9b53497f-2a7b-4291-8ddb-ed1c0e8f7545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:59.380021 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1de52-15fc-4652-aa17-f2897b3c4895 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1dceaddb6e414faef0e0448cdf1be8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:24:59.380670 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1de52-15fc-4652-aa17-f2897b3c4895 service swift] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:59.380952 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1de52-15fc-4652-aa17-f2897b3c4895 service swift] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:59.381224 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1de52-15fc-4652-aa17-f2897b3c4895 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:59.382913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-a1d1de52-15fc-4652-aa17-f2897b3c4895 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:59.386561 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:59.431903 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 697/1401] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:24:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:24:59.458255 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:59.468374 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1de52-15fc-4652-aa17-f2897b3c4895 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:24:59.470473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1de52-15fc-4652-aa17-f2897b3c4895 service swift] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:24:59.476344 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53497f-2a7b-4291-8ddb-ed1c0e8f7545 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:24:59.477544 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-9b53497f-2a7b-4291-8ddb-ed1c0e8f7545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:59.479114 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 705/1402] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jul 19 15:24:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:24:59.614201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53497f-2a7b-4291-8ddb-ed1c0e8f7545 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:24:59.689180 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:59.744666 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10bbc5-7113-4cde-8d83-b6aa98476416 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:24:59.745332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10bbc5-7113-4cde-8d83-b6aa98476416 service nova] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:24:59.745503 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10bbc5-7113-4cde-8d83-b6aa98476416 service nova] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:24:59.745780 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10bbc5-7113-4cde-8d83-b6aa98476416 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:24:59.747496 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-fe10bbc5-7113-4cde-8d83-b6aa98476416 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:24:59.851634 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10bbc5-7113-4cde-8d83-b6aa98476416 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:24:59.853261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10bbc5-7113-4cde-8d83-b6aa98476416 service nova] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:24:59.874792 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 698/1403] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:24:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:25:02.002884 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8c119-5a4d-4863-9a4b-8efdcad1b3c4 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:02.003475 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8c119-5a4d-4863-9a4b-8efdcad1b3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:02.003475 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8c119-5a4d-4863-9a4b-8efdcad1b3c4 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:02.004866 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 706/1404] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:25:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:25:02.010255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e7f35-2fc3-4aa1-83d7-1016c997196e None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:02.010686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e7f35-2fc3-4aa1-83d7-1016c997196e None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:02.010824 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e7f35-2fc3-4aa1-83d7-1016c997196e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:02.091747 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-b46e7f35-2fc3-4aa1-83d7-1016c997196e None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:25:02.092998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-b46e7f35-2fc3-4aa1-83d7-1016c997196e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:02.136932 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:02.212086 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 699/1405] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:25:02.259423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8c119-5a4d-4863-9a4b-8efdcad1b3c4 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:25:02.261121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-1ff8c119-5a4d-4863-9a4b-8efdcad1b3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:02.451668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8c119-5a4d-4863-9a4b-8efdcad1b3c4 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:25:02.541705 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:02.602595 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a087609-cf66-4f90-a362-df6da6bca9a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:25:02.603302 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a087609-cf66-4f90-a362-df6da6bca9a4 service nova] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:02.603597 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a087609-cf66-4f90-a362-df6da6bca9a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:02.603874 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a087609-cf66-4f90-a362-df6da6bca9a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:02.605930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-3a087609-cf66-4f90-a362-df6da6bca9a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:02.748463 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a087609-cf66-4f90-a362-df6da6bca9a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:25:02.750527 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a087609-cf66-4f90-a362-df6da6bca9a4 service nova] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:25:02.801888 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 707/1406] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:25:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:25:04.949045 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd6e56-0ffc-44af-893c-646ed9abc0b6 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:04.949611 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd6e56-0ffc-44af-893c-646ed9abc0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:04.949611 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd6e56-0ffc-44af-893c-646ed9abc0b6 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:04.951006 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 700/1407] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:25:04.957178 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d38e3e-7ede-4226-b945-47c0ec71771c None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:04.957648 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d38e3e-7ede-4226-b945-47c0ec71771c None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:04.957755 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d38e3e-7ede-4226-b945-47c0ec71771c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:05.039146 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-00d38e3e-7ede-4226-b945-47c0ec71771c None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:25:05.040459 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-00d38e3e-7ede-4226-b945-47c0ec71771c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:05.079352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:05.163254 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 708/1408] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:25:05.207905 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd6e56-0ffc-44af-893c-646ed9abc0b6 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:25:05.209443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-02fd6e56-0ffc-44af-893c-646ed9abc0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:05.381541 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd6e56-0ffc-44af-893c-646ed9abc0b6 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:25:05.399737 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:05.518473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb8f46-2fa1-45e4-a797-65feb425856a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:25:05.519041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb8f46-2fa1-45e4-a797-65feb425856a service nova] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:05.519365 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb8f46-2fa1-45e4-a797-65feb425856a service nova] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:05.519650 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb8f46-2fa1-45e4-a797-65feb425856a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:05.521353 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-becb8f46-2fa1-45e4-a797-65feb425856a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:05.623519 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb8f46-2fa1-45e4-a797-65feb425856a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:25:05.625115 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb8f46-2fa1-45e4-a797-65feb425856a service nova] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:25:05.644703 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 701/1409] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:25:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:25:15.161099 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=31 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:15.642281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=91 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:22.361449 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0c49e-f2a1-4927-a4a5-ab24997d7f61 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:22.362058 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0c49e-f2a1-4927-a4a5-ab24997d7f61 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:22.362058 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0c49e-f2a1-4927-a4a5-ab24997d7f61 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:22.363481 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 709/1410] 10.222.0.44 () {54 vars in 918 bytes} [Tue Jul 19 15:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:25:22.368949 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec93db9-cf39-4781-bcfc-867f93a62fca None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:22.369422 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec93db9-cf39-4781-bcfc-867f93a62fca None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:22.369532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec93db9-cf39-4781-bcfc-867f93a62fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:22.448558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-3ec93db9-cf39-4781-bcfc-867f93a62fca None None] MFA Rules not processed for user `2a27fe78683743c397fe7929e9053c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:25:22.449688 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-3ec93db9-cf39-4781-bcfc-867f93a62fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:22.563431 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 702/1411] 10.222.0.44 () {58 vars in 1015 bytes} [Tue Jul 19 15:25:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:25:22.577719 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576abca1-23ab-4bb0-ae39-7b2351b421ed None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:22.578083 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576abca1-23ab-4bb0-ae39-7b2351b421ed None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:22.578450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576abca1-23ab-4bb0-ae39-7b2351b421ed None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:22.580433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 710/1412] 10.222.0.44 () {54 vars in 918 bytes} [Tue Jul 19 15:25:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:25:22.585446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288681c4-bd51-412f-a5dd-beac102d1ee6 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:22.585752 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288681c4-bd51-412f-a5dd-beac102d1ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:22.586035 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288681c4-bd51-412f-a5dd-beac102d1ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:22.667776 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:22.670610 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-288681c4-bd51-412f-a5dd-beac102d1ee6 None None] MFA Rules not processed for user `fef0511f56144ca9945b2dddfa2601a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:25:22.672378 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-288681c4-bd51-412f-a5dd-beac102d1ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:22.793492 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 703/1413] 10.222.0.44 () {58 vars in 1015 bytes} [Tue Jul 19 15:25:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:25:25.367493 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8e9df-9b4b-47bb-b8b1-ba9f98027d5e None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:25.368087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8e9df-9b4b-47bb-b8b1-ba9f98027d5e None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:25.368087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8e9df-9b4b-47bb-b8b1-ba9f98027d5e None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:25.369471 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 15:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:25:25.376144 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49344772-0d87-41a6-92b7-8df5dd123ebd None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:25.377026 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49344772-0d87-41a6-92b7-8df5dd123ebd None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:25.377188 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49344772-0d87-41a6-92b7-8df5dd123ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:25.452261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-49344772-0d87-41a6-92b7-8df5dd123ebd None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:25:25.453488 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-49344772-0d87-41a6-92b7-8df5dd123ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:25.520056 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:25.572819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 15:25:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:25:25.617875 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8e9df-9b4b-47bb-b8b1-ba9f98027d5e None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:25:25.619381 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-42f8e9df-9b4b-47bb-b8b1-ba9f98027d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:25.772282 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8e9df-9b4b-47bb-b8b1-ba9f98027d5e None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:25:25.851761 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:25.926527 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6675a-6be2-4818-878d-f74ecd74be2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:25:25.927458 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6675a-6be2-4818-878d-f74ecd74be2b service nova] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:25.927890 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6675a-6be2-4818-878d-f74ecd74be2b service nova] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:25.928307 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6675a-6be2-4818-878d-f74ecd74be2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:25.931393 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-eac6675a-6be2-4818-878d-f74ecd74be2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:26.034988 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac6675a-6be2-4818-878d-f74ecd74be2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:25:26.036638 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac6675a-6be2-4818-878d-f74ecd74be2b service nova] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:25:26.057098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 712/1416] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:25:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:25:27.025068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b48d8-59f5-4a1f-b632-87b0606c044d None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:27.025772 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b48d8-59f5-4a1f-b632-87b0606c044d None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:27.025772 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b48d8-59f5-4a1f-b632-87b0606c044d None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:27.027116 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 15:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:25:27.034081 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbd66d-6380-40e8-9605-15f207216e63 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:27.034666 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbd66d-6380-40e8-9605-15f207216e63 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:27.034895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbd66d-6380-40e8-9605-15f207216e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:27.136467 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-2cfbd66d-6380-40e8-9605-15f207216e63 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:25:27.137599 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-2cfbd66d-6380-40e8-9605-15f207216e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:27.169678 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:27.250627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 15:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:25:27.412685 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b48d8-59f5-4a1f-b632-87b0606c044d None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:25:27.414272 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-a84b48d8-59f5-4a1f-b632-87b0606c044d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:27.576917 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b48d8-59f5-4a1f-b632-87b0606c044d None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:25:27.620818 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:27.706525 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b88343-f5ba-4f20-bd5d-975020a19dac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:25:27.707095 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b88343-f5ba-4f20-bd5d-975020a19dac service nova] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:27.707405 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b88343-f5ba-4f20-bd5d-975020a19dac service nova] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:27.707681 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b88343-f5ba-4f20-bd5d-975020a19dac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:27.709427 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-e9b88343-f5ba-4f20-bd5d-975020a19dac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:27.813440 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b88343-f5ba-4f20-bd5d-975020a19dac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:25:27.815064 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b88343-f5ba-4f20-bd5d-975020a19dac service nova] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:25:27.840625 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 706/1419] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:25:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:25:28.773765 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1212c3a-1c1a-49d8-b3ea-e7c66c88ebdc None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:28.774336 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1212c3a-1c1a-49d8-b3ea-e7c66c88ebdc None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:28.774336 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1212c3a-1c1a-49d8-b3ea-e7c66c88ebdc None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:28.775768 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 15:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:25:28.782472 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78759bf1-1b0e-4a8e-962b-f87de3f579da None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:28.783074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78759bf1-1b0e-4a8e-962b-f87de3f579da None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:28.783074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78759bf1-1b0e-4a8e-962b-f87de3f579da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:28.844751 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:28.872690 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-78759bf1-1b0e-4a8e-962b-f87de3f579da None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:25:28.873961 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-78759bf1-1b0e-4a8e-962b-f87de3f579da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:28.982642 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 15:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:25:29.142654 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1212c3a-1c1a-49d8-b3ea-e7c66c88ebdc None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:25:29.144238 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-f1212c3a-1c1a-49d8-b3ea-e7c66c88ebdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:29.314759 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1212c3a-1c1a-49d8-b3ea-e7c66c88ebdc None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:25:29.329713 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:29.562034 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a276d-5410-45ec-8fb8-d7df147ab57a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:25:29.562629 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a276d-5410-45ec-8fb8-d7df147ab57a service nova] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:29.562975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a276d-5410-45ec-8fb8-d7df147ab57a service nova] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:29.563818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a276d-5410-45ec-8fb8-d7df147ab57a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:29.565620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-e65a276d-5410-45ec-8fb8-d7df147ab57a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:29.665574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a276d-5410-45ec-8fb8-d7df147ab57a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:25:29.667191 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a276d-5410-45ec-8fb8-d7df147ab57a service nova] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:25:29.687396 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 715/1422] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:25:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:25:30.625159 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161db82-9c66-42a2-9910-478dac78d418 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:30.626321 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161db82-9c66-42a2-9910-478dac78d418 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:30.626321 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161db82-9c66-42a2-9910-478dac78d418 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:30.627720 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 15:25:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:25:30.633084 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad566fbd-b62e-40ce-934c-0a09658d36bf None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:30.633576 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad566fbd-b62e-40ce-934c-0a09658d36bf None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:30.633681 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad566fbd-b62e-40ce-934c-0a09658d36bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:30.652457 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:30.724066 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-ad566fbd-b62e-40ce-934c-0a09658d36bf None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:25:30.725711 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-ad566fbd-b62e-40ce-934c-0a09658d36bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:30.851914 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 15:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:25:31.018484 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161db82-9c66-42a2-9910-478dac78d418 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:25:31.021408 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-5161db82-9c66-42a2-9910-478dac78d418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:31.218166 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:31.261275 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161db82-9c66-42a2-9910-478dac78d418 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:25:31.403168 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea98ab4-4747-450d-9c42-392d88681ecd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:25:31.404107 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea98ab4-4747-450d-9c42-392d88681ecd service nova] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:31.404517 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea98ab4-4747-450d-9c42-392d88681ecd service nova] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:31.404897 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea98ab4-4747-450d-9c42-392d88681ecd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:31.407415 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-3ea98ab4-4747-450d-9c42-392d88681ecd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:31.508661 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:31.525117 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea98ab4-4747-450d-9c42-392d88681ecd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:25:31.526770 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea98ab4-4747-450d-9c42-392d88681ecd service nova] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:25:31.549302 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 709/1425] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:25:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:25:32.499918 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767859b-211a-4332-bcdc-ab44fa4dab67 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:32.500519 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767859b-211a-4332-bcdc-ab44fa4dab67 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:32.500519 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767859b-211a-4332-bcdc-ab44fa4dab67 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:32.502308 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 15:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:25:32.508184 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ea354-6e78-4b72-bf94-cb019ca8a4e1 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:32.509058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ea354-6e78-4b72-bf94-cb019ca8a4e1 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:32.509275 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ea354-6e78-4b72-bf94-cb019ca8a4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:32.599983 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-683ea354-6e78-4b72-bf94-cb019ca8a4e1 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:25:32.601266 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-683ea354-6e78-4b72-bf94-cb019ca8a4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:32.713795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 15:25:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:25:32.866443 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767859b-211a-4332-bcdc-ab44fa4dab67 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:25:32.868110 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-4767859b-211a-4332-bcdc-ab44fa4dab67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:32.968597 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:33.042153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767859b-211a-4332-bcdc-ab44fa4dab67 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:25:33.171553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022fcd2-4821-4636-885f-cc7c7e6ec12d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:25:33.172224 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022fcd2-4821-4636-885f-cc7c7e6ec12d service nova] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:33.172516 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022fcd2-4821-4636-885f-cc7c7e6ec12d service nova] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:33.172795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022fcd2-4821-4636-885f-cc7c7e6ec12d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:33.174539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-7022fcd2-4821-4636-885f-cc7c7e6ec12d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:33.228277 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:33.277228 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022fcd2-4821-4636-885f-cc7c7e6ec12d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:25:33.279015 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022fcd2-4821-4636-885f-cc7c7e6ec12d service nova] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:25:33.301346 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 718/1428] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:25:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:25:34.213795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fb5b7-a25c-4437-bd2e-62d0c3fd8219 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:34.214344 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fb5b7-a25c-4437-bd2e-62d0c3fd8219 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:34.214344 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fb5b7-a25c-4437-bd2e-62d0c3fd8219 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:34.215818 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 15:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:25:34.222170 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d278fc-eabb-499a-a124-6eb6472f4acc None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:34.222754 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d278fc-eabb-499a-a124-6eb6472f4acc None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:34.222754 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d278fc-eabb-499a-a124-6eb6472f4acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:34.309831 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-a0d278fc-eabb-499a-a124-6eb6472f4acc None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:25:34.311065 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-a0d278fc-eabb-499a-a124-6eb6472f4acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:34.418193 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 15:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:25:34.587204 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fb5b7-a25c-4437-bd2e-62d0c3fd8219 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:25:34.588799 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-ec6fb5b7-a25c-4437-bd2e-62d0c3fd8219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:34.646193 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:34.769280 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fb5b7-a25c-4437-bd2e-62d0c3fd8219 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:25:34.905861 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54999c24-1a60-4216-9a7e-daa73f302b2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:25:34.906547 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54999c24-1a60-4216-9a7e-daa73f302b2d service nova] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:34.907450 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54999c24-1a60-4216-9a7e-daa73f302b2d service nova] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:34.907739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54999c24-1a60-4216-9a7e-daa73f302b2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:34.909459 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-54999c24-1a60-4216-9a7e-daa73f302b2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:34.917388 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:35.008185 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54999c24-1a60-4216-9a7e-daa73f302b2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:25:35.009794 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54999c24-1a60-4216-9a7e-daa73f302b2d service nova] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:25:35.034159 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 712/1431] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:25:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:25:35.884600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd84ff-1e52-432e-bfa2-d9bd06909261 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:35.885468 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd84ff-1e52-432e-bfa2-d9bd06909261 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:35.885682 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd84ff-1e52-432e-bfa2-d9bd06909261 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:35.887257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 15:25:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:25:35.893254 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8478a31-cfea-41e5-a4f3-e6f042692b02 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:35.893824 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8478a31-cfea-41e5-a4f3-e6f042692b02 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:35.893824 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8478a31-cfea-41e5-a4f3-e6f042692b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:35.985532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-b8478a31-cfea-41e5-a4f3-e6f042692b02 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:25:35.987253 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-b8478a31-cfea-41e5-a4f3-e6f042692b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:36.073609 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:36.110407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 15:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:25:36.265666 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd84ff-1e52-432e-bfa2-d9bd06909261 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:25:36.268324 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-39fd84ff-1e52-432e-bfa2-d9bd06909261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:36.305243 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:36.498646 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd84ff-1e52-432e-bfa2-d9bd06909261 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:25:36.616023 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:36.648568 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670067b0-d959-40a6-9d9b-4584d9ad870e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:25:36.649355 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670067b0-d959-40a6-9d9b-4584d9ad870e service nova] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:36.649640 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670067b0-d959-40a6-9d9b-4584d9ad870e service nova] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:36.649918 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670067b0-d959-40a6-9d9b-4584d9ad870e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:36.651722 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-670067b0-d959-40a6-9d9b-4584d9ad870e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:36.767396 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670067b0-d959-40a6-9d9b-4584d9ad870e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:25:36.768937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670067b0-d959-40a6-9d9b-4584d9ad870e service nova] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:25:36.791089 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 721/1434] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:25:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:25:37.636735 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c0b80-2649-4cc0-a0d8-48fe041cf88b None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:37.637315 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c0b80-2649-4cc0-a0d8-48fe041cf88b None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:37.637315 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c0b80-2649-4cc0-a0d8-48fe041cf88b None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:37.638768 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 15:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:25:37.654411 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90df23d-301f-43eb-a0b0-c1d0c1660055 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:37.655008 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90df23d-301f-43eb-a0b0-c1d0c1660055 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:37.655451 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90df23d-301f-43eb-a0b0-c1d0c1660055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:37.770687 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-f90df23d-301f-43eb-a0b0-c1d0c1660055 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:25:37.771967 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-f90df23d-301f-43eb-a0b0-c1d0c1660055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:37.819188 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:37.880949 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 15:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:25:38.036796 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c0b80-2649-4cc0-a0d8-48fe041cf88b None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:25:38.038499 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-235c0b80-2649-4cc0-a0d8-48fe041cf88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:38.205333 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c0b80-2649-4cc0-a0d8-48fe041cf88b None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:25:38.278880 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:38.342878 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049c32e-47ca-4966-83dd-843682a38823 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:25:38.343634 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049c32e-47ca-4966-83dd-843682a38823 service nova] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:38.343922 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049c32e-47ca-4966-83dd-843682a38823 service nova] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:38.344203 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049c32e-47ca-4966-83dd-843682a38823 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:38.345929 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-8049c32e-47ca-4966-83dd-843682a38823 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:38.462804 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8049c32e-47ca-4966-83dd-843682a38823 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:25:38.464385 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8049c32e-47ca-4966-83dd-843682a38823 service nova] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:25:38.484869 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 715/1437] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:25:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:25:39.416299 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09827d09-2de7-4054-aa5f-5ad258569dfe None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:39.417193 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09827d09-2de7-4054-aa5f-5ad258569dfe None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:39.417193 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09827d09-2de7-4054-aa5f-5ad258569dfe None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:39.418568 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 15:25:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:25:39.423871 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad759d8a-1540-42b3-b9d2-d57e18091e0b None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:39.424414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad759d8a-1540-42b3-b9d2-d57e18091e0b None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:39.424414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad759d8a-1540-42b3-b9d2-d57e18091e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:39.505767 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-ad759d8a-1540-42b3-b9d2-d57e18091e0b None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:25:39.506986 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-ad759d8a-1540-42b3-b9d2-d57e18091e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:39.509147 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:39.619884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 15:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:25:39.781449 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09827d09-2de7-4054-aa5f-5ad258569dfe None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:25:39.783210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-09827d09-2de7-4054-aa5f-5ad258569dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:39.958827 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09827d09-2de7-4054-aa5f-5ad258569dfe None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:25:39.992870 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:40.087723 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7c14e-14eb-413e-8e93-ed0dd6a32fb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:25:40.088798 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7c14e-14eb-413e-8e93-ed0dd6a32fb5 service nova] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:40.089147 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7c14e-14eb-413e-8e93-ed0dd6a32fb5 service nova] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:40.089479 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7c14e-14eb-413e-8e93-ed0dd6a32fb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:40.091585 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-4ce7c14e-14eb-413e-8e93-ed0dd6a32fb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:40.190158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7c14e-14eb-413e-8e93-ed0dd6a32fb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:25:40.191831 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7c14e-14eb-413e-8e93-ed0dd6a32fb5 service nova] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:25:40.211460 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 724/1440] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:25:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:25:42.174656 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477e72b-cad8-4a4b-8061-3c3a0c902860 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:42.175203 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477e72b-cad8-4a4b-8061-3c3a0c902860 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:42.175203 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477e72b-cad8-4a4b-8061-3c3a0c902860 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:42.176725 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 15:25:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:25:42.182592 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc37ec-6814-446d-bf2e-ab8acb64b0b7 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:42.183070 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc37ec-6814-446d-bf2e-ab8acb64b0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:42.183174 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc37ec-6814-446d-bf2e-ab8acb64b0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:42.225241 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:42.262922 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-f9bc37ec-6814-446d-bf2e-ab8acb64b0b7 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:25:42.264182 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-f9bc37ec-6814-446d-bf2e-ab8acb64b0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:42.385230 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 15:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:25:42.435365 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477e72b-cad8-4a4b-8061-3c3a0c902860 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:25:42.436924 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-d477e72b-cad8-4a4b-8061-3c3a0c902860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:42.576566 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477e72b-cad8-4a4b-8061-3c3a0c902860 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:25:42.610291 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:42.654349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1a8cb-ca18-4a3b-8c7e-328cb890fba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:25:42.655013 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1a8cb-ca18-4a3b-8c7e-328cb890fba6 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:42.655320 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1a8cb-ca18-4a3b-8c7e-328cb890fba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:42.657819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1a8cb-ca18-4a3b-8c7e-328cb890fba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:42.657992 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-0ef1a8cb-ca18-4a3b-8c7e-328cb890fba6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:42.784243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1a8cb-ca18-4a3b-8c7e-328cb890fba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:25:42.786690 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1a8cb-ca18-4a3b-8c7e-328cb890fba6 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:25:42.810715 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 718/1443] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:25:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:25:45.061763 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3b322-6cb1-4d0a-963a-367027ad01d7 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:45.062424 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3b322-6cb1-4d0a-963a-367027ad01d7 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:45.062424 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3b322-6cb1-4d0a-963a-367027ad01d7 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:45.064672 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 15:25:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:25:45.071862 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004d3fe-75e8-41dc-8fab-239c71cc2e82 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:45.072494 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004d3fe-75e8-41dc-8fab-239c71cc2e82 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:45.072494 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004d3fe-75e8-41dc-8fab-239c71cc2e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:45.145080 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-a004d3fe-75e8-41dc-8fab-239c71cc2e82 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:25:45.146235 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-a004d3fe-75e8-41dc-8fab-239c71cc2e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:45.160820 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:45.252472 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 15:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:25:45.290917 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3b322-6cb1-4d0a-963a-367027ad01d7 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:25:45.292505 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-2fe3b322-6cb1-4d0a-963a-367027ad01d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:45.413065 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3b322-6cb1-4d0a-963a-367027ad01d7 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:25:45.426604 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:45.495506 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529a90a-d2cc-4999-ad18-8109b1a87954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:25:45.496193 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529a90a-d2cc-4999-ad18-8109b1a87954 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:45.496483 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529a90a-d2cc-4999-ad18-8109b1a87954 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:45.496768 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529a90a-d2cc-4999-ad18-8109b1a87954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:45.498542 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-4529a90a-d2cc-4999-ad18-8109b1a87954 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:45.634181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529a90a-d2cc-4999-ad18-8109b1a87954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:25:45.635735 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529a90a-d2cc-4999-ad18-8109b1a87954 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:25:45.658565 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 727/1446] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:25:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:25:48.244817 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c392365-4542-49be-a0dd-9668c69a58c0 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:48.245398 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c392365-4542-49be-a0dd-9668c69a58c0 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:48.245398 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c392365-4542-49be-a0dd-9668c69a58c0 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:48.246786 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 15:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:25:48.253421 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c20118-80af-4a3f-b0d2-f0cab0bf2364 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:48.253989 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c20118-80af-4a3f-b0d2-f0cab0bf2364 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:48.253989 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c20118-80af-4a3f-b0d2-f0cab0bf2364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:48.311310 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:48.331681 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-e6c20118-80af-4a3f-b0d2-f0cab0bf2364 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:25:48.332898 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-e6c20118-80af-4a3f-b0d2-f0cab0bf2364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:48.444796 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 15:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:25:48.496631 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c392365-4542-49be-a0dd-9668c69a58c0 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:25:48.498251 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-6c392365-4542-49be-a0dd-9668c69a58c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:48.609014 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c392365-4542-49be-a0dd-9668c69a58c0 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:25:48.663075 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:48.700175 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfac54f-c468-4926-990a-0da3b64c7414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:25:48.700741 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfac54f-c468-4926-990a-0da3b64c7414 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:48.701029 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfac54f-c468-4926-990a-0da3b64c7414 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:48.701308 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfac54f-c468-4926-990a-0da3b64c7414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:48.703001 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-2dfac54f-c468-4926-990a-0da3b64c7414 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:48.820296 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfac54f-c468-4926-990a-0da3b64c7414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:25:48.821725 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfac54f-c468-4926-990a-0da3b64c7414 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:25:48.840268 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 721/1449] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:25:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:25:51.071694 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34c29d-5134-4a61-b8dd-65769c4bd597 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:51.072238 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34c29d-5134-4a61-b8dd-65769c4bd597 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:51.072238 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34c29d-5134-4a61-b8dd-65769c4bd597 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:51.073648 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 15:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:25:51.078971 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8dbc3-af59-4590-9425-ad16e60b5d42 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:51.079407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8dbc3-af59-4590-9425-ad16e60b5d42 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:51.079587 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8dbc3-af59-4590-9425-ad16e60b5d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:51.147654 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-30a8dbc3-af59-4590-9425-ad16e60b5d42 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:25:51.149073 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-30a8dbc3-af59-4590-9425-ad16e60b5d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:51.172667 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:51.258490 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 15:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:25:51.300209 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34c29d-5134-4a61-b8dd-65769c4bd597 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:25:51.301785 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-fe34c29d-5134-4a61-b8dd-65769c4bd597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:51.414707 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34c29d-5134-4a61-b8dd-65769c4bd597 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:25:51.435118 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:51.493264 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13bf47-6162-49d7-856c-11674f913155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:25:51.493945 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13bf47-6162-49d7-856c-11674f913155 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:51.494242 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13bf47-6162-49d7-856c-11674f913155 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:51.494556 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13bf47-6162-49d7-856c-11674f913155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:51.496401 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-fb13bf47-6162-49d7-856c-11674f913155 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:51.623642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13bf47-6162-49d7-856c-11674f913155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:25:51.625142 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13bf47-6162-49d7-856c-11674f913155 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:25:51.645017 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 730/1452] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:25:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:25:53.786267 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe5592-059d-4fac-ae11-4e0dc2bc3331 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:53.786893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe5592-059d-4fac-ae11-4e0dc2bc3331 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:53.786893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe5592-059d-4fac-ae11-4e0dc2bc3331 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:53.788242 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 15:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:25:53.793862 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab935f-9092-439a-971b-37eeb5abc9b4 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:53.794540 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab935f-9092-439a-971b-37eeb5abc9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:53.794540 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab935f-9092-439a-971b-37eeb5abc9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:53.867598 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:53.870783 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-ceab935f-9092-439a-971b-37eeb5abc9b4 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:25:53.873231 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-ceab935f-9092-439a-971b-37eeb5abc9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:53.974828 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 15:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:25:54.014771 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe5592-059d-4fac-ae11-4e0dc2bc3331 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:25:54.016473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-81fe5592-059d-4fac-ae11-4e0dc2bc3331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:54.148206 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe5592-059d-4fac-ae11-4e0dc2bc3331 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:25:54.207413 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:54.236532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb5ce8-8bd1-47ab-b846-70c95067c62c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:25:54.237081 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb5ce8-8bd1-47ab-b846-70c95067c62c service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:54.237364 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb5ce8-8bd1-47ab-b846-70c95067c62c service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:54.237642 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb5ce8-8bd1-47ab-b846-70c95067c62c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:54.239416 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-13eb5ce8-8bd1-47ab-b846-70c95067c62c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:54.370723 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb5ce8-8bd1-47ab-b846-70c95067c62c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:25:54.372230 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb5ce8-8bd1-47ab-b846-70c95067c62c service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:25:54.393071 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 724/1455] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:25:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:25:56.503147 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cad59-8956-44ce-8d49-aa14b5335c6a None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:56.503754 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cad59-8956-44ce-8d49-aa14b5335c6a None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:56.503754 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cad59-8956-44ce-8d49-aa14b5335c6a None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:56.505024 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 15:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:25:56.510737 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad726d-38f2-496e-9c92-b04205bff711 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:56.511271 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad726d-38f2-496e-9c92-b04205bff711 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:56.511386 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad726d-38f2-496e-9c92-b04205bff711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:56.581503 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-4dad726d-38f2-496e-9c92-b04205bff711 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:25:56.582760 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-4dad726d-38f2-496e-9c92-b04205bff711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:56.612022 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:56.686295 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 15:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:25:56.736697 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98cad59-8956-44ce-8d49-aa14b5335c6a None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:25:56.739900 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-c98cad59-8956-44ce-8d49-aa14b5335c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:56.850717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98cad59-8956-44ce-8d49-aa14b5335c6a None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:25:56.880290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:56.925910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d35b47-7396-4340-b96f-68592551fe17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:25:56.926563 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d35b47-7396-4340-b96f-68592551fe17 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:56.926852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d35b47-7396-4340-b96f-68592551fe17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:56.927140 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d35b47-7396-4340-b96f-68592551fe17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:56.928835 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-61d35b47-7396-4340-b96f-68592551fe17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:57.041421 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d35b47-7396-4340-b96f-68592551fe17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:25:57.042844 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d35b47-7396-4340-b96f-68592551fe17 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:25:57.061421 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 733/1458] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:25:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:25:59.183687 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9c345-e385-4d13-af9e-bbeeb2a62e87 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:59.184204 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9c345-e385-4d13-af9e-bbeeb2a62e87 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:59.184301 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9c345-e385-4d13-af9e-bbeeb2a62e87 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:59.185623 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 15:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:25:59.191628 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768585aa-5294-4d1e-a419-205eba5f0e8a None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:59.192083 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768585aa-5294-4d1e-a419-205eba5f0e8a None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:59.192199 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768585aa-5294-4d1e-a419-205eba5f0e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:59.255856 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-768585aa-5294-4d1e-a419-205eba5f0e8a None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:25:59.257069 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-768585aa-5294-4d1e-a419-205eba5f0e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:59.266415 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:59.354036 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 15:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:25:59.392419 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9c345-e385-4d13-af9e-bbeeb2a62e87 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:25:59.393967 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-80f9c345-e385-4d13-af9e-bbeeb2a62e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:59.506562 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9c345-e385-4d13-af9e-bbeeb2a62e87 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:25:59.566190 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:59.584711 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01db3c-54eb-4dbc-8a66-2315a2bd0a82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:25:59.585363 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01db3c-54eb-4dbc-8a66-2315a2bd0a82 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:59.585651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01db3c-54eb-4dbc-8a66-2315a2bd0a82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:59.585933 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01db3c-54eb-4dbc-8a66-2315a2bd0a82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:59.587637 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-3d01db3c-54eb-4dbc-8a66-2315a2bd0a82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:59.702443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01db3c-54eb-4dbc-8a66-2315a2bd0a82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:25:59.703937 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01db3c-54eb-4dbc-8a66-2315a2bd0a82 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:25:59.722238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 727/1461] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:25:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:26:01.856350 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372e98a-bd6a-4d16-bbb6-d1591f8284fe None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:01.856952 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372e98a-bd6a-4d16-bbb6-d1591f8284fe None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:01.856952 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372e98a-bd6a-4d16-bbb6-d1591f8284fe None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:01.859274 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 15:26:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:26:01.865558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c813b1-cdc3-4a72-abdc-e6168b62cf3d None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:01.866000 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c813b1-cdc3-4a72-abdc-e6168b62cf3d None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:01.866127 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c813b1-cdc3-4a72-abdc-e6168b62cf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:01.933270 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-23c813b1-cdc3-4a72-abdc-e6168b62cf3d None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:26:01.934500 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-23c813b1-cdc3-4a72-abdc-e6168b62cf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:26:01.973991 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:26:02.041533 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 15:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:26:02.079007 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372e98a-bd6a-4d16-bbb6-d1591f8284fe None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:26:02.080598 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-2372e98a-bd6a-4d16-bbb6-d1591f8284fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:26:02.189606 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372e98a-bd6a-4d16-bbb6-d1591f8284fe None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:26:02.229025 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:26:02.267869 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75cfd1-2999-4122-945a-4b86dce70b39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:26:02.268538 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75cfd1-2999-4122-945a-4b86dce70b39 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:02.268827 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75cfd1-2999-4122-945a-4b86dce70b39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:02.269109 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75cfd1-2999-4122-945a-4b86dce70b39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:02.270813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-3e75cfd1-2999-4122-945a-4b86dce70b39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:26:02.388830 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75cfd1-2999-4122-945a-4b86dce70b39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:26:02.390263 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75cfd1-2999-4122-945a-4b86dce70b39 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:26:02.413422 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 736/1464] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:26:04.478503 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0aff4-87fc-4aa6-b1cb-cd6f4ce5895e None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:04.479057 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0aff4-87fc-4aa6-b1cb-cd6f4ce5895e None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:04.479057 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0aff4-87fc-4aa6-b1cb-cd6f4ce5895e None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:04.480402 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 15:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:26:04.486072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088af035-a5da-4b6e-9158-5bfa6d5aaa0c None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:04.486537 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088af035-a5da-4b6e-9158-5bfa6d5aaa0c None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:04.486630 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088af035-a5da-4b6e-9158-5bfa6d5aaa0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:04.560383 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-088af035-a5da-4b6e-9158-5bfa6d5aaa0c None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:26:04.561649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-088af035-a5da-4b6e-9158-5bfa6d5aaa0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:26:04.583041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:26:04.664187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 15:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:26:04.701643 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0aff4-87fc-4aa6-b1cb-cd6f4ce5895e None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:26:04.703966 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-38a0aff4-87fc-4aa6-b1cb-cd6f4ce5895e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:26:04.809992 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0aff4-87fc-4aa6-b1cb-cd6f4ce5895e None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:26:04.881577 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:26:04.888899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce22ec3-9d17-4cf3-b246-f878537a43fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:26:04.889552 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce22ec3-9d17-4cf3-b246-f878537a43fb service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:04.889837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce22ec3-9d17-4cf3-b246-f878537a43fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:04.890117 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce22ec3-9d17-4cf3-b246-f878537a43fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:04.891864 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-0ce22ec3-9d17-4cf3-b246-f878537a43fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:26:05.001190 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce22ec3-9d17-4cf3-b246-f878537a43fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:26:05.002607 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce22ec3-9d17-4cf3-b246-f878537a43fb service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:26:05.021429 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 730/1467] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:26:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:26:07.113642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188e0b5-407b-4d7f-9c48-0f197b1555b3 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:07.114173 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188e0b5-407b-4d7f-9c48-0f197b1555b3 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:07.114173 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188e0b5-407b-4d7f-9c48-0f197b1555b3 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:07.115556 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 15:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:26:07.121012 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b2911-c4cc-4f7f-b0a1-c6e24fa98e16 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:07.121431 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b2911-c4cc-4f7f-b0a1-c6e24fa98e16 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:07.121564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b2911-c4cc-4f7f-b0a1-c6e24fa98e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:07.186417 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-0a1b2911-c4cc-4f7f-b0a1-c6e24fa98e16 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:26:07.187669 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-0a1b2911-c4cc-4f7f-b0a1-c6e24fa98e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:26:07.234913 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:26:07.285581 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 15:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:26:07.322178 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188e0b5-407b-4d7f-9c48-0f197b1555b3 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:26:07.323841 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-c188e0b5-407b-4d7f-9c48-0f197b1555b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:26:07.427047 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188e0b5-407b-4d7f-9c48-0f197b1555b3 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:26:07.473743 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:26:07.501189 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59ac07-21af-4e53-93a1-4b1fb8a3d2eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:26:07.501832 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59ac07-21af-4e53-93a1-4b1fb8a3d2eb service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:07.502118 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59ac07-21af-4e53-93a1-4b1fb8a3d2eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:07.502391 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59ac07-21af-4e53-93a1-4b1fb8a3d2eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:07.504059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-da59ac07-21af-4e53-93a1-4b1fb8a3d2eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:26:07.614122 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59ac07-21af-4e53-93a1-4b1fb8a3d2eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:26:07.615593 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59ac07-21af-4e53-93a1-4b1fb8a3d2eb service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:26:07.634248 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 739/1470] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:26:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:26:17.284076 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=22 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:26:17.632013 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=66 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:26:27.586420 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7091d-688b-4742-9a78-e7c8293c6a78 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:27.586990 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7091d-688b-4742-9a78-e7c8293c6a78 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:27.586990 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7091d-688b-4742-9a78-e7c8293c6a78 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:27.588397 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 732/1471] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:26:27.594266 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88cc1f-dd0c-421f-97ad-c60eae36debf None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:27.594706 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88cc1f-dd0c-421f-97ad-c60eae36debf None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:27.594924 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88cc1f-dd0c-421f-97ad-c60eae36debf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:27.664877 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-1f88cc1f-dd0c-421f-97ad-c60eae36debf None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:26:27.666090 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-1f88cc1f-dd0c-421f-97ad-c60eae36debf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:26:27.761577 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 740/1472] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:26:27.846919 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e7e55-5660-4be5-b61a-91147f8c73cc None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:27.847210 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e7e55-5660-4be5-b61a-91147f8c73cc None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:27.847523 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e7e55-5660-4be5-b61a-91147f8c73cc None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:27.848888 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 733/1473] 10.222.0.44 () {54 vars in 961 bytes} [Tue Jul 19 15:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:26:27.853814 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4965b-e4d0-4da9-b7ea-c640c8067ca8 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:27.854116 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4965b-e4d0-4da9-b7ea-c640c8067ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:27.854405 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4965b-e4d0-4da9-b7ea-c640c8067ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:27.930280 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-79c4965b-e4d0-4da9-b7ea-c640c8067ca8 None None] MFA Rules not processed for user `3e66abbda1744a71b4d26677dcef76be`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:26:27.931522 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-79c4965b-e4d0-4da9-b7ea-c640c8067ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:26:27.952138 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:26:28.007115 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 741/1474] 10.222.0.44 () {58 vars in 1058 bytes} [Tue Jul 19 15:26:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:26:28.014718 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e7e55-5660-4be5-b61a-91147f8c73cc None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:26:28.016847 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-295e7e55-5660-4be5-b61a-91147f8c73cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:26:28.119199 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e7e55-5660-4be5-b61a-91147f8c73cc None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:26:28.191877 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2e518-861e-4e89-8cfd-fc57285b9f15 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e66abbda1744a71b4d26677dcef76be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:26:28.192530 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2e518-861e-4e89-8cfd-fc57285b9f15 service glance] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:28.192818 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2e518-861e-4e89-8cfd-fc57285b9f15 service glance] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:28.193099 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2e518-861e-4e89-8cfd-fc57285b9f15 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:28.194771 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-9ab2e518-861e-4e89-8cfd-fc57285b9f15 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:26:28.247912 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:26:28.303033 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2e518-861e-4e89-8cfd-fc57285b9f15 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:26:28.304498 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2e518-861e-4e89-8cfd-fc57285b9f15 service glance] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:26:28.323482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 734/1475] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:26:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:26:30.487916 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904c748-0e22-4cda-a137-9283c3cf8e3e None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:30.488457 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904c748-0e22-4cda-a137-9283c3cf8e3e None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:30.488457 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904c748-0e22-4cda-a137-9283c3cf8e3e None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:30.489771 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 742/1476] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:26:30.495762 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec42dd0-2bee-4455-8e56-c50c03394f95 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:30.496467 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec42dd0-2bee-4455-8e56-c50c03394f95 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:30.496467 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec42dd0-2bee-4455-8e56-c50c03394f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:30.563241 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-6ec42dd0-2bee-4455-8e56-c50c03394f95 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:26:30.564473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-6ec42dd0-2bee-4455-8e56-c50c03394f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:26:30.662751 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 735/1477] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:26:30.686070 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904c748-0e22-4cda-a137-9283c3cf8e3e None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:26:30.688348 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-3904c748-0e22-4cda-a137-9283c3cf8e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:26:30.816196 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904c748-0e22-4cda-a137-9283c3cf8e3e None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:26:30.866123 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:26:30.912543 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc518b7-6f98-4e3c-bcda-fab3b8bd5ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:26:30.913207 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc518b7-6f98-4e3c-bcda-fab3b8bd5ece admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:30.913493 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc518b7-6f98-4e3c-bcda-fab3b8bd5ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:30.913773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc518b7-6f98-4e3c-bcda-fab3b8bd5ece admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:30.914504 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc518b7-6f98-4e3c-bcda-fab3b8bd5ece admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:26:30.916259 dv-cinder-849846-2-smb devstack@keystone.service[80304]: WARNING py.warnings [None req-5dc518b7-6f98-4e3c-bcda-fab3b8bd5ece admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:26:30.916259 dv-cinder-849846-2-smb devstack@keystone.service[80304]: warnings.warn(msg) Jul 19 15:26:30.916259 dv-cinder-849846-2-smb devstack@keystone.service[80304]: Jul 19 15:26:30.917391 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc518b7-6f98-4e3c-bcda-fab3b8bd5ece admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:26:30.936334 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 743/1478] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jul 19 15:26:30 2022] GET /identity/v3/projects => generated 2553 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:26:33.014410 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468891b-3cc9-4b5b-a4cc-768ed912b310 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:33.014962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468891b-3cc9-4b5b-a4cc-768ed912b310 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:33.015069 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468891b-3cc9-4b5b-a4cc-768ed912b310 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:33.017020 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 736/1479] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:26:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:26:33.022236 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ea94a-122b-498d-9ac8-aeef833d3af9 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:33.022698 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ea94a-122b-498d-9ac8-aeef833d3af9 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:33.022804 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ea94a-122b-498d-9ac8-aeef833d3af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:33.087856 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-477ea94a-122b-498d-9ac8-aeef833d3af9 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:26:33.089065 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-477ea94a-122b-498d-9ac8-aeef833d3af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:26:33.189758 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 744/1480] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:26:33.232361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468891b-3cc9-4b5b-a4cc-768ed912b310 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:26:33.234021 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-8468891b-3cc9-4b5b-a4cc-768ed912b310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:26:33.243974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:26:33.384471 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468891b-3cc9-4b5b-a4cc-768ed912b310 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:26:33.465239 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:26:33.499410 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121ac11-fba7-47ad-9ffb-97fc320c6c8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:26:33.500629 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121ac11-fba7-47ad-9ffb-97fc320c6c8d service nova] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:33.500916 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121ac11-fba7-47ad-9ffb-97fc320c6c8d service nova] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:33.501195 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121ac11-fba7-47ad-9ffb-97fc320c6c8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:33.502876 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-c121ac11-fba7-47ad-9ffb-97fc320c6c8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:26:33.599160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121ac11-fba7-47ad-9ffb-97fc320c6c8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:26:33.600806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121ac11-fba7-47ad-9ffb-97fc320c6c8d service nova] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:26:33.619838 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 737/1481] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:26:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:26:35.853421 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fce1d1-88ea-496f-8656-3440178a957d None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:35.853962 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fce1d1-88ea-496f-8656-3440178a957d None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:35.853962 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fce1d1-88ea-496f-8656-3440178a957d None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:35.855399 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 745/1482] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:26:35.861679 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286d987-aaef-4c59-ac39-a7fee717d3d2 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:35.862122 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286d987-aaef-4c59-ac39-a7fee717d3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:35.862254 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286d987-aaef-4c59-ac39-a7fee717d3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:35.929708 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-2286d987-aaef-4c59-ac39-a7fee717d3d2 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:26:35.930926 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-2286d987-aaef-4c59-ac39-a7fee717d3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:26:35.976921 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:26:36.032277 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 738/1483] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:26:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:26:36.068865 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fce1d1-88ea-496f-8656-3440178a957d None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:26:36.070419 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-b1fce1d1-88ea-496f-8656-3440178a957d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:26:36.094565 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:26:36.185584 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fce1d1-88ea-496f-8656-3440178a957d None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:26:36.260119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679afb1b-b9e8-4c04-bbab-7601d139d4da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:26:36.260768 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679afb1b-b9e8-4c04-bbab-7601d139d4da service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:36.261056 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679afb1b-b9e8-4c04-bbab-7601d139d4da service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:36.261338 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679afb1b-b9e8-4c04-bbab-7601d139d4da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:36.263265 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-679afb1b-b9e8-4c04-bbab-7601d139d4da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:26:36.340426 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:26:36.377115 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679afb1b-b9e8-4c04-bbab-7601d139d4da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:26:36.378548 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679afb1b-b9e8-4c04-bbab-7601d139d4da service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:26:36.398940 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 746/1484] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:26:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:26:38.511414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701737e-1c07-4e8e-98cc-7c4629c82a5f None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:38.511930 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701737e-1c07-4e8e-98cc-7c4629c82a5f None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:38.511930 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701737e-1c07-4e8e-98cc-7c4629c82a5f None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:38.513304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 739/1485] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:26:38.519362 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b589b8-3656-403f-b261-61e42f30f227 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:38.520114 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b589b8-3656-403f-b261-61e42f30f227 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:38.520114 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b589b8-3656-403f-b261-61e42f30f227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:38.584986 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-61b589b8-3656-403f-b261-61e42f30f227 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:26:38.586190 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-61b589b8-3656-403f-b261-61e42f30f227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:26:38.681232 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 747/1486] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:26:38.719375 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701737e-1c07-4e8e-98cc-7c4629c82a5f None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:26:38.720935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-e701737e-1c07-4e8e-98cc-7c4629c82a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:26:38.824862 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701737e-1c07-4e8e-98cc-7c4629c82a5f None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:26:38.900539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:26:38.902464 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5c118-a7c8-4795-bf6d-d2dde0f2d728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:26:38.903190 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5c118-a7c8-4795-bf6d-d2dde0f2d728 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:38.903624 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5c118-a7c8-4795-bf6d-d2dde0f2d728 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:38.904115 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5c118-a7c8-4795-bf6d-d2dde0f2d728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:38.906803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-88f5c118-a7c8-4795-bf6d-d2dde0f2d728 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:26:39.014885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5c118-a7c8-4795-bf6d-d2dde0f2d728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:26:39.016369 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5c118-a7c8-4795-bf6d-d2dde0f2d728 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:26:39.034939 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 740/1487] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:26:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:26:41.297712 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f542e-a081-4bdf-983f-039e165a75c9 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:41.298252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f542e-a081-4bdf-983f-039e165a75c9 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:41.298252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f542e-a081-4bdf-983f-039e165a75c9 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:41.299611 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 748/1488] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:26:41.305090 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350648c-06bd-439b-baed-4a0555afc0bc None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:41.305509 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350648c-06bd-439b-baed-4a0555afc0bc None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:41.305636 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350648c-06bd-439b-baed-4a0555afc0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:41.371120 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-c350648c-06bd-439b-baed-4a0555afc0bc None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:26:41.372366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-c350648c-06bd-439b-baed-4a0555afc0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:26:41.426924 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:26:41.471816 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 741/1489] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:26:41.516103 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f542e-a081-4bdf-983f-039e165a75c9 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:26:41.517687 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-c48f542e-a081-4bdf-983f-039e165a75c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:26:41.554088 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:26:41.623118 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f542e-a081-4bdf-983f-039e165a75c9 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:26:41.695792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a955c-f916-4c66-85e5-4a76c982f584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:26:41.696445 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a955c-f916-4c66-85e5-4a76c982f584 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:41.696731 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a955c-f916-4c66-85e5-4a76c982f584 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:41.697011 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a955c-f916-4c66-85e5-4a76c982f584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:41.698718 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-cf1a955c-f916-4c66-85e5-4a76c982f584 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:26:41.779494 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:26:41.809014 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a955c-f916-4c66-85e5-4a76c982f584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:26:41.810365 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a955c-f916-4c66-85e5-4a76c982f584 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:26:41.828749 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 749/1490] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:26:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:26:44.116500 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ec701-76e3-493f-8305-a4d56fd1682d None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:44.117142 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ec701-76e3-493f-8305-a4d56fd1682d None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:44.117142 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ec701-76e3-493f-8305-a4d56fd1682d None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:44.118450 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 742/1491] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jul 19 15:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:26:44.123964 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7c17b-b5d1-4ccc-a043-eb6adf93fcd7 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:44.124476 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7c17b-b5d1-4ccc-a043-eb6adf93fcd7 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:44.125137 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7c17b-b5d1-4ccc-a043-eb6adf93fcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:44.190703 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-a9c7c17b-b5d1-4ccc-a043-eb6adf93fcd7 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:26:44.191937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-a9c7c17b-b5d1-4ccc-a043-eb6adf93fcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:26:44.286571 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 750/1492] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jul 19 15:26:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:26:44.325750 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ec701-76e3-493f-8305-a4d56fd1682d None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:26:44.327324 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-da7ec701-76e3-493f-8305-a4d56fd1682d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:26:44.430877 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ec701-76e3-493f-8305-a4d56fd1682d None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:26:44.503391 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb813e2-5010-48ab-a3d6-b8b1f39d5d4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:26:44.504057 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb813e2-5010-48ab-a3d6-b8b1f39d5d4a service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:44.504346 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb813e2-5010-48ab-a3d6-b8b1f39d5d4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:44.504629 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb813e2-5010-48ab-a3d6-b8b1f39d5d4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:44.506473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-dbb813e2-5010-48ab-a3d6-b8b1f39d5d4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:26:44.515897 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:26:44.615304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb813e2-5010-48ab-a3d6-b8b1f39d5d4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:26:44.616768 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb813e2-5010-48ab-a3d6-b8b1f39d5d4a service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:26:44.634631 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 743/1493] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:26:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:26:54.284763 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=82 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:26:54.632356 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=50 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:28:11.503159 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b0fbd-896c-4506-acbc-8663cf275f24 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:28:11.503780 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b0fbd-896c-4506-acbc-8663cf275f24 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:28:11.503780 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b0fbd-896c-4506-acbc-8663cf275f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:28:11.611247 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-e17b0fbd-896c-4506-acbc-8663cf275f24 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:28:11.612512 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-e17b0fbd-896c-4506-acbc-8663cf275f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:28:11.713423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 751/1494] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:28:11.721991 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40370480-5438-44d8-9d74-5f1a2204221a None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:28:11.722872 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40370480-5438-44d8-9d74-5f1a2204221a None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:28:11.723337 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40370480-5438-44d8-9d74-5f1a2204221a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:28:11.800521 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-40370480-5438-44d8-9d74-5f1a2204221a None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:28:11.801702 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-40370480-5438-44d8-9d74-5f1a2204221a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:28:11.900796 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 744/1495] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:28:11.907602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b0fbd-896c-4506-acbc-8663cf275f24 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:28:11.909290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-e17b0fbd-896c-4506-acbc-8663cf275f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:28:11.920880 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b0fbd-896c-4506-acbc-8663cf275f24 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:28:11.984069 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:28:12.018223 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5268495-f2a1-4c18-884a-23efa1793590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:28:12.018897 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5268495-f2a1-4c18-884a-23efa1793590 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:28:12.019180 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5268495-f2a1-4c18-884a-23efa1793590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:28:12.019488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5268495-f2a1-4c18-884a-23efa1793590 admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:28:12.020214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5268495-f2a1-4c18-884a-23efa1793590 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:28:12.020527 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5268495-f2a1-4c18-884a-23efa1793590 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:28:12.021544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: WARNING py.warnings [None req-e5268495-f2a1-4c18-884a-23efa1793590 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:28:12.021544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: warnings.warn(msg) Jul 19 15:28:12.021544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: Jul 19 15:28:12.022425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5268495-f2a1-4c18-884a-23efa1793590 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:28:12.033868 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 752/1496] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:28:12.042100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40370480-5438-44d8-9d74-5f1a2204221a None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:28:12.051867 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40370480-5438-44d8-9d74-5f1a2204221a None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:28:12.113126 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:28:12.147444 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1dbbd8-c79f-4f86-babd-993788c86780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:28:12.148106 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dbbd8-c79f-4f86-babd-993788c86780 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:28:12.148394 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dbbd8-c79f-4f86-babd-993788c86780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:28:12.148676 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dbbd8-c79f-4f86-babd-993788c86780 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:28:12.149363 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1dbbd8-c79f-4f86-babd-993788c86780 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:28:12.151449 dv-cinder-849846-2-smb devstack@keystone.service[80305]: WARNING py.warnings [None req-af1dbbd8-c79f-4f86-babd-993788c86780 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:28:12.151449 dv-cinder-849846-2-smb devstack@keystone.service[80305]: warnings.warn(msg) Jul 19 15:28:12.151449 dv-cinder-849846-2-smb devstack@keystone.service[80305]: Jul 19 15:28:12.152655 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1dbbd8-c79f-4f86-babd-993788c86780 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:28:12.209241 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 745/1497] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:28:12 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:28:12.213595 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5268495-f2a1-4c18-884a-23efa1793590 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:28:12.215163 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-e5268495-f2a1-4c18-884a-23efa1793590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:28:12.253298 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5268495-f2a1-4c18-884a-23efa1793590 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:28:12.358126 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db771fe5-bbb8-4b84-ac7c-2f986fccec08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:28:12.358803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db771fe5-bbb8-4b84-ac7c-2f986fccec08 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:28:12.359086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db771fe5-bbb8-4b84-ac7c-2f986fccec08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:28:12.359386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db771fe5-bbb8-4b84-ac7c-2f986fccec08 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:28:12.360094 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db771fe5-bbb8-4b84-ac7c-2f986fccec08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:28:12.361091 dv-cinder-849846-2-smb devstack@keystone.service[80304]: WARNING py.warnings [None req-db771fe5-bbb8-4b84-ac7c-2f986fccec08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:28:12.361091 dv-cinder-849846-2-smb devstack@keystone.service[80304]: warnings.warn(msg) Jul 19 15:28:12.361091 dv-cinder-849846-2-smb devstack@keystone.service[80304]: Jul 19 15:28:12.362282 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db771fe5-bbb8-4b84-ac7c-2f986fccec08 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:28:12.402649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 753/1498] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:28:12 2022] POST /identity/v3/users => generated 290 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:28:12.407476 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1dbbd8-c79f-4f86-babd-993788c86780 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:28:12.409104 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-af1dbbd8-c79f-4f86-babd-993788c86780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:28:12.473758 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1dbbd8-c79f-4f86-babd-993788c86780 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:28:12.559983 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:28:12.571210 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b965f00-5177-4562-a503-7e73d1c086d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:28:12.571968 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b965f00-5177-4562-a503-7e73d1c086d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:28:12.572300 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b965f00-5177-4562-a503-7e73d1c086d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:28:12.572575 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b965f00-5177-4562-a503-7e73d1c086d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:28:12.573314 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b965f00-5177-4562-a503-7e73d1c086d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:28:12.574330 dv-cinder-849846-2-smb devstack@keystone.service[80305]: WARNING py.warnings [None req-6b965f00-5177-4562-a503-7e73d1c086d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:28:12.574330 dv-cinder-849846-2-smb devstack@keystone.service[80305]: warnings.warn(msg) Jul 19 15:28:12.574330 dv-cinder-849846-2-smb devstack@keystone.service[80305]: Jul 19 15:28:12.575208 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b965f00-5177-4562-a503-7e73d1c086d6 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:28:12.587948 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 746/1499] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:28:12.592676 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db771fe5-bbb8-4b84-ac7c-2f986fccec08 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:28:12.594198 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-db771fe5-bbb8-4b84-ac7c-2f986fccec08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:28:12.605702 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db771fe5-bbb8-4b84-ac7c-2f986fccec08 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:28:12.630591 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:28:12.701499 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82699de-ae95-4d40-8301-9a17a775f019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:28:12.702170 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82699de-ae95-4d40-8301-9a17a775f019 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:28:12.702452 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82699de-ae95-4d40-8301-9a17a775f019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:28:12.702725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82699de-ae95-4d40-8301-9a17a775f019 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:28:12.703503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82699de-ae95-4d40-8301-9a17a775f019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:28:12.704506 dv-cinder-849846-2-smb devstack@keystone.service[80304]: WARNING py.warnings [None req-e82699de-ae95-4d40-8301-9a17a775f019 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:28:12.704506 dv-cinder-849846-2-smb devstack@keystone.service[80304]: warnings.warn(msg) Jul 19 15:28:12.704506 dv-cinder-849846-2-smb devstack@keystone.service[80304]: Jul 19 15:28:12.705386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82699de-ae95-4d40-8301-9a17a775f019 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:28:12.718108 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 754/1500] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:28:12.722399 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b965f00-5177-4562-a503-7e73d1c086d6 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:28:12.724047 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-6b965f00-5177-4562-a503-7e73d1c086d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:28:12.757184 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b965f00-5177-4562-a503-7e73d1c086d6 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:28:12.854809 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834edbad-3b9d-4e13-956d-b62770727eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:28:12.855738 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834edbad-3b9d-4e13-956d-b62770727eb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:28:12.856021 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834edbad-3b9d-4e13-956d-b62770727eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:28:12.856298 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834edbad-3b9d-4e13-956d-b62770727eb3 admin admin] PATH_INFO: `/v3/projects/68855129ffb34ca7b17ef4c1da71d147/users/d4719dacebbb4783b0b79f8fb1f89277/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:28:12.878456 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834edbad-3b9d-4e13-956d-b62770727eb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68855129ffb34ca7b17ef4c1da71d147, user_id=d4719dacebbb4783b0b79f8fb1f89277, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:28:12.879519 dv-cinder-849846-2-smb devstack@keystone.service[80305]: WARNING py.warnings [None req-834edbad-3b9d-4e13-956d-b62770727eb3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:28:12.879519 dv-cinder-849846-2-smb devstack@keystone.service[80305]: warnings.warn(msg) Jul 19 15:28:12.879519 dv-cinder-849846-2-smb devstack@keystone.service[80305]: Jul 19 15:28:12.881500 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834edbad-3b9d-4e13-956d-b62770727eb3 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:28:12.907801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 747/1501] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:28:12 2022] PUT /identity/v3/projects/68855129ffb34ca7b17ef4c1da71d147/users/d4719dacebbb4783b0b79f8fb1f89277/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:28:12.920056 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b10c6c-6797-46b2-9916-82dd6742399a None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:28:12.920358 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b10c6c-6797-46b2-9916-82dd6742399a None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:28:12.920646 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b10c6c-6797-46b2-9916-82dd6742399a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:28:12.977023 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-e1b10c6c-6797-46b2-9916-82dd6742399a None None] MFA Rules not processed for user `d4719dacebbb4783b0b79f8fb1f89277`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:28:12.978241 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-e1b10c6c-6797-46b2-9916-82dd6742399a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:28:13.055825 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 755/1502] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:28:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:28:13.069040 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c16800-13a7-4cc8-8910-c842e19117fb None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:28:13.069332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c16800-13a7-4cc8-8910-c842e19117fb None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:28:13.069609 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c16800-13a7-4cc8-8910-c842e19117fb None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:28:13.071007 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 748/1503] 10.222.0.44 () {54 vars in 964 bytes} [Tue Jul 19 15:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:28:13.076508 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b64e4-1f60-4e29-a7c8-644a4dd27c15 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:28:13.076796 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b64e4-1f60-4e29-a7c8-644a4dd27c15 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:28:13.077156 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b64e4-1f60-4e29-a7c8-644a4dd27c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:28:13.107210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:28:13.153454 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-dd5b64e4-1f60-4e29-a7c8-644a4dd27c15 None None] MFA Rules not processed for user `fcf1f5f0ccf8449191a8660e5b1906d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:28:13.154602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-dd5b64e4-1f60-4e29-a7c8-644a4dd27c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:28:13.235016 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 756/1504] 10.222.0.44 () {58 vars in 1061 bytes} [Tue Jul 19 15:28:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:28:13.242824 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c16800-13a7-4cc8-8910-c842e19117fb None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:28:13.244477 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-f4c16800-13a7-4cc8-8910-c842e19117fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:28:13.295496 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:28:13.350636 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c16800-13a7-4cc8-8910-c842e19117fb None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:28:13.423460 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf3020-71c0-480d-a906-ca17c3d893d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:28:13.424030 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf3020-71c0-480d-a906-ca17c3d893d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:28:13.424318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf3020-71c0-480d-a906-ca17c3d893d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:28:13.424598 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf3020-71c0-480d-a906-ca17c3d893d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:28:13.426268 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-85bf3020-71c0-480d-a906-ca17c3d893d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:28:13.651415 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf3020-71c0-480d-a906-ca17c3d893d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:28:13.652846 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf3020-71c0-480d-a906-ca17c3d893d2 service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:28:13.656429 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:28:13.672328 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 749/1505] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:28:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:28:13.714826 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97767d8-05b4-44f7-b6b1-2a3540468d28 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:28:13.715288 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97767d8-05b4-44f7-b6b1-2a3540468d28 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:28:13.715436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97767d8-05b4-44f7-b6b1-2a3540468d28 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:28:13.716719 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 757/1506] 10.222.0.44 () {52 vars in 829 bytes} [Tue Jul 19 15:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:28:13.720298 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf3020-71c0-480d-a906-ca17c3d893d2 service cinder] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:28:13.721516 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-85bf3020-71c0-480d-a906-ca17c3d893d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:28:13.822567 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf3020-71c0-480d-a906-ca17c3d893d2 service cinder] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:28:13.917739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b1cc3-fe8a-4caa-8260-a5e95fce86b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:28:13.918613 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b1cc3-fe8a-4caa-8260-a5e95fce86b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:28:13.918891 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b1cc3-fe8a-4caa-8260-a5e95fce86b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:28:13.919929 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b1cc3-fe8a-4caa-8260-a5e95fce86b0 admin admin] PATH_INFO: `/v3/users/d4719dacebbb4783b0b79f8fb1f89277` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:28:13.937506 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b1cc3-fe8a-4caa-8260-a5e95fce86b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4719dacebbb4783b0b79f8fb1f89277)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:28:13.938453 dv-cinder-849846-2-smb devstack@keystone.service[80305]: WARNING py.warnings [None req-e13b1cc3-fe8a-4caa-8260-a5e95fce86b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:28:13.938453 dv-cinder-849846-2-smb devstack@keystone.service[80305]: warnings.warn(msg) Jul 19 15:28:13.938453 dv-cinder-849846-2-smb devstack@keystone.service[80305]: Jul 19 15:28:13.939970 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b1cc3-fe8a-4caa-8260-a5e95fce86b0 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:28:13.950021 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:28:14.003980 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-e13b1cc3-fe8a-4caa-8260-a5e95fce86b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4719dacebbb4783b0b79f8fb1f89277'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:28:14.022460 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-e13b1cc3-fe8a-4caa-8260-a5e95fce86b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4719dacebbb4783b0b79f8fb1f89277'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:28:14.036597 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-e13b1cc3-fe8a-4caa-8260-a5e95fce86b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4719dacebbb4783b0b79f8fb1f89277'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:28:14.037177 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-e13b1cc3-fe8a-4caa-8260-a5e95fce86b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4719dacebbb4783b0b79f8fb1f89277'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:28:14.037601 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-e13b1cc3-fe8a-4caa-8260-a5e95fce86b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4719dacebbb4783b0b79f8fb1f89277'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:28:14.053757 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 750/1507] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:28:13 2022] DELETE /identity/v3/users/d4719dacebbb4783b0b79f8fb1f89277 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:28:14.058255 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc6d3c-acc5-4bba-823c-2aa0aaa93cab None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:28:14.058549 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc6d3c-acc5-4bba-823c-2aa0aaa93cab None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:28:14.058854 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc6d3c-acc5-4bba-823c-2aa0aaa93cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:28:14.113896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-93fc6d3c-acc5-4bba-823c-2aa0aaa93cab None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:28:14.115058 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-93fc6d3c-acc5-4bba-823c-2aa0aaa93cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:28:14.190614 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:28:14.204595 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 758/1508] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:28:14.215577 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b1cc3-fe8a-4caa-8260-a5e95fce86b0 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:28:14.217366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-e13b1cc3-fe8a-4caa-8260-a5e95fce86b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:28:14.317085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b1cc3-fe8a-4caa-8260-a5e95fce86b0 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:28:14.371837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:28:14.392407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd787f1-933b-4d17-ae7a-e5c996d41cf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:28:14.393066 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd787f1-933b-4d17-ae7a-e5c996d41cf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:28:14.393353 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd787f1-933b-4d17-ae7a-e5c996d41cf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:28:14.393634 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd787f1-933b-4d17-ae7a-e5c996d41cf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:28:14.395360 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-1dd787f1-933b-4d17-ae7a-e5c996d41cf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:28:14.504765 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd787f1-933b-4d17-ae7a-e5c996d41cf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:28:14.506116 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd787f1-933b-4d17-ae7a-e5c996d41cf2 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:28:14.523973 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 751/1509] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:28:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:28:14.866434 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc6d3c-acc5-4bba-823c-2aa0aaa93cab None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:28:14.867738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-93fc6d3c-acc5-4bba-823c-2aa0aaa93cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:28:14.879715 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc6d3c-acc5-4bba-823c-2aa0aaa93cab None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:28:14.979728 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356df28-c095-4c6f-a4e6-f50af3569399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:28:14.980586 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356df28-c095-4c6f-a4e6-f50af3569399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:28:14.980878 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356df28-c095-4c6f-a4e6-f50af3569399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:28:14.981156 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356df28-c095-4c6f-a4e6-f50af3569399 admin admin] PATH_INFO: `/v3/projects/68855129ffb34ca7b17ef4c1da71d147` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:28:14.991794 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356df28-c095-4c6f-a4e6-f50af3569399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68855129ffb34ca7b17ef4c1da71d147)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:28:14.992819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: WARNING py.warnings [None req-7356df28-c095-4c6f-a4e6-f50af3569399 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:28:14.992819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: warnings.warn(msg) Jul 19 15:28:14.992819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: Jul 19 15:28:14.994009 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356df28-c095-4c6f-a4e6-f50af3569399 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:28:15.051867 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-7356df28-c095-4c6f-a4e6-f50af3569399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68855129ffb34ca7b17ef4c1da71d147', 'request_id': 'req-7356df28-c095-4c6f-a4e6-f50af3569399'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:28:15.065275 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-7356df28-c095-4c6f-a4e6-f50af3569399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68855129ffb34ca7b17ef4c1da71d147', 'request_id': 'req-7356df28-c095-4c6f-a4e6-f50af3569399'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:28:15.074821 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-7356df28-c095-4c6f-a4e6-f50af3569399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68855129ffb34ca7b17ef4c1da71d147', 'request_id': 'req-7356df28-c095-4c6f-a4e6-f50af3569399'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:28:15.097051 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-7356df28-c095-4c6f-a4e6-f50af3569399 admin admin] The token cache is being invalidate because project 68855129ffb34ca7b17ef4c1da71d147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:28:15.097345 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-7356df28-c095-4c6f-a4e6-f50af3569399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:28:15.097876 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-7356df28-c095-4c6f-a4e6-f50af3569399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:28:15.099272 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 759/1510] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:28:14 2022] DELETE /identity/v3/projects/68855129ffb34ca7b17ef4c1da71d147 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:28:24.521694 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=62 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:28:25.095095 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:30:03.161211 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c5c3b-9df8-4582-800b-3d99af8bfbf6 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:03.161778 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c5c3b-9df8-4582-800b-3d99af8bfbf6 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:03.161778 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c5c3b-9df8-4582-800b-3d99af8bfbf6 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:03.163073 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 15:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:30:03.168657 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4f9e5-b907-4ceb-b6d1-90878c50c83a None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:03.169120 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4f9e5-b907-4ceb-b6d1-90878c50c83a None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:03.169222 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4f9e5-b907-4ceb-b6d1-90878c50c83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:03.252832 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-e2e4f9e5-b907-4ceb-b6d1-90878c50c83a None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:30:03.254062 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-e2e4f9e5-b907-4ceb-b6d1-90878c50c83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:30:03.367417 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 15:30:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:30:03.525048 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c5c3b-9df8-4582-800b-3d99af8bfbf6 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:30:03.527803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-0f7c5c3b-9df8-4582-800b-3d99af8bfbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:30:03.666612 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c5c3b-9df8-4582-800b-3d99af8bfbf6 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:30:03.672249 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487b00a-7d10-4df5-8c1e-6e1e0d0309dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:30:03.672904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487b00a-7d10-4df5-8c1e-6e1e0d0309dd service nova] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:03.673191 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487b00a-7d10-4df5-8c1e-6e1e0d0309dd service nova] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:03.673473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487b00a-7d10-4df5-8c1e-6e1e0d0309dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:03.681882 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487b00a-7d10-4df5-8c1e-6e1e0d0309dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:30:03.683496 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487b00a-7d10-4df5-8c1e-6e1e0d0309dd service nova] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:30:03.693380 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 753/1513] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:30:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:30:04.542270 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0181c-9dd7-49a6-b198-aa035ff5e449 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:04.542816 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0181c-9dd7-49a6-b198-aa035ff5e449 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:04.542816 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0181c-9dd7-49a6-b198-aa035ff5e449 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:04.545588 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 15:30:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:30:04.550756 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe6741-da11-4bd7-9088-d287dfcb56b3 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:04.551398 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe6741-da11-4bd7-9088-d287dfcb56b3 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:04.551398 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe6741-da11-4bd7-9088-d287dfcb56b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:04.569233 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-0bbe6741-da11-4bd7-9088-d287dfcb56b3 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:30:04.570435 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-0bbe6741-da11-4bd7-9088-d287dfcb56b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:30:04.578471 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 15:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:30:04.730837 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0181c-9dd7-49a6-b198-aa035ff5e449 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:30:04.745187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0181c-9dd7-49a6-b198-aa035ff5e449 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:30:04.750444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473816b7-0d7f-4852-96db-b4fe9b493f7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:30:04.751084 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473816b7-0d7f-4852-96db-b4fe9b493f7b service nova] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:04.751402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473816b7-0d7f-4852-96db-b4fe9b493f7b service nova] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:04.751682 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473816b7-0d7f-4852-96db-b4fe9b493f7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:04.760659 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473816b7-0d7f-4852-96db-b4fe9b493f7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:30:04.762359 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473816b7-0d7f-4852-96db-b4fe9b493f7b service nova] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:30:04.772713 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 762/1516] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:30:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:30:04.840646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6e9a6-4178-4858-8091-ab177baff3b6 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:04.840938 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6e9a6-4178-4858-8091-ab177baff3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:04.841225 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6e9a6-4178-4858-8091-ab177baff3b6 None None] PATH_INFO: `/v3` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:04.842754 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 755/1517] 10.222.0.40 () {54 vars in 925 bytes} [Tue Jul 19 15:30:04 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:30:04.849570 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757331f5-e971-4ab8-8c04-d6e5a5af6356 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:04.849895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757331f5-e971-4ab8-8c04-d6e5a5af6356 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:04.850145 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757331f5-e971-4ab8-8c04-d6e5a5af6356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:04.917537 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-757331f5-e971-4ab8-8c04-d6e5a5af6356 None None] MFA Rules not processed for user `2a27fe78683743c397fe7929e9053c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:30:04.918792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-757331f5-e971-4ab8-8c04-d6e5a5af6356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:30:04.937638 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:30:04.998016 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 763/1518] 10.222.0.40 () {58 vars in 1015 bytes} [Tue Jul 19 15:30:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:30:14.341158 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f768fbc-e843-44ae-905c-65873354f832 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:14.341751 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f768fbc-e843-44ae-905c-65873354f832 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:14.341751 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f768fbc-e843-44ae-905c-65873354f832 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:14.343127 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 756/1519] 10.222.0.44 () {54 vars in 961 bytes} [Tue Jul 19 15:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:30:14.348457 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6063c7a-8d51-43a8-9917-0e765b694563 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:14.348941 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6063c7a-8d51-43a8-9917-0e765b694563 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:14.349052 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6063c7a-8d51-43a8-9917-0e765b694563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:14.367612 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-d6063c7a-8d51-43a8-9917-0e765b694563 None None] MFA Rules not processed for user `2a27fe78683743c397fe7929e9053c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:30:14.368822 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-d6063c7a-8d51-43a8-9917-0e765b694563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:30:14.377487 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 764/1520] 10.222.0.44 () {58 vars in 1058 bytes} [Tue Jul 19 15:30:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:30:14.385084 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f768fbc-e843-44ae-905c-65873354f832 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:30:14.398440 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f768fbc-e843-44ae-905c-65873354f832 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:30:14.404285 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1055f0e-ac0c-4ef2-b8c4-195caad75b1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a27fe78683743c397fe7929e9053c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:30:14.404931 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1055f0e-ac0c-4ef2-b8c4-195caad75b1f service placement] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:14.405216 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1055f0e-ac0c-4ef2-b8c4-195caad75b1f service placement] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:14.405495 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1055f0e-ac0c-4ef2-b8c4-195caad75b1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:14.414701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1055f0e-ac0c-4ef2-b8c4-195caad75b1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:30:14.416951 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1055f0e-ac0c-4ef2-b8c4-195caad75b1f service placement] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:30:14.427427 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 757/1521] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:30:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:30:16.042926 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e9f93-655d-4a89-b9f7-4b933de9c689 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:16.043491 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e9f93-655d-4a89-b9f7-4b933de9c689 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:16.043613 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e9f93-655d-4a89-b9f7-4b933de9c689 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:16.044908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 15:30:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:30:16.049860 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cf8a0-626d-4286-931c-eb2e48f1357f None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:16.050332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cf8a0-626d-4286-931c-eb2e48f1357f None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:16.050443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cf8a0-626d-4286-931c-eb2e48f1357f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:16.069300 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-2f6cf8a0-626d-4286-931c-eb2e48f1357f None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:30:16.070475 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-2f6cf8a0-626d-4286-931c-eb2e48f1357f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:30:16.078435 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 15:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:30:16.240665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e9f93-655d-4a89-b9f7-4b933de9c689 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:30:16.256888 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e9f93-655d-4a89-b9f7-4b933de9c689 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:30:16.263621 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f144c2-d0da-42bb-a102-0ae5b9d40ebe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:30:16.264942 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f144c2-d0da-42bb-a102-0ae5b9d40ebe service nova] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:16.266383 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f144c2-d0da-42bb-a102-0ae5b9d40ebe service nova] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:16.266669 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f144c2-d0da-42bb-a102-0ae5b9d40ebe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:16.276053 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f144c2-d0da-42bb-a102-0ae5b9d40ebe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:30:16.277621 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f144c2-d0da-42bb-a102-0ae5b9d40ebe service nova] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:30:16.287727 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 766/1524] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:30:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:30:17.122812 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4cd29-71db-4f5f-87f9-3a425f4a50f0 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:17.123352 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4cd29-71db-4f5f-87f9-3a425f4a50f0 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:17.123352 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4cd29-71db-4f5f-87f9-3a425f4a50f0 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:17.124719 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 15:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:30:17.129701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748893f8-5235-462d-90d0-75f5a7422166 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:17.130191 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748893f8-5235-462d-90d0-75f5a7422166 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:17.130312 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748893f8-5235-462d-90d0-75f5a7422166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:17.148298 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-748893f8-5235-462d-90d0-75f5a7422166 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:30:17.149507 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-748893f8-5235-462d-90d0-75f5a7422166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:30:17.157932 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 15:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:30:17.311006 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4cd29-71db-4f5f-87f9-3a425f4a50f0 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:30:17.325427 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4cd29-71db-4f5f-87f9-3a425f4a50f0 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:30:17.330933 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ff259-13e9-4161-8350-680b52056447 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:30:17.331597 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ff259-13e9-4161-8350-680b52056447 service nova] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:17.331881 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ff259-13e9-4161-8350-680b52056447 service nova] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:17.332158 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ff259-13e9-4161-8350-680b52056447 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:17.340973 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ff259-13e9-4161-8350-680b52056447 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:30:17.342558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ff259-13e9-4161-8350-680b52056447 service nova] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:30:17.351811 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 760/1527] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:30:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:30:21.376157 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf5036-29ba-4cc7-91ca-d08ec90aa3d8 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:21.376772 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf5036-29ba-4cc7-91ca-d08ec90aa3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:21.376772 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf5036-29ba-4cc7-91ca-d08ec90aa3d8 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:21.378090 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 15:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:30:21.383483 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f122a7-68a7-4fc0-af29-7e26e187d313 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:21.383943 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f122a7-68a7-4fc0-af29-7e26e187d313 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:21.384047 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f122a7-68a7-4fc0-af29-7e26e187d313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:21.402356 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-b6f122a7-68a7-4fc0-af29-7e26e187d313 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:30:21.403573 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-b6f122a7-68a7-4fc0-af29-7e26e187d313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:30:21.411431 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 15:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:30:21.581951 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf5036-29ba-4cc7-91ca-d08ec90aa3d8 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:30:21.583802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-eccf5036-29ba-4cc7-91ca-d08ec90aa3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:30:21.663206 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf5036-29ba-4cc7-91ca-d08ec90aa3d8 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:30:21.667349 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672ce3f-b18a-4b65-9cc6-4cc1d519ccd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:30:21.667996 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672ce3f-b18a-4b65-9cc6-4cc1d519ccd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:21.668284 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672ce3f-b18a-4b65-9cc6-4cc1d519ccd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:21.668558 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672ce3f-b18a-4b65-9cc6-4cc1d519ccd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:21.677648 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672ce3f-b18a-4b65-9cc6-4cc1d519ccd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:30:21.679063 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672ce3f-b18a-4b65-9cc6-4cc1d519ccd0 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:30:21.688993 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 769/1530] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:30:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:30:23.761226 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee110413-0bee-42a8-91e7-7f54bf544550 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:23.761801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee110413-0bee-42a8-91e7-7f54bf544550 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:23.761801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee110413-0bee-42a8-91e7-7f54bf544550 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:23.763176 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 15:30:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:30:23.768424 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a0c6c-5c32-4db5-bed5-71e092933888 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:23.768861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a0c6c-5c32-4db5-bed5-71e092933888 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:23.768969 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a0c6c-5c32-4db5-bed5-71e092933888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:23.788603 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-970a0c6c-5c32-4db5-bed5-71e092933888 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:30:23.789802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-970a0c6c-5c32-4db5-bed5-71e092933888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:30:23.798068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 15:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:30:23.834739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee110413-0bee-42a8-91e7-7f54bf544550 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:30:23.846451 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee110413-0bee-42a8-91e7-7f54bf544550 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:30:23.850084 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e47bc-dc71-4752-b0c7-d2d934269a8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:30:23.850759 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e47bc-dc71-4752-b0c7-d2d934269a8a service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:23.851026 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e47bc-dc71-4752-b0c7-d2d934269a8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:23.851338 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e47bc-dc71-4752-b0c7-d2d934269a8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:23.861029 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e47bc-dc71-4752-b0c7-d2d934269a8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:30:23.862459 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e47bc-dc71-4752-b0c7-d2d934269a8a service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:30:23.872578 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 763/1533] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:30:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:30:27.522733 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d29cd5-86e6-4040-8429-e75172725fd0 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:27.523352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d29cd5-86e6-4040-8429-e75172725fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:27.523352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d29cd5-86e6-4040-8429-e75172725fd0 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:27.525008 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 15:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:30:27.530281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dd2e3-6b18-429c-a9fb-697a124da478 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:27.530724 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dd2e3-6b18-429c-a9fb-697a124da478 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:27.530828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dd2e3-6b18-429c-a9fb-697a124da478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:27.537164 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=81 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:30:27.550268 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-ed8dd2e3-6b18-429c-a9fb-697a124da478 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:30:27.551500 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-ed8dd2e3-6b18-429c-a9fb-697a124da478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:30:27.560007 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 15:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:30:27.861967 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d29cd5-86e6-4040-8429-e75172725fd0 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:30:27.863998 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-30d29cd5-86e6-4040-8429-e75172725fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:30:27.934291 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:30:27.948742 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d29cd5-86e6-4040-8429-e75172725fd0 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:30:27.952380 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b81094-b178-4076-8d53-957050705791 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:30:27.953047 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b81094-b178-4076-8d53-957050705791 service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:27.953339 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b81094-b178-4076-8d53-957050705791 service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:27.953745 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b81094-b178-4076-8d53-957050705791 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:27.962736 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b81094-b178-4076-8d53-957050705791 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:30:27.964259 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b81094-b178-4076-8d53-957050705791 service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:30:27.973614 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 772/1536] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:30:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:30:30.042390 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706500b9-d37e-4dc0-9e57-deb9f5135a3a None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:30.042963 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706500b9-d37e-4dc0-9e57-deb9f5135a3a None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:30.042963 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706500b9-d37e-4dc0-9e57-deb9f5135a3a None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:30.044377 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 15:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:30:30.049880 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53800e6-5236-4b5b-898f-f2f05c2f1004 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:30.050363 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53800e6-5236-4b5b-898f-f2f05c2f1004 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:30.050564 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53800e6-5236-4b5b-898f-f2f05c2f1004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:30.069765 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-c53800e6-5236-4b5b-898f-f2f05c2f1004 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:30:30.070987 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-c53800e6-5236-4b5b-898f-f2f05c2f1004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:30:30.080393 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 15:30:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:30:30.392724 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706500b9-d37e-4dc0-9e57-deb9f5135a3a None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:30:30.394405 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-706500b9-d37e-4dc0-9e57-deb9f5135a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:30:30.408298 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706500b9-d37e-4dc0-9e57-deb9f5135a3a None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:30:30.411816 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d90f8-ddd4-4214-9c07-5d3a822ed905 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:30:30.412452 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d90f8-ddd4-4214-9c07-5d3a822ed905 service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:30.412734 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d90f8-ddd4-4214-9c07-5d3a822ed905 service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:30.413014 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d90f8-ddd4-4214-9c07-5d3a822ed905 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:30.423117 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d90f8-ddd4-4214-9c07-5d3a822ed905 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:30:30.424575 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d90f8-ddd4-4214-9c07-5d3a822ed905 service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:30:30.434407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 766/1539] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:30:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:30:40.076068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=11 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:30:40.429945 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=8 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:12.103064 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44609b-0f2b-41ef-8762-71c5336e4569 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:12.103763 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44609b-0f2b-41ef-8762-71c5336e4569 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:12.103763 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44609b-0f2b-41ef-8762-71c5336e4569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:12.127204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-8a44609b-0f2b-41ef-8762-71c5336e4569 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:12.128496 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-8a44609b-0f2b-41ef-8762-71c5336e4569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:12.140234 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 774/1540] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:12.149738 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432f7dd-f729-4adc-8095-382c922370c1 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:12.150359 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432f7dd-f729-4adc-8095-382c922370c1 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:12.150359 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432f7dd-f729-4adc-8095-382c922370c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:12.177587 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-4432f7dd-f729-4adc-8095-382c922370c1 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:12.178834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-4432f7dd-f729-4adc-8095-382c922370c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:12.191984 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 767/1541] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:12.197063 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44609b-0f2b-41ef-8762-71c5336e4569 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:12.208525 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44609b-0f2b-41ef-8762-71c5336e4569 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:12.219134 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fde4a-ab3a-43d4-b974-4b064ea3116a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:12.219885 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fde4a-ab3a-43d4-b974-4b064ea3116a admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:12.220168 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fde4a-ab3a-43d4-b974-4b064ea3116a admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:12.220451 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fde4a-ab3a-43d4-b974-4b064ea3116a admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:12.221204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40fde4a-ab3a-43d4-b974-4b064ea3116a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:12.221516 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40fde4a-ab3a-43d4-b974-4b064ea3116a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:12.223169 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40fde4a-ab3a-43d4-b974-4b064ea3116a admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:12.237283 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 775/1542] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:12.246150 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432f7dd-f729-4adc-8095-382c922370c1 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:12.255850 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432f7dd-f729-4adc-8095-382c922370c1 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:12.259623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cb923-51e0-4ab7-9522-0f9a5d26919c None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:12.259982 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cb923-51e0-4ab7-9522-0f9a5d26919c None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:12.260578 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cb923-51e0-4ab7-9522-0f9a5d26919c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:12.267975 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbafeb2-4c4d-465d-87d5-73bfc5ec29bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:12.268658 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbafeb2-4c4d-465d-87d5-73bfc5ec29bf admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:12.268945 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbafeb2-4c4d-465d-87d5-73bfc5ec29bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:12.269218 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbafeb2-4c4d-465d-87d5-73bfc5ec29bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:12.269941 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbafeb2-4c4d-465d-87d5-73bfc5ec29bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:12.277489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbafeb2-4c4d-465d-87d5-73bfc5ec29bf admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:12.296542 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-399cb923-51e0-4ab7-9522-0f9a5d26919c None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:12.308526 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-399cb923-51e0-4ab7-9522-0f9a5d26919c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:12.327552 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 776/1543] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:12.335513 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244ddc2-0e39-42d3-82fe-a6caa89a18ab None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:12.335819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244ddc2-0e39-42d3-82fe-a6caa89a18ab None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:12.336084 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244ddc2-0e39-42d3-82fe-a6caa89a18ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:12.367396 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 768/1544] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:32:12 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:12.371923 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbafeb2-4c4d-465d-87d5-73bfc5ec29bf admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:12.374991 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-5244ddc2-0e39-42d3-82fe-a6caa89a18ab None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:12.384465 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-5244ddc2-0e39-42d3-82fe-a6caa89a18ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:12.519779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbafeb2-4c4d-465d-87d5-73bfc5ec29bf admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:12.523911 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 777/1545] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:32:12.530524 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244ddc2-0e39-42d3-82fe-a6caa89a18ab None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:12.536732 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243b385-da0c-408c-a330-ab2115848549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:12.537425 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243b385-da0c-408c-a330-ab2115848549 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:12.537706 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243b385-da0c-408c-a330-ab2115848549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:12.537987 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243b385-da0c-408c-a330-ab2115848549 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:12.538681 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243b385-da0c-408c-a330-ab2115848549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:12.541674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: WARNING py.warnings [None req-0243b385-da0c-408c-a330-ab2115848549 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:32:12.541674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: warnings.warn(msg) Jul 19 15:32:12.541674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: Jul 19 15:32:12.542907 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243b385-da0c-408c-a330-ab2115848549 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:12.555209 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244ddc2-0e39-42d3-82fe-a6caa89a18ab None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:12.565730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc90c05-9b10-4e48-ac60-3af60f80d2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:12.565730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc90c05-9b10-4e48-ac60-3af60f80d2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:12.565730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc90c05-9b10-4e48-ac60-3af60f80d2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:12.565730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc90c05-9b10-4e48-ac60-3af60f80d2f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:12.566192 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc90c05-9b10-4e48-ac60-3af60f80d2f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:12.566192 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc90c05-9b10-4e48-ac60-3af60f80d2f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:12.568899 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc90c05-9b10-4e48-ac60-3af60f80d2f6 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:12.607663 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 778/1546] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:12.609809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5308d6-59b0-46df-8678-fcc88a376e40 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:12.610453 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5308d6-59b0-46df-8678-fcc88a376e40 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:12.610987 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5308d6-59b0-46df-8678-fcc88a376e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:12.650380 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 769/1547] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:32:12 2022] POST /identity/v3/users => generated 288 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:12.651405 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-7d5308d6-59b0-46df-8678-fcc88a376e40 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:12.651709 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aea81d-eb77-4353-b9d1-efca5961ff41 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:12.652008 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aea81d-eb77-4353-b9d1-efca5961ff41 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:12.652292 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aea81d-eb77-4353-b9d1-efca5961ff41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:12.653791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-7d5308d6-59b0-46df-8678-fcc88a376e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:12.669167 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 779/1548] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:12.670548 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16444a-0cd7-4eca-88a1-6a39403595a5 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:12.670845 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16444a-0cd7-4eca-88a1-6a39403595a5 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:12.671108 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16444a-0cd7-4eca-88a1-6a39403595a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:12.681282 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-10aea81d-eb77-4353-b9d1-efca5961ff41 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:12.683016 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-10aea81d-eb77-4353-b9d1-efca5961ff41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:12.699343 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 770/1549] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:12.700209 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aea81d-eb77-4353-b9d1-efca5961ff41 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:12.701614 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-ea16444a-0cd7-4eca-88a1-6a39403595a5 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:12.702879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-ea16444a-0cd7-4eca-88a1-6a39403595a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:12.710423 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aea81d-eb77-4353-b9d1-efca5961ff41 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:12.712150 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 780/1550] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:12.713498 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1978d54-41f6-4242-a713-6c4a5e6e5d5c None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:12.713793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1978d54-41f6-4242-a713-6c4a5e6e5d5c None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:12.714085 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1978d54-41f6-4242-a713-6c4a5e6e5d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:12.722620 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a0881-005a-4eb7-93b7-636946b4bfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:12.726197 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a0881-005a-4eb7-93b7-636946b4bfb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:12.726197 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a0881-005a-4eb7-93b7-636946b4bfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:12.726197 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a0881-005a-4eb7-93b7-636946b4bfb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:12.726197 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a0881-005a-4eb7-93b7-636946b4bfb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:12.726649 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a0881-005a-4eb7-93b7-636946b4bfb6 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:12.733211 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-f1978d54-41f6-4242-a713-6c4a5e6e5d5c None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:12.734458 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-f1978d54-41f6-4242-a713-6c4a5e6e5d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:12.743201 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 781/1551] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:12.743814 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1978d54-41f6-4242-a713-6c4a5e6e5d5c None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:12.757598 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1978d54-41f6-4242-a713-6c4a5e6e5d5c None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:12.762659 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 771/1552] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:32:12 2022] POST /identity/v3/projects => generated 405 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:12.763000 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdbfd7-a729-4e5f-8d67-d004b614858c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:12.764001 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdbfd7-a729-4e5f-8d67-d004b614858c admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:12.764137 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a45b82-949f-44a0-ba39-37acd2d625ab None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:12.764336 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a45b82-949f-44a0-ba39-37acd2d625ab None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:12.764627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a45b82-949f-44a0-ba39-37acd2d625ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:12.765089 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdbfd7-a729-4e5f-8d67-d004b614858c admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:12.765906 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdbfd7-a729-4e5f-8d67-d004b614858c admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:12.766953 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdbfd7-a729-4e5f-8d67-d004b614858c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:12.768953 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdbfd7-a729-4e5f-8d67-d004b614858c admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:12.784256 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 782/1553] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:12.784256 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577ba56-4785-4c33-b307-6b09bab869a8 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:12.784256 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577ba56-4785-4c33-b307-6b09bab869a8 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:12.784256 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577ba56-4785-4c33-b307-6b09bab869a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:12.790787 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-50a45b82-949f-44a0-ba39-37acd2d625ab None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:12.792040 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-50a45b82-949f-44a0-ba39-37acd2d625ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:12.806093 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-3577ba56-4785-4c33-b307-6b09bab869a8 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:12.807343 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-3577ba56-4785-4c33-b307-6b09bab869a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:12.874518 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 772/1554] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:12.874518 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6c3f3-a85b-45e5-9b79-c2088beea41d None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:12.874518 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6c3f3-a85b-45e5-9b79-c2088beea41d None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:12.874518 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6c3f3-a85b-45e5-9b79-c2088beea41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:12.887966 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 783/1555] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:12.889403 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907aebf-715d-49d2-8f48-d4d62ed1d1f4 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:12.889785 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907aebf-715d-49d2-8f48-d4d62ed1d1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:12.890142 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907aebf-715d-49d2-8f48-d4d62ed1d1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:12.909962 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-1907aebf-715d-49d2-8f48-d4d62ed1d1f4 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:12.911100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-1907aebf-715d-49d2-8f48-d4d62ed1d1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:12.913093 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-9db6c3f3-a85b-45e5-9b79-c2088beea41d None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:12.914276 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-9db6c3f3-a85b-45e5-9b79-c2088beea41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:12.919887 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 784/1556] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:12.921487 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236a94e-9ebf-44f4-b07d-895e3a2ec91c None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:12.921733 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236a94e-9ebf-44f4-b07d-895e3a2ec91c None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:12.922010 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236a94e-9ebf-44f4-b07d-895e3a2ec91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:12.926269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 773/1557] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:12.926269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63dc9b-3cb2-4244-9c4d-4a1b69e496fc None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:12.926269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63dc9b-3cb2-4244-9c4d-4a1b69e496fc None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:12.926269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63dc9b-3cb2-4244-9c4d-4a1b69e496fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:12.950709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-b236a94e-9ebf-44f4-b07d-895e3a2ec91c None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:12.951979 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-b236a94e-9ebf-44f4-b07d-895e3a2ec91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:12.953879 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-5f63dc9b-3cb2-4244-9c4d-4a1b69e496fc None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:12.955382 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-5f63dc9b-3cb2-4244-9c4d-4a1b69e496fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:12.961811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 785/1558] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:12.962450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236a94e-9ebf-44f4-b07d-895e3a2ec91c None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:12.965791 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 774/1559] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:12.966872 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63dc9b-3cb2-4244-9c4d-4a1b69e496fc None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:12.974092 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236a94e-9ebf-44f4-b07d-895e3a2ec91c None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:12.976731 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63dc9b-3cb2-4244-9c4d-4a1b69e496fc None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:12.978917 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a3457-e7e6-4667-88ea-be8b3f11e6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:12.979671 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a3457-e7e6-4667-88ea-be8b3f11e6e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:12.979935 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a3457-e7e6-4667-88ea-be8b3f11e6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:12.980217 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a3457-e7e6-4667-88ea-be8b3f11e6e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:12.980922 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a3457-e7e6-4667-88ea-be8b3f11e6e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:12.981624 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883a06e-7fa1-452f-891d-f8c43f32ba90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:12.982274 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883a06e-7fa1-452f-891d-f8c43f32ba90 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:12.982552 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883a06e-7fa1-452f-891d-f8c43f32ba90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:12.982825 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883a06e-7fa1-452f-891d-f8c43f32ba90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:12.982930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a3457-e7e6-4667-88ea-be8b3f11e6e1 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:12.983586 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883a06e-7fa1-452f-891d-f8c43f32ba90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:12.985134 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883a06e-7fa1-452f-891d-f8c43f32ba90 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:12.990943 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:12.997005 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 775/1560] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:12.998573 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ccac1-e0ec-4a37-a613-8a404030b427 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:12.999204 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ccac1-e0ec-4a37-a613-8a404030b427 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:12.999515 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ccac1-e0ec-4a37-a613-8a404030b427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.001299 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:13.007715 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 786/1561] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:32:12 2022] POST /identity/v3/users => generated 303 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:13.008847 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a3457-e7e6-4667-88ea-be8b3f11e6e1 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:13.020230 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a3457-e7e6-4667-88ea-be8b3f11e6e1 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:13.022218 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-c34ccac1-e0ec-4a37-a613-8a404030b427 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:13.023742 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-c34ccac1-e0ec-4a37-a613-8a404030b427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:13.025279 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70f34d-45fe-4696-a8d6-7983161ad31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:13.025931 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70f34d-45fe-4696-a8d6-7983161ad31d admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:13.026222 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70f34d-45fe-4696-a8d6-7983161ad31d admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:13.026506 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70f34d-45fe-4696-a8d6-7983161ad31d admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.027247 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70f34d-45fe-4696-a8d6-7983161ad31d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:13.027577 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70f34d-45fe-4696-a8d6-7983161ad31d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:13.029322 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70f34d-45fe-4696-a8d6-7983161ad31d admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:13.031968 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 776/1562] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:13.032759 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ccac1-e0ec-4a37-a613-8a404030b427 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:13.042334 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ccac1-e0ec-4a37-a613-8a404030b427 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:13.053153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 787/1563] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:13.053473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60fef9-ae34-4ad2-b22d-89e2b29692c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:13.053613 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce453a4-d3ad-402d-9b49-0c4f3e181d8f None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:13.053613 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce453a4-d3ad-402d-9b49-0c4f3e181d8f None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:13.053613 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce453a4-d3ad-402d-9b49-0c4f3e181d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.053869 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60fef9-ae34-4ad2-b22d-89e2b29692c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:13.053869 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60fef9-ae34-4ad2-b22d-89e2b29692c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:13.053869 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60fef9-ae34-4ad2-b22d-89e2b29692c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.053869 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60fef9-ae34-4ad2-b22d-89e2b29692c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:13.053869 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60fef9-ae34-4ad2-b22d-89e2b29692c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:13.054223 dv-cinder-849846-2-smb devstack@keystone.service[80305]: WARNING py.warnings [None req-5a60fef9-ae34-4ad2-b22d-89e2b29692c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:32:13.054223 dv-cinder-849846-2-smb devstack@keystone.service[80305]: warnings.warn(msg) Jul 19 15:32:13.054223 dv-cinder-849846-2-smb devstack@keystone.service[80305]: Jul 19 15:32:13.054223 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60fef9-ae34-4ad2-b22d-89e2b29692c9 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:13.064463 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 777/1564] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:13.065305 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60fef9-ae34-4ad2-b22d-89e2b29692c9 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:13.066742 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-0ce453a4-d3ad-402d-9b49-0c4f3e181d8f None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:13.068539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-0ce453a4-d3ad-402d-9b49-0c4f3e181d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:13.076928 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 788/1565] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:13.080512 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60fef9-ae34-4ad2-b22d-89e2b29692c9 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:13.080620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce453a4-d3ad-402d-9b49-0c4f3e181d8f None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:13.082550 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523aac9-45b9-4d3e-be03-4ae1715e0448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:13.083266 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523aac9-45b9-4d3e-be03-4ae1715e0448 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:13.083561 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523aac9-45b9-4d3e-be03-4ae1715e0448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:13.083841 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523aac9-45b9-4d3e-be03-4ae1715e0448 admin admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.084573 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523aac9-45b9-4d3e-be03-4ae1715e0448 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:13.084887 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523aac9-45b9-4d3e-be03-4ae1715e0448 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:13.086494 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523aac9-45b9-4d3e-be03-4ae1715e0448 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:13.087899 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce453a4-d3ad-402d-9b49-0c4f3e181d8f None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:13.092721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bf4f7-c609-4e96-b883-3c1d2906e790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:13.093391 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bf4f7-c609-4e96-b883-3c1d2906e790 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:13.093663 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bf4f7-c609-4e96-b883-3c1d2906e790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:13.093942 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bf4f7-c609-4e96-b883-3c1d2906e790 admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.094663 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bf4f7-c609-4e96-b883-3c1d2906e790 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:13.094973 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bf4f7-c609-4e96-b883-3c1d2906e790 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:13.096590 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bf4f7-c609-4e96-b883-3c1d2906e790 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:13.099911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 778/1566] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:13.100787 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523aac9-45b9-4d3e-be03-4ae1715e0448 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:13.112523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 789/1567] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:13.113357 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bf4f7-c609-4e96-b883-3c1d2906e790 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:13.123984 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bf4f7-c609-4e96-b883-3c1d2906e790 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:13.124247 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523aac9-45b9-4d3e-be03-4ae1715e0448 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:13.128639 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b74e29-53f4-43a0-bd3b-8c1d96b2fe63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:13.128907 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c187b-7009-410b-95e2-c407b0103974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:13.129527 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b74e29-53f4-43a0-bd3b-8c1d96b2fe63 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:13.130345 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c187b-7009-410b-95e2-c407b0103974 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:13.130495 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b74e29-53f4-43a0-bd3b-8c1d96b2fe63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:13.130631 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c187b-7009-410b-95e2-c407b0103974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:13.130906 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c187b-7009-410b-95e2-c407b0103974 admin admin] PATH_INFO: `/v3/projects/32c8e69e0fea46958a7eeb79b91f740a/users/7143c461c94444558d6ac9f5cddfb264/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.131012 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b74e29-53f4-43a0-bd3b-8c1d96b2fe63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.131683 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b74e29-53f4-43a0-bd3b-8c1d96b2fe63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:13.133509 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b74e29-53f4-43a0-bd3b-8c1d96b2fe63 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:13.144196 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 790/1568] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:13.145145 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b74e29-53f4-43a0-bd3b-8c1d96b2fe63 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:13.149389 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c187b-7009-410b-95e2-c407b0103974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c8e69e0fea46958a7eeb79b91f740a, user_id=7143c461c94444558d6ac9f5cddfb264, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:13.152090 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c187b-7009-410b-95e2-c407b0103974 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:13.155076 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b74e29-53f4-43a0-bd3b-8c1d96b2fe63 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:13.160141 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1fd37-b5d4-45ed-9d1f-95f18d3d4a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:13.160732 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1fd37-b5d4-45ed-9d1f-95f18d3d4a5a admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:13.161552 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1fd37-b5d4-45ed-9d1f-95f18d3d4a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:13.161830 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1fd37-b5d4-45ed-9d1f-95f18d3d4a5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.162581 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1fd37-b5d4-45ed-9d1f-95f18d3d4a5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:13.162874 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1fd37-b5d4-45ed-9d1f-95f18d3d4a5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:13.165210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1fd37-b5d4-45ed-9d1f-95f18d3d4a5a admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:13.167193 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 779/1569] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:13 2022] PUT /identity/v3/projects/32c8e69e0fea46958a7eeb79b91f740a/users/7143c461c94444558d6ac9f5cddfb264/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:13.167891 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c187b-7009-410b-95e2-c407b0103974 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:13.177454 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 791/1570] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:13.178571 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1fd37-b5d4-45ed-9d1f-95f18d3d4a5a admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:13.188529 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1fd37-b5d4-45ed-9d1f-95f18d3d4a5a admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:13.236658 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c187b-7009-410b-95e2-c407b0103974 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:13.241911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1639b-4e7f-4081-98a3-5275f01de613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:13.242652 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1639b-4e7f-4081-98a3-5275f01de613 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:13.242850 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1639b-4e7f-4081-98a3-5275f01de613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:13.243132 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1639b-4e7f-4081-98a3-5275f01de613 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.243853 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1639b-4e7f-4081-98a3-5275f01de613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:13.244796 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b9d61-e486-49a0-a3cc-d756e80fc32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:13.245464 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b9d61-e486-49a0-a3cc-d756e80fc32b admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:13.245746 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1639b-4e7f-4081-98a3-5275f01de613 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:13.245889 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b9d61-e486-49a0-a3cc-d756e80fc32b admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:13.246039 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b9d61-e486-49a0-a3cc-d756e80fc32b admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.246727 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b9d61-e486-49a0-a3cc-d756e80fc32b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:13.247761 dv-cinder-849846-2-smb devstack@keystone.service[80304]: WARNING py.warnings [None req-cb8b9d61-e486-49a0-a3cc-d756e80fc32b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:32:13.247761 dv-cinder-849846-2-smb devstack@keystone.service[80304]: warnings.warn(msg) Jul 19 15:32:13.247761 dv-cinder-849846-2-smb devstack@keystone.service[80304]: Jul 19 15:32:13.248946 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b9d61-e486-49a0-a3cc-d756e80fc32b admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:13.271701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 780/1571] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:32:13 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:13.272665 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1639b-4e7f-4081-98a3-5275f01de613 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:13.280548 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 792/1572] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:32:13 2022] POST /identity/v3/projects => generated 405 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:13.280548 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b9d61-e486-49a0-a3cc-d756e80fc32b admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:13.336352 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1639b-4e7f-4081-98a3-5275f01de613 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:13.341108 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c5db5-bffa-461a-9868-b8d10e0aa21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:13.341800 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c5db5-bffa-461a-9868-b8d10e0aa21b admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:13.342043 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b9d61-e486-49a0-a3cc-d756e80fc32b admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:13.342226 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c5db5-bffa-461a-9868-b8d10e0aa21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:13.342513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c5db5-bffa-461a-9868-b8d10e0aa21b admin admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.343276 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c5db5-bffa-461a-9868-b8d10e0aa21b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:13.343600 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c5db5-bffa-461a-9868-b8d10e0aa21b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:13.345262 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c5db5-bffa-461a-9868-b8d10e0aa21b admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:13.346779 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924a1b8-22db-4a2d-82da-5adcbb57ebc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:13.347468 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924a1b8-22db-4a2d-82da-5adcbb57ebc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:13.347761 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924a1b8-22db-4a2d-82da-5adcbb57ebc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:13.348045 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924a1b8-22db-4a2d-82da-5adcbb57ebc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.349284 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924a1b8-22db-4a2d-82da-5adcbb57ebc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:13.351169 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924a1b8-22db-4a2d-82da-5adcbb57ebc8 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:13.357431 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 781/1573] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:13.365332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c5db5-bffa-461a-9868-b8d10e0aa21b admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:13.368486 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c5db5-bffa-461a-9868-b8d10e0aa21b admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:13.373959 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc05aa6-4e4f-481b-8533-4ddc87302b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:13.374621 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc05aa6-4e4f-481b-8533-4ddc87302b15 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:13.374907 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc05aa6-4e4f-481b-8533-4ddc87302b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:13.375189 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc05aa6-4e4f-481b-8533-4ddc87302b15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.376056 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc05aa6-4e4f-481b-8533-4ddc87302b15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:13.377879 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc05aa6-4e4f-481b-8533-4ddc87302b15 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:13.384808 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 793/1574] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:32:13 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:13.385769 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924a1b8-22db-4a2d-82da-5adcbb57ebc8 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:13.399081 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:13.401735 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:13.407273 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 782/1575] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:32:13 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:13.408660 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d327fe5-52cb-44c9-8d5b-2f4be7fb26b2 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:13.408942 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d327fe5-52cb-44c9-8d5b-2f4be7fb26b2 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:13.409219 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d327fe5-52cb-44c9-8d5b-2f4be7fb26b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.429491 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-7d327fe5-52cb-44c9-8d5b-2f4be7fb26b2 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:13.430932 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-7d327fe5-52cb-44c9-8d5b-2f4be7fb26b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:13.460774 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924a1b8-22db-4a2d-82da-5adcbb57ebc8 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:13.492430 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 783/1576] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:13.493336 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d327fe5-52cb-44c9-8d5b-2f4be7fb26b2 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:13.503361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d327fe5-52cb-44c9-8d5b-2f4be7fb26b2 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:13.508351 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cd5a5-39fc-4e8b-8477-33ebc751ebcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:13.509321 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cd5a5-39fc-4e8b-8477-33ebc751ebcb admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:13.509519 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cd5a5-39fc-4e8b-8477-33ebc751ebcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:13.509802 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cd5a5-39fc-4e8b-8477-33ebc751ebcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.510700 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cd5a5-39fc-4e8b-8477-33ebc751ebcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:13.512860 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cd5a5-39fc-4e8b-8477-33ebc751ebcb admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:13.526024 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05b4bf-b9df-431d-82af-cff183aff1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:13.526705 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05b4bf-b9df-431d-82af-cff183aff1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:13.527022 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05b4bf-b9df-431d-82af-cff183aff1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:13.527402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05b4bf-b9df-431d-82af-cff183aff1c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.528032 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05b4bf-b9df-431d-82af-cff183aff1c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:13.529634 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05b4bf-b9df-431d-82af-cff183aff1c5 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:13.540284 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 784/1577] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:32:13 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:13.541121 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cd5a5-39fc-4e8b-8477-33ebc751ebcb admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:13.544203 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 794/1578] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:13.545158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05b4bf-b9df-431d-82af-cff183aff1c5 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:13.555114 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05b4bf-b9df-431d-82af-cff183aff1c5 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:13.605998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cd5a5-39fc-4e8b-8477-33ebc751ebcb admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:13.610748 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ba4c6-4a50-4d4d-90d9-6691268a6e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:13.611555 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ba4c6-4a50-4d4d-90d9-6691268a6e66 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:13.611841 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ba4c6-4a50-4d4d-90d9-6691268a6e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:13.612117 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ba4c6-4a50-4d4d-90d9-6691268a6e66 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.612805 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ba4c6-4a50-4d4d-90d9-6691268a6e66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:13.613586 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c7c1e-71bd-4c98-bec2-137edb9c0b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:13.614374 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c7c1e-71bd-4c98-bec2-137edb9c0b3e admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:13.614663 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c7c1e-71bd-4c98-bec2-137edb9c0b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:13.614769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ba4c6-4a50-4d4d-90d9-6691268a6e66 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:13.614946 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c7c1e-71bd-4c98-bec2-137edb9c0b3e admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.615694 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c7c1e-71bd-4c98-bec2-137edb9c0b3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:13.617582 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c7c1e-71bd-4c98-bec2-137edb9c0b3e admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:13.635568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 785/1579] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:32:13 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:13.636376 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ba4c6-4a50-4d4d-90d9-6691268a6e66 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:13.643834 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 795/1580] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:32:13 2022] POST /identity/v3/users => generated 303 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:13.647252 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ba4c6-4a50-4d4d-90d9-6691268a6e66 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:13.648698 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c7c1e-71bd-4c98-bec2-137edb9c0b3e admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:13.652445 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0af425-0003-46af-9e25-c11de0294e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:13.653210 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0af425-0003-46af-9e25-c11de0294e05 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:13.653491 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0af425-0003-46af-9e25-c11de0294e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:13.653764 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0af425-0003-46af-9e25-c11de0294e05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.654457 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0af425-0003-46af-9e25-c11de0294e05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:13.656401 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0af425-0003-46af-9e25-c11de0294e05 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:13.660075 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c7c1e-71bd-4c98-bec2-137edb9c0b3e admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:13.665904 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd162dc0-c5b8-4bd5-9400-11fda59b0a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:13.666582 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd162dc0-c5b8-4bd5-9400-11fda59b0a95 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:13.666873 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd162dc0-c5b8-4bd5-9400-11fda59b0a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:13.667156 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd162dc0-c5b8-4bd5-9400-11fda59b0a95 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.667893 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd162dc0-c5b8-4bd5-9400-11fda59b0a95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:13.669832 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd162dc0-c5b8-4bd5-9400-11fda59b0a95 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:13.684546 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 786/1581] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:32:13 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:13.685281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0af425-0003-46af-9e25-c11de0294e05 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:13.691406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 796/1582] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:32:13 2022] POST /identity/v3/users => generated 293 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:13.692229 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd162dc0-c5b8-4bd5-9400-11fda59b0a95 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:13.722958 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:13.737800 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:13.749962 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd162dc0-c5b8-4bd5-9400-11fda59b0a95 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:13.752472 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0af425-0003-46af-9e25-c11de0294e05 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:13.757152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04439d4-22da-44ed-a9f2-533ddf546c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:13.757825 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04439d4-22da-44ed-a9f2-533ddf546c51 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:13.758115 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04439d4-22da-44ed-a9f2-533ddf546c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:13.758398 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04439d4-22da-44ed-a9f2-533ddf546c51 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.759089 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04439d4-22da-44ed-a9f2-533ddf546c51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:13.761034 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04439d4-22da-44ed-a9f2-533ddf546c51 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:13.783269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 787/1583] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:32:13 2022] POST /identity/v3/users => generated 282 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:13.783269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04439d4-22da-44ed-a9f2-533ddf546c51 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:13.792678 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04439d4-22da-44ed-a9f2-533ddf546c51 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:13.797431 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f293c6-47ae-4fc9-a297-deb303c22209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:13.798057 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f293c6-47ae-4fc9-a297-deb303c22209 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:13.798341 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f293c6-47ae-4fc9-a297-deb303c22209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:13.798621 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f293c6-47ae-4fc9-a297-deb303c22209 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.799339 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f293c6-47ae-4fc9-a297-deb303c22209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:13.801264 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f293c6-47ae-4fc9-a297-deb303c22209 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:13.804485 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8d03e-f4f3-4fcd-9ce3-560469a23b0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:13.805188 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8d03e-f4f3-4fcd-9ce3-560469a23b0f service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:13.805448 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8d03e-f4f3-4fcd-9ce3-560469a23b0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:13.805762 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8d03e-f4f3-4fcd-9ce3-560469a23b0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.816163 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8d03e-f4f3-4fcd-9ce3-560469a23b0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:13.817725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8d03e-f4f3-4fcd-9ce3-560469a23b0f service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:13.824196 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 788/1584] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:32:13 2022] POST /identity/v3/users => generated 290 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:13.824196 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f293c6-47ae-4fc9-a297-deb303c22209 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:13.828025 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 797/1585] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:13.828700 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8d03e-f4f3-4fcd-9ce3-560469a23b0f service neutron] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:13.832091 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f293c6-47ae-4fc9-a297-deb303c22209 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:13.838750 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8d03e-f4f3-4fcd-9ce3-560469a23b0f service neutron] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:13.841306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16179995-a787-437c-bb43-bc93dca68676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:13.842342 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16179995-a787-437c-bb43-bc93dca68676 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:13.842626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16179995-a787-437c-bb43-bc93dca68676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:13.842984 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16179995-a787-437c-bb43-bc93dca68676 admin admin] PATH_INFO: `/v3/projects/45b6302bfa2146abbb4d0739d3cb3473/users/b45daa47d2e7412a9363846a07b6039c/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.844117 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda53216-d2b8-4456-b788-c420f1a887f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:13.844283 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda53216-d2b8-4456-b788-c420f1a887f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:13.844541 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda53216-d2b8-4456-b788-c420f1a887f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:13.844845 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda53216-d2b8-4456-b788-c420f1a887f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.845595 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda53216-d2b8-4456-b788-c420f1a887f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:13.847171 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda53216-d2b8-4456-b788-c420f1a887f4 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:13.859598 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 798/1586] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:13.860264 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda53216-d2b8-4456-b788-c420f1a887f4 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:13.867043 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16179995-a787-437c-bb43-bc93dca68676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45b6302bfa2146abbb4d0739d3cb3473, user_id=b45daa47d2e7412a9363846a07b6039c, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:13.870040 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16179995-a787-437c-bb43-bc93dca68676 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:13.871191 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda53216-d2b8-4456-b788-c420f1a887f4 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:13.876185 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c793561-e800-45bf-b36d-d772b39ec8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:13.877020 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c793561-e800-45bf-b36d-d772b39ec8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:13.877304 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c793561-e800-45bf-b36d-d772b39ec8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:13.877580 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c793561-e800-45bf-b36d-d772b39ec8f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.878312 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c793561-e800-45bf-b36d-d772b39ec8f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:13.880511 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c793561-e800-45bf-b36d-d772b39ec8f8 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:13.887099 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 789/1587] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:13 2022] PUT /identity/v3/projects/45b6302bfa2146abbb4d0739d3cb3473/users/b45daa47d2e7412a9363846a07b6039c/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:13.888312 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16179995-a787-437c-bb43-bc93dca68676 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:13.894653 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 799/1588] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:13.895996 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c793561-e800-45bf-b36d-d772b39ec8f8 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:13.910233 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c793561-e800-45bf-b36d-d772b39ec8f8 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:13.980769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16179995-a787-437c-bb43-bc93dca68676 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:13.982372 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16bebf5-7795-4771-9c78-244bf4ca1b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:13.983062 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bebf5-7795-4771-9c78-244bf4ca1b14 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:13.983379 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bebf5-7795-4771-9c78-244bf4ca1b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:13.983662 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bebf5-7795-4771-9c78-244bf4ca1b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.984427 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16bebf5-7795-4771-9c78-244bf4ca1b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:13.985930 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01516e61-6dc0-4881-b077-4d7a888239d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:13.986096 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16bebf5-7795-4771-9c78-244bf4ca1b14 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:13.986814 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01516e61-6dc0-4881-b077-4d7a888239d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:13.987253 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01516e61-6dc0-4881-b077-4d7a888239d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:13.987928 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01516e61-6dc0-4881-b077-4d7a888239d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:13.988984 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01516e61-6dc0-4881-b077-4d7a888239d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:13.991824 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01516e61-6dc0-4881-b077-4d7a888239d1 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:14.002295 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 800/1589] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:14.002295 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16bebf5-7795-4771-9c78-244bf4ca1b14 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:14.012830 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16bebf5-7795-4771-9c78-244bf4ca1b14 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:14.018221 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78853b0-2b21-4519-ae20-4a41ebe5c222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:14.019131 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78853b0-2b21-4519-ae20-4a41ebe5c222 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:14.022254 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78853b0-2b21-4519-ae20-4a41ebe5c222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:14.022254 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78853b0-2b21-4519-ae20-4a41ebe5c222 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:14.022467 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 790/1590] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:32:13 2022] POST /identity/v3/users => generated 296 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:14.022566 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78853b0-2b21-4519-ae20-4a41ebe5c222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:14.022675 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01516e61-6dc0-4881-b077-4d7a888239d1 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:14.022767 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78853b0-2b21-4519-ae20-4a41ebe5c222 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:14.038728 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01516e61-6dc0-4881-b077-4d7a888239d1 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:14.042205 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 801/1591] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:14.043165 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78853b0-2b21-4519-ae20-4a41ebe5c222 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:14.046518 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852f64b-503a-49ec-ae87-bd1da0a85e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:14.047339 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852f64b-503a-49ec-ae87-bd1da0a85e0e admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:14.047719 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852f64b-503a-49ec-ae87-bd1da0a85e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:14.048096 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852f64b-503a-49ec-ae87-bd1da0a85e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:14.048929 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852f64b-503a-49ec-ae87-bd1da0a85e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:14.050925 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852f64b-503a-49ec-ae87-bd1da0a85e0e admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:14.054304 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78853b0-2b21-4519-ae20-4a41ebe5c222 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:14.059481 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467c02d-3ba3-4619-8c51-03f0a1af9bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:14.060183 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467c02d-3ba3-4619-8c51-03f0a1af9bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:14.060466 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467c02d-3ba3-4619-8c51-03f0a1af9bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:14.060745 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467c02d-3ba3-4619-8c51-03f0a1af9bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:14.061488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467c02d-3ba3-4619-8c51-03f0a1af9bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:14.063166 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 791/1592] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:14.063584 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467c02d-3ba3-4619-8c51-03f0a1af9bb7 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:14.064759 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b9f6d-269e-4337-a0bf-710a298f6ea7 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:14.065318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b9f6d-269e-4337-a0bf-710a298f6ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:14.065541 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b9f6d-269e-4337-a0bf-710a298f6ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:14.075793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 802/1593] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:14.076623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467c02d-3ba3-4619-8c51-03f0a1af9bb7 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:14.087372 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-991b9f6d-269e-4337-a0bf-710a298f6ea7 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:14.088994 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-991b9f6d-269e-4337-a0bf-710a298f6ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:14.089536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467c02d-3ba3-4619-8c51-03f0a1af9bb7 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:14.094344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fd5ea-ad79-4841-bc72-12f8c4fe1542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:14.095023 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fd5ea-ad79-4841-bc72-12f8c4fe1542 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:14.095376 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fd5ea-ad79-4841-bc72-12f8c4fe1542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:14.095708 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fd5ea-ad79-4841-bc72-12f8c4fe1542 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:14.096400 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fd5ea-ad79-4841-bc72-12f8c4fe1542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:14.098132 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 792/1594] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:14.098792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fd5ea-ad79-4841-bc72-12f8c4fe1542 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:14.102900 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b9f6d-269e-4337-a0bf-710a298f6ea7 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:14.112817 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b9f6d-269e-4337-a0bf-710a298f6ea7 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:14.114575 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 803/1595] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:14.115469 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fd5ea-ad79-4841-bc72-12f8c4fe1542 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:14.122533 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84f4e7-2784-44b2-8c8e-b23699914c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:14.122533 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84f4e7-2784-44b2-8c8e-b23699914c72 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:14.122829 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84f4e7-2784-44b2-8c8e-b23699914c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:14.123110 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84f4e7-2784-44b2-8c8e-b23699914c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:14.124124 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84f4e7-2784-44b2-8c8e-b23699914c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:14.125871 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84f4e7-2784-44b2-8c8e-b23699914c72 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:14.126003 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fd5ea-ad79-4841-bc72-12f8c4fe1542 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:14.133778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ecfce-6336-4bcb-a047-f7e318c01d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:14.134579 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ecfce-6336-4bcb-a047-f7e318c01d99 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:14.134848 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ecfce-6336-4bcb-a047-f7e318c01d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:14.135335 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ecfce-6336-4bcb-a047-f7e318c01d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:14.136085 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ecfce-6336-4bcb-a047-f7e318c01d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:14.137721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ecfce-6336-4bcb-a047-f7e318c01d99 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:14.139491 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 793/1596] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:14.140542 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84f4e7-2784-44b2-8c8e-b23699914c72 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:14.150798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84f4e7-2784-44b2-8c8e-b23699914c72 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:14.151657 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 804/1597] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:14.155385 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ecfce-6336-4bcb-a047-f7e318c01d99 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:14.160408 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef856f9-5da7-444e-9dae-3e7ea31ea5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:14.161863 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef856f9-5da7-444e-9dae-3e7ea31ea5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:14.162261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef856f9-5da7-444e-9dae-3e7ea31ea5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:14.162602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef856f9-5da7-444e-9dae-3e7ea31ea5d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:14.163488 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef856f9-5da7-444e-9dae-3e7ea31ea5d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:14.165280 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef856f9-5da7-444e-9dae-3e7ea31ea5d6 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:14.169709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ecfce-6336-4bcb-a047-f7e318c01d99 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:14.176325 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 794/1598] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:14.180856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef856f9-5da7-444e-9dae-3e7ea31ea5d6 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:14.190696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfde9c-f3ee-491c-87ed-3275be102a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:14.190929 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef856f9-5da7-444e-9dae-3e7ea31ea5d6 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:14.191563 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfde9c-f3ee-491c-87ed-3275be102a1a admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:14.191948 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfde9c-f3ee-491c-87ed-3275be102a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:14.192376 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfde9c-f3ee-491c-87ed-3275be102a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:14.194221 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfde9c-f3ee-491c-87ed-3275be102a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:14.195986 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfde9c-f3ee-491c-87ed-3275be102a1a admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:14.196162 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f939b-ac68-4cdd-b7a9-321cd8f9109b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:14.196956 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f939b-ac68-4cdd-b7a9-321cd8f9109b admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:14.197244 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f939b-ac68-4cdd-b7a9-321cd8f9109b admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:14.197517 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f939b-ac68-4cdd-b7a9-321cd8f9109b admin admin] PATH_INFO: `/v3/projects/d44026158fd9491e914359db8dfab34a/users/2bb3854e6572455aa71046535bd5c282/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:14.212144 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 805/1599] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:14.213722 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfde9c-f3ee-491c-87ed-3275be102a1a admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:14.216092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f939b-ac68-4cdd-b7a9-321cd8f9109b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d44026158fd9491e914359db8dfab34a, user_id=2bb3854e6572455aa71046535bd5c282, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:14.216212 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-c9cfde9c-f3ee-491c-87ed-3275be102a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:14.218924 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f939b-ac68-4cdd-b7a9-321cd8f9109b admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:14.234788 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 795/1600] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:14 2022] PUT /identity/v3/projects/d44026158fd9491e914359db8dfab34a/users/2bb3854e6572455aa71046535bd5c282/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:14.235304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f939b-ac68-4cdd-b7a9-321cd8f9109b admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:14.256881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:14.263632 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:14.312634 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfde9c-f3ee-491c-87ed-3275be102a1a admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:14.328510 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f939b-ac68-4cdd-b7a9-321cd8f9109b admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:14.334743 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31102d-b77e-4105-9e95-ae422d95e2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:14.335714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31102d-b77e-4105-9e95-ae422d95e2e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:14.335961 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31102d-b77e-4105-9e95-ae422d95e2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:14.336241 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31102d-b77e-4105-9e95-ae422d95e2e7 admin admin] PATH_INFO: `/v3/projects/f321ce34787d43ebb12922bdc08f92f6/users/7f20b8f6cc244c3ea24400ae77e36fe8/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:14.354031 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31102d-b77e-4105-9e95-ae422d95e2e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f321ce34787d43ebb12922bdc08f92f6, user_id=7f20b8f6cc244c3ea24400ae77e36fe8, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:14.357455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31102d-b77e-4105-9e95-ae422d95e2e7 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:14.373978 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 796/1601] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:14 2022] PUT /identity/v3/projects/f321ce34787d43ebb12922bdc08f92f6/users/7f20b8f6cc244c3ea24400ae77e36fe8/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:14.375025 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31102d-b77e-4105-9e95-ae422d95e2e7 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:14.375606 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc74d88-8513-40f2-afe8-dc4072d50a36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:14.376274 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc74d88-8513-40f2-afe8-dc4072d50a36 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:14.376587 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc74d88-8513-40f2-afe8-dc4072d50a36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:14.376870 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc74d88-8513-40f2-afe8-dc4072d50a36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:14.388726 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc74d88-8513-40f2-afe8-dc4072d50a36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:14.390368 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc74d88-8513-40f2-afe8-dc4072d50a36 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:14.402118 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 806/1602] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:14.402856 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc74d88-8513-40f2-afe8-dc4072d50a36 service neutron] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:14.414366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc74d88-8513-40f2-afe8-dc4072d50a36 service neutron] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:14.444619 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31102d-b77e-4105-9e95-ae422d95e2e7 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:14.451427 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ff3e2-57dd-4ee4-81c5-b0f397d8098e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:14.452332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ff3e2-57dd-4ee4-81c5-b0f397d8098e admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:14.452618 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ff3e2-57dd-4ee4-81c5-b0f397d8098e admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:14.452898 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ff3e2-57dd-4ee4-81c5-b0f397d8098e admin admin] PATH_INFO: `/v3/projects/1df69107e3734efc8c76253f79d581e8/users/20537318b9ef48b1b1d39e6eeddaec58/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:14.478230 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ff3e2-57dd-4ee4-81c5-b0f397d8098e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1df69107e3734efc8c76253f79d581e8, user_id=20537318b9ef48b1b1d39e6eeddaec58, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:14.481083 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ff3e2-57dd-4ee4-81c5-b0f397d8098e admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:14.490783 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2b106-13dd-40d0-b6bd-ffd328b8d8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:14.491772 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2b106-13dd-40d0-b6bd-ffd328b8d8ee admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:14.492062 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2b106-13dd-40d0-b6bd-ffd328b8d8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:14.492348 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2b106-13dd-40d0-b6bd-ffd328b8d8ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:14.493200 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2b106-13dd-40d0-b6bd-ffd328b8d8ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:14.494729 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2b106-13dd-40d0-b6bd-ffd328b8d8ee admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:14.496897 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 797/1603] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:14 2022] PUT /identity/v3/projects/1df69107e3734efc8c76253f79d581e8/users/20537318b9ef48b1b1d39e6eeddaec58/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:14.497460 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ff3e2-57dd-4ee4-81c5-b0f397d8098e admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:14.520891 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 807/1604] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:14.522495 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2b106-13dd-40d0-b6bd-ffd328b8d8ee admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:14.533589 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2b106-13dd-40d0-b6bd-ffd328b8d8ee admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:14.575511 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ff3e2-57dd-4ee4-81c5-b0f397d8098e admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:14.583540 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c4778-8927-46e3-9228-059143613a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:14.584456 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c4778-8927-46e3-9228-059143613a9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:14.584747 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c4778-8927-46e3-9228-059143613a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:14.585029 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c4778-8927-46e3-9228-059143613a9a admin admin] PATH_INFO: `/v3/projects/a3e4d7fdc7ee4616ad8a50b177c444e6/users/98556b3197704897ae7d09403e60fe7e/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:14.606337 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c4778-8927-46e3-9228-059143613a9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3e4d7fdc7ee4616ad8a50b177c444e6, user_id=98556b3197704897ae7d09403e60fe7e, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:14.609608 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c4778-8927-46e3-9228-059143613a9a admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:14.612790 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716cc302-5fce-4b74-b957-c404bb4f57de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:14.613995 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cc302-5fce-4b74-b957-c404bb4f57de admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:14.614364 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cc302-5fce-4b74-b957-c404bb4f57de admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:14.614765 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cc302-5fce-4b74-b957-c404bb4f57de admin admin] PATH_INFO: `/v3/projects/5c971c14b3764addb5b05cc84154c8d8/users/7dbd6ff526844272b3f48e49991039ba/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:14.619285 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:14.634539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 798/1605] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:14 2022] PUT /identity/v3/projects/a3e4d7fdc7ee4616ad8a50b177c444e6/users/98556b3197704897ae7d09403e60fe7e/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:14.636300 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d4bad-233d-4b1e-8613-c1f407f5c982 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:14.636455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716cc302-5fce-4b74-b957-c404bb4f57de admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c971c14b3764addb5b05cc84154c8d8, user_id=7dbd6ff526844272b3f48e49991039ba, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:14.636898 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d4bad-233d-4b1e-8613-c1f407f5c982 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:14.637325 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d4bad-233d-4b1e-8613-c1f407f5c982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:14.637559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: WARNING py.warnings [None req-716cc302-5fce-4b74-b957-c404bb4f57de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:32:14.637559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: warnings.warn(msg) Jul 19 15:32:14.637559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: Jul 19 15:32:14.640154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716cc302-5fce-4b74-b957-c404bb4f57de admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:14.662584 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 808/1606] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:14 2022] PUT /identity/v3/projects/5c971c14b3764addb5b05cc84154c8d8/users/7dbd6ff526844272b3f48e49991039ba/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:14.663751 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:14.667008 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bb354-4b78-467c-9db3-495802a498d9 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:14.668603 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bb354-4b78-467c-9db3-495802a498d9 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:14.669063 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bb354-4b78-467c-9db3-495802a498d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:14.699771 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-d50d4bad-233d-4b1e-8613-c1f407f5c982 None None] MFA Rules not processed for user `2bb3854e6572455aa71046535bd5c282`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:14.705255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-d50d4bad-233d-4b1e-8613-c1f407f5c982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:14.705819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-8b1bb354-4b78-467c-9db3-495802a498d9 None None] MFA Rules not processed for user `7f20b8f6cc244c3ea24400ae77e36fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:14.708334 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-8b1bb354-4b78-467c-9db3-495802a498d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:14.826694 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 799/1607] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:14.826694 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f151f45-4e14-4861-8666-0e11009445a0 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:14.826694 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f151f45-4e14-4861-8666-0e11009445a0 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:14.826694 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f151f45-4e14-4861-8666-0e11009445a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:14.872335 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 809/1608] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:14 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:14.874142 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1bb354-4b78-467c-9db3-495802a498d9 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:14.897898 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-4f151f45-4e14-4861-8666-0e11009445a0 None None] MFA Rules not processed for user `20537318b9ef48b1b1d39e6eeddaec58`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:14.901038 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-4f151f45-4e14-4861-8666-0e11009445a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:14.964098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1bb354-4b78-467c-9db3-495802a498d9 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:14.969016 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fd7b7-49a2-4246-baad-7acd640f7bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:14.970092 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fd7b7-49a2-4246-baad-7acd640f7bbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:14.970473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fd7b7-49a2-4246-baad-7acd640f7bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:14.970870 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fd7b7-49a2-4246-baad-7acd640f7bbb admin admin] PATH_INFO: `/v3/projects/9c6b93bc4d064d2cb0d74da656abffe1/users/dcd12611b7d144e28fa1358f927c9f2d/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:14.987736 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2fd7b7-49a2-4246-baad-7acd640f7bbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c6b93bc4d064d2cb0d74da656abffe1, user_id=dcd12611b7d144e28fa1358f927c9f2d, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:14.991042 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2fd7b7-49a2-4246-baad-7acd640f7bbb admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:15.008766 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 810/1609] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:14 2022] PUT /identity/v3/projects/9c6b93bc4d064d2cb0d74da656abffe1/users/dcd12611b7d144e28fa1358f927c9f2d/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:15.010436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f62a2-27b6-47c3-a089-e4875c239cb4 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:15.010825 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f62a2-27b6-47c3-a089-e4875c239cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:15.011204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f62a2-27b6-47c3-a089-e4875c239cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:15.050499 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 800/1610] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:15.053973 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79cb51-ca70-421d-9f44-7c6dcefdd159 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:15.054705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79cb51-ca70-421d-9f44-7c6dcefdd159 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:15.055289 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79cb51-ca70-421d-9f44-7c6dcefdd159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:15.081462 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-4e79cb51-ca70-421d-9f44-7c6dcefdd159 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:15.083739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-4e79cb51-ca70-421d-9f44-7c6dcefdd159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:15.085028 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-1d1f62a2-27b6-47c3-a089-e4875c239cb4 None None] MFA Rules not processed for user `98556b3197704897ae7d09403e60fe7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:15.086968 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-1d1f62a2-27b6-47c3-a089-e4875c239cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:15.155717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:15.188560 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 811/1611] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:15 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:15.189423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f62a2-27b6-47c3-a089-e4875c239cb4 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:15.234016 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 801/1612] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:15.234016 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e7894-c74e-47f8-8b91-6d6a2c887b55 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:15.234016 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e7894-c74e-47f8-8b91-6d6a2c887b55 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:15.234016 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e7894-c74e-47f8-8b91-6d6a2c887b55 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:15.236259 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 802/1613] 10.222.0.44 () {54 vars in 962 bytes} [Tue Jul 19 15:32:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:15.239384 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137064a-17ac-4615-9604-9119bf06b457 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:15.239827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137064a-17ac-4615-9604-9119bf06b457 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:15.240198 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137064a-17ac-4615-9604-9119bf06b457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:15.275758 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f62a2-27b6-47c3-a089-e4875c239cb4 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:15.280310 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-d137064a-17ac-4615-9604-9119bf06b457 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:15.281340 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50c023-002e-42c4-bc5f-92dca2493936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:15.282237 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50c023-002e-42c4-bc5f-92dca2493936 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:15.282533 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50c023-002e-42c4-bc5f-92dca2493936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:15.282822 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50c023-002e-42c4-bc5f-92dca2493936 admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:15.283622 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50c023-002e-42c4-bc5f-92dca2493936 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:15.285010 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-d137064a-17ac-4615-9604-9119bf06b457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:15.289459 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50c023-002e-42c4-bc5f-92dca2493936 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:15.309275 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 803/1614] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:15.309275 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9396f-bfbf-48b6-94be-9e5acf34e279 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:15.309275 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9396f-bfbf-48b6-94be-9e5acf34e279 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:15.309275 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9396f-bfbf-48b6-94be-9e5acf34e279 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:15.315087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 804/1615] 10.222.0.44 () {54 vars in 962 bytes} [Tue Jul 19 15:32:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:15.317146 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9396f-bfbf-48b6-94be-9e5acf34e279 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:15.343911 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 812/1616] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:32:15 2022] POST /identity/v3/projects => generated 405 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:15.344121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5270a-269b-4869-ae56-7f3adba8332b None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:15.344342 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5270a-269b-4869-ae56-7f3adba8332b None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:15.344633 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5270a-269b-4869-ae56-7f3adba8332b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:15.382880 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:15.400174 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-dfe5270a-269b-4869-ae56-7f3adba8332b None None] MFA Rules not processed for user `fef0511f56144ca9945b2dddfa2601a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:15.401480 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-dfe5270a-269b-4869-ae56-7f3adba8332b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:15.447860 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9396f-bfbf-48b6-94be-9e5acf34e279 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:15.499602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 813/1617] 10.222.0.44 () {58 vars in 1059 bytes} [Tue Jul 19 15:32:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:15.501633 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5270a-269b-4869-ae56-7f3adba8332b None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:15.562789 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b117de-8983-462c-9b34-143caeb0cffb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:15.563406 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b117de-8983-462c-9b34-143caeb0cffb service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:15.563688 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b117de-8983-462c-9b34-143caeb0cffb service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:15.563978 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b117de-8983-462c-9b34-143caeb0cffb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:15.584473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5270a-269b-4869-ae56-7f3adba8332b None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:15.590444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9816c2-8880-49f0-b193-f1ac3a95e999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:15.591475 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9816c2-8880-49f0-b193-f1ac3a95e999 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:15.592578 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9816c2-8880-49f0-b193-f1ac3a95e999 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:15.593025 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9816c2-8880-49f0-b193-f1ac3a95e999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:15.599994 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:15.638219 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b117de-8983-462c-9b34-143caeb0cffb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:15.639747 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b117de-8983-462c-9b34-143caeb0cffb service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:15.655925 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 805/1618] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:15 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:15.657803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091e9ec-710b-4a2c-9e75-47f5db6a0325 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:15.658144 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091e9ec-710b-4a2c-9e75-47f5db6a0325 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:15.658665 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091e9ec-710b-4a2c-9e75-47f5db6a0325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:15.679783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-9091e9ec-710b-4a2c-9e75-47f5db6a0325 None None] MFA Rules not processed for user `fef0511f56144ca9945b2dddfa2601a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:15.682289 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-9091e9ec-710b-4a2c-9e75-47f5db6a0325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:15.694390 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 806/1619] 10.222.0.44 () {58 vars in 1059 bytes} [Tue Jul 19 15:32:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:15.702705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091e9ec-710b-4a2c-9e75-47f5db6a0325 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:15.704766 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9816c2-8880-49f0-b193-f1ac3a95e999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:15.706560 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9816c2-8880-49f0-b193-f1ac3a95e999 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:15.714859 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091e9ec-710b-4a2c-9e75-47f5db6a0325 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:15.719867 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f72d0-342e-4691-a033-6ed685c12977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:15.720728 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f72d0-342e-4691-a033-6ed685c12977 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:15.721179 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f72d0-342e-4691-a033-6ed685c12977 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:15.721555 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f72d0-342e-4691-a033-6ed685c12977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:15.736128 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f72d0-342e-4691-a033-6ed685c12977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:15.737546 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f72d0-342e-4691-a033-6ed685c12977 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:15.750713 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 807/1620] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:15.751986 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 814/1621] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:15.752695 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f72d0-342e-4691-a033-6ed685c12977 service neutron] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:15.754100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9816c2-8880-49f0-b193-f1ac3a95e999 service neutron] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:15.772760 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f72d0-342e-4691-a033-6ed685c12977 service neutron] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:15.778506 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9816c2-8880-49f0-b193-f1ac3a95e999 service neutron] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:15.785156 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e80dc-1ce9-49ee-a7b1-7d8dd0953a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:15.786827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e80dc-1ce9-49ee-a7b1-7d8dd0953a4d admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:15.787740 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e80dc-1ce9-49ee-a7b1-7d8dd0953a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:15.788576 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e80dc-1ce9-49ee-a7b1-7d8dd0953a4d admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:15.789774 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e80dc-1ce9-49ee-a7b1-7d8dd0953a4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:15.792697 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e80dc-1ce9-49ee-a7b1-7d8dd0953a4d admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:15.794584 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649f064-e474-4d86-8cb9-c6e02bb6ee8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:15.795548 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649f064-e474-4d86-8cb9-c6e02bb6ee8d service nova] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:15.795847 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649f064-e474-4d86-8cb9-c6e02bb6ee8d service nova] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:15.795946 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649f064-e474-4d86-8cb9-c6e02bb6ee8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:15.838505 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 808/1622] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:32:15 2022] POST /identity/v3/users => generated 309 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:15.842307 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ca3dc-5418-4922-980f-d040a4e9edc8 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:15.842611 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ca3dc-5418-4922-980f-d040a4e9edc8 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:15.842905 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ca3dc-5418-4922-980f-d040a4e9edc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:15.894333 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649f064-e474-4d86-8cb9-c6e02bb6ee8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:15.897571 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649f064-e474-4d86-8cb9-c6e02bb6ee8d service nova] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:15.917092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-884ca3dc-5418-4922-980f-d040a4e9edc8 None None] MFA Rules not processed for user `b45daa47d2e7412a9363846a07b6039c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:15.919838 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-884ca3dc-5418-4922-980f-d040a4e9edc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:15.925563 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 815/1623] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:15.927810 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649f064-e474-4d86-8cb9-c6e02bb6ee8d service nova] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:15.947198 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649f064-e474-4d86-8cb9-c6e02bb6ee8d service nova] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:15.969430 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34b5b1-a09d-4872-a0d9-b8bd3b015a08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:15.970104 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34b5b1-a09d-4872-a0d9-b8bd3b015a08 service nova] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:15.970547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34b5b1-a09d-4872-a0d9-b8bd3b015a08 service nova] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:15.970831 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34b5b1-a09d-4872-a0d9-b8bd3b015a08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:16.044619 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:16.092865 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 809/1624] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:15 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:16.093769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ca3dc-5418-4922-980f-d040a4e9edc8 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:16.109777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34b5b1-a09d-4872-a0d9-b8bd3b015a08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:16.112193 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34b5b1-a09d-4872-a0d9-b8bd3b015a08 service nova] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:16.123648 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ca3dc-5418-4922-980f-d040a4e9edc8 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:16.126510 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 816/1625] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:16.127744 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34b5b1-a09d-4872-a0d9-b8bd3b015a08 service nova] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:16.140920 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34b5b1-a09d-4872-a0d9-b8bd3b015a08 service nova] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:16.146596 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d7539-f3f3-422b-9683-1107feec9b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:16.147698 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d7539-f3f3-422b-9683-1107feec9b13 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:16.148098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d7539-f3f3-422b-9683-1107feec9b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:16.148713 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d7539-f3f3-422b-9683-1107feec9b13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:16.149592 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d7539-f3f3-422b-9683-1107feec9b13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:16.151926 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d7539-f3f3-422b-9683-1107feec9b13 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:16.154058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595ca61-c3c1-498f-9c01-8a3083b9a855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:16.156825 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595ca61-c3c1-498f-9c01-8a3083b9a855 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:16.158041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595ca61-c3c1-498f-9c01-8a3083b9a855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:16.158555 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595ca61-c3c1-498f-9c01-8a3083b9a855 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:16.165264 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595ca61-c3c1-498f-9c01-8a3083b9a855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:16.167550 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595ca61-c3c1-498f-9c01-8a3083b9a855 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:16.193250 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 817/1626] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:32:16 2022] POST /identity/v3/projects => generated 403 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:16.194892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d7539-f3f3-422b-9683-1107feec9b13 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:16.212268 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 810/1627] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:16.216071 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595ca61-c3c1-498f-9c01-8a3083b9a855 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:16.228380 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:16.241740 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595ca61-c3c1-498f-9c01-8a3083b9a855 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:16.295213 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d7539-f3f3-422b-9683-1107feec9b13 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:16.303420 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a3cc5-45ae-4c7b-8663-fa58260ed8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:16.304892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a3cc5-45ae-4c7b-8663-fa58260ed8b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:16.305233 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a3cc5-45ae-4c7b-8663-fa58260ed8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:16.305673 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a3cc5-45ae-4c7b-8663-fa58260ed8b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:16.307468 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a3cc5-45ae-4c7b-8663-fa58260ed8b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:16.309999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a3cc5-45ae-4c7b-8663-fa58260ed8b2 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:16.335526 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 818/1628] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:32:16 2022] POST /identity/v3/users => generated 308 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:16.340162 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a3cc5-45ae-4c7b-8663-fa58260ed8b2 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:16.364741 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a3cc5-45ae-4c7b-8663-fa58260ed8b2 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:16.383089 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1be36-8b33-468e-9319-53b201e60f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:16.384050 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1be36-8b33-468e-9319-53b201e60f46 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:16.384339 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1be36-8b33-468e-9319-53b201e60f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:16.384720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1be36-8b33-468e-9319-53b201e60f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:16.385679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1be36-8b33-468e-9319-53b201e60f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:16.387425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1be36-8b33-468e-9319-53b201e60f46 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:16.408484 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee037eb-dd57-4cf0-93fc-8b2701ba64c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:16.409650 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee037eb-dd57-4cf0-93fc-8b2701ba64c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:16.410104 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee037eb-dd57-4cf0-93fc-8b2701ba64c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:16.411323 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee037eb-dd57-4cf0-93fc-8b2701ba64c2 admin admin] PATH_INFO: `/v3/projects/eba2ac3a7b524bc0b0332fc3d218513a/users/ecdbf1557a07493986b4bc6e22ac5da1/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:16.418770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 819/1629] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:16.419927 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1be36-8b33-468e-9319-53b201e60f46 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:16.442329 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1be36-8b33-468e-9319-53b201e60f46 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:16.455708 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51b864-fcc7-4d4e-8664-f52191c3da94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:16.456967 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51b864-fcc7-4d4e-8664-f52191c3da94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:16.457420 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51b864-fcc7-4d4e-8664-f52191c3da94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:16.457917 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51b864-fcc7-4d4e-8664-f52191c3da94 admin admin] PATH_INFO: `/v3/projects/b651f2774dfb4dacb9ec151fcccb84ca/users/46a97735a3ec4771ad26abba16e91f4b/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:16.458092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee037eb-dd57-4cf0-93fc-8b2701ba64c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eba2ac3a7b524bc0b0332fc3d218513a, user_id=ecdbf1557a07493986b4bc6e22ac5da1, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:16.460777 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee037eb-dd57-4cf0-93fc-8b2701ba64c2 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:16.502754 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 811/1630] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:16 2022] PUT /identity/v3/projects/eba2ac3a7b524bc0b0332fc3d218513a/users/ecdbf1557a07493986b4bc6e22ac5da1/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:16.504550 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51b864-fcc7-4d4e-8664-f52191c3da94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b651f2774dfb4dacb9ec151fcccb84ca, user_id=46a97735a3ec4771ad26abba16e91f4b, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:16.507924 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51b864-fcc7-4d4e-8664-f52191c3da94 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:16.508496 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee037eb-dd57-4cf0-93fc-8b2701ba64c2 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:16.560124 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 820/1631] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:16 2022] PUT /identity/v3/projects/b651f2774dfb4dacb9ec151fcccb84ca/users/46a97735a3ec4771ad26abba16e91f4b/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:16.563135 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51b864-fcc7-4d4e-8664-f52191c3da94 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:16.738433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51b864-fcc7-4d4e-8664-f52191c3da94 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:16.744132 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc60aaa-9b0e-41aa-9d4f-24357ae81fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:16.745159 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc60aaa-9b0e-41aa-9d4f-24357ae81fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:16.745845 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc60aaa-9b0e-41aa-9d4f-24357ae81fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:16.746458 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc60aaa-9b0e-41aa-9d4f-24357ae81fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:16.747520 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc60aaa-9b0e-41aa-9d4f-24357ae81fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:16.750644 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc60aaa-9b0e-41aa-9d4f-24357ae81fb8 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:16.761826 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee037eb-dd57-4cf0-93fc-8b2701ba64c2 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:16.765377 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 821/1632] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:16.767071 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e611eb-b67f-443a-bb75-d7b15eba9c63 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:16.767607 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e611eb-b67f-443a-bb75-d7b15eba9c63 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:16.768196 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e611eb-b67f-443a-bb75-d7b15eba9c63 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:16.769947 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 822/1633] 10.222.0.44 () {54 vars in 912 bytes} [Tue Jul 19 15:32:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:16.775880 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e611eb-b67f-443a-bb75-d7b15eba9c63 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:16.777832 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228425d4-2e89-40f7-8ded-c1b7b08711c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:16.778544 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228425d4-2e89-40f7-8ded-c1b7b08711c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:16.780934 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228425d4-2e89-40f7-8ded-c1b7b08711c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:16.781234 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228425d4-2e89-40f7-8ded-c1b7b08711c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:16.783963 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228425d4-2e89-40f7-8ded-c1b7b08711c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:16.789606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228425d4-2e89-40f7-8ded-c1b7b08711c2 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:16.806972 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e611eb-b67f-443a-bb75-d7b15eba9c63 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:16.813908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed41b0-1750-4ba6-b1c3-4d2b19683e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:16.815314 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed41b0-1750-4ba6-b1c3-4d2b19683e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:16.815866 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed41b0-1750-4ba6-b1c3-4d2b19683e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:16.816220 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 812/1634] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:32:16.816877 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed41b0-1750-4ba6-b1c3-4d2b19683e12 admin admin] PATH_INFO: `/v3/projects/b651f2774dfb4dacb9ec151fcccb84ca/users/46a97735a3ec4771ad26abba16e91f4b/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:16.819453 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed41b0-1750-4ba6-b1c3-4d2b19683e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b651f2774dfb4dacb9ec151fcccb84ca, user_id=46a97735a3ec4771ad26abba16e91f4b, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:16.821259 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0262378-0e20-4886-83cd-46d98ac3f3c1 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:16.821565 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0262378-0e20-4886-83cd-46d98ac3f3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:16.821856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0262378-0e20-4886-83cd-46d98ac3f3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:16.823417 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed41b0-1750-4ba6-b1c3-4d2b19683e12 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:16.856046 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 823/1635] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:16 2022] PUT /identity/v3/projects/b651f2774dfb4dacb9ec151fcccb84ca/users/46a97735a3ec4771ad26abba16e91f4b/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:16.857397 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed41b0-1750-4ba6-b1c3-4d2b19683e12 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:16.877283 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-a0262378-0e20-4886-83cd-46d98ac3f3c1 None None] MFA Rules not processed for user `fef0511f56144ca9945b2dddfa2601a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:16.882773 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-a0262378-0e20-4886-83cd-46d98ac3f3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:16.957186 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:16.967030 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:16.978372 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed41b0-1750-4ba6-b1c3-4d2b19683e12 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:16.986618 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90bbb8c-afcd-43d0-8982-f83e04b55c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:16.988148 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bbb8c-afcd-43d0-8982-f83e04b55c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:16.988666 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bbb8c-afcd-43d0-8982-f83e04b55c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:16.989206 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bbb8c-afcd-43d0-8982-f83e04b55c0c admin admin] PATH_INFO: `/v3/projects/eba2ac3a7b524bc0b0332fc3d218513a/users/ecdbf1557a07493986b4bc6e22ac5da1/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:16.991576 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90bbb8c-afcd-43d0-8982-f83e04b55c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eba2ac3a7b524bc0b0332fc3d218513a, user_id=ecdbf1557a07493986b4bc6e22ac5da1, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:16.997454 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90bbb8c-afcd-43d0-8982-f83e04b55c0c admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:17.003299 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 813/1636] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jul 19 15:32:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:17.005799 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d8b99-943f-491f-8239-e73e4b0c755c None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:17.006731 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d8b99-943f-491f-8239-e73e4b0c755c None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:17.007068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d8b99-943f-491f-8239-e73e4b0c755c None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:17.009529 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 814/1637] 10.222.0.44 () {54 vars in 912 bytes} [Tue Jul 19 15:32:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:17.015753 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afb3cd-d058-48cd-91e4-6f3a768d5dfa None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:17.016050 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afb3cd-d058-48cd-91e4-6f3a768d5dfa None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:17.016335 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afb3cd-d058-48cd-91e4-6f3a768d5dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:17.030578 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 824/1638] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:16 2022] PUT /identity/v3/projects/eba2ac3a7b524bc0b0332fc3d218513a/users/ecdbf1557a07493986b4bc6e22ac5da1/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:17.031972 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90bbb8c-afcd-43d0-8982-f83e04b55c0c admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:17.061819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-31afb3cd-d058-48cd-91e4-6f3a768d5dfa None None] MFA Rules not processed for user `fef0511f56144ca9945b2dddfa2601a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:17.063682 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-31afb3cd-d058-48cd-91e4-6f3a768d5dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:17.201733 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90bbb8c-afcd-43d0-8982-f83e04b55c0c admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:17.212344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881eff0-1795-4829-aae0-3443eb340dcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:17.215094 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881eff0-1795-4829-aae0-3443eb340dcf service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:17.215094 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881eff0-1795-4829-aae0-3443eb340dcf service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:17.215094 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881eff0-1795-4829-aae0-3443eb340dcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:17.226926 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 815/1639] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jul 19 15:32:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:17.229511 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528652f-18c4-439a-97a6-bd5b5897f102 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:17.229929 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528652f-18c4-439a-97a6-bd5b5897f102 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:17.230816 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528652f-18c4-439a-97a6-bd5b5897f102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:17.251866 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881eff0-1795-4829-aae0-3443eb340dcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:17.340247 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881eff0-1795-4829-aae0-3443eb340dcf service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:17.340247 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 825/1640] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:17.340247 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881eff0-1795-4829-aae0-3443eb340dcf service cinder] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:17.342259 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-5528652f-18c4-439a-97a6-bd5b5897f102 None None] MFA Rules not processed for user `ecdbf1557a07493986b4bc6e22ac5da1`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:17.342259 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-5528652f-18c4-439a-97a6-bd5b5897f102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:17.348052 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881eff0-1795-4829-aae0-3443eb340dcf service cinder] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:17.377425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b8225-8f1c-49ff-8e1c-86426aeb4c3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:17.381466 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b8225-8f1c-49ff-8e1c-86426aeb4c3b service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:17.384569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b8225-8f1c-49ff-8e1c-86426aeb4c3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:17.385209 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b8225-8f1c-49ff-8e1c-86426aeb4c3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:17.438438 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b8225-8f1c-49ff-8e1c-86426aeb4c3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:17.442071 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b8225-8f1c-49ff-8e1c-86426aeb4c3b service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:17.489883 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 826/1641] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:17.546882 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 816/1642] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:17 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:17.591415 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b8225-8f1c-49ff-8e1c-86426aeb4c3b service cinder] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:17.596585 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528652f-18c4-439a-97a6-bd5b5897f102 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:17.616419 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528652f-18c4-439a-97a6-bd5b5897f102 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:17.622554 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4eab17-b893-4e08-8061-f2b9f1a84c87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:17.623604 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4eab17-b893-4e08-8061-f2b9f1a84c87 service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:17.623991 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4eab17-b893-4e08-8061-f2b9f1a84c87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:17.624406 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4eab17-b893-4e08-8061-f2b9f1a84c87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:17.662977 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4eab17-b893-4e08-8061-f2b9f1a84c87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:17.665263 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4eab17-b893-4e08-8061-f2b9f1a84c87 service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:17.690549 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 817/1643] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:17 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:32:17.702609 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b8225-8f1c-49ff-8e1c-86426aeb4c3b service cinder] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:17.725398 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d55a15-0755-4ebe-8b3a-8e5dc93ff3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:17.726493 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d55a15-0755-4ebe-8b3a-8e5dc93ff3d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:17.727956 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d55a15-0755-4ebe-8b3a-8e5dc93ff3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:17.729564 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d55a15-0755-4ebe-8b3a-8e5dc93ff3d6 admin admin] PATH_INFO: `/v3/users/2bb3854e6572455aa71046535bd5c282` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:17.733368 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d55a15-0755-4ebe-8b3a-8e5dc93ff3d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bb3854e6572455aa71046535bd5c282)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:17.734877 dv-cinder-849846-2-smb devstack@keystone.service[80304]: WARNING py.warnings [None req-01d55a15-0755-4ebe-8b3a-8e5dc93ff3d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:32:17.734877 dv-cinder-849846-2-smb devstack@keystone.service[80304]: warnings.warn(msg) Jul 19 15:32:17.734877 dv-cinder-849846-2-smb devstack@keystone.service[80304]: Jul 19 15:32:17.736207 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d55a15-0755-4ebe-8b3a-8e5dc93ff3d6 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:17.894294 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-01d55a15-0755-4ebe-8b3a-8e5dc93ff3d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bb3854e6572455aa71046535bd5c282'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:17.941254 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-01d55a15-0755-4ebe-8b3a-8e5dc93ff3d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bb3854e6572455aa71046535bd5c282'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:17.973989 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-01d55a15-0755-4ebe-8b3a-8e5dc93ff3d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bb3854e6572455aa71046535bd5c282'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:17.986687 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-01d55a15-0755-4ebe-8b3a-8e5dc93ff3d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bb3854e6572455aa71046535bd5c282'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:17.988700 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-01d55a15-0755-4ebe-8b3a-8e5dc93ff3d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bb3854e6572455aa71046535bd5c282'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:18.001372 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:18.029658 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4eab17-b893-4e08-8061-f2b9f1a84c87 service cinder] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:18.037810 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 827/1644] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:32:17 2022] DELETE /identity/v3/users/2bb3854e6572455aa71046535bd5c282 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:18.049727 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fa1ff-ff93-46c5-9e05-fca4310cc3c1 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:18.050282 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4eab17-b893-4e08-8061-f2b9f1a84c87 service cinder] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:18.052624 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fa1ff-ff93-46c5-9e05-fca4310cc3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:18.052958 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fa1ff-ff93-46c5-9e05-fca4310cc3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:18.093902 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-6b5fa1ff-ff93-46c5-9e05-fca4310cc3c1 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:18.095382 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-6b5fa1ff-ff93-46c5-9e05-fca4310cc3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:18.261429 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:18.269338 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 828/1645] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:18.294967 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b0ceb-52e4-42e9-80c2-989ef5a58bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:18.296744 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b0ceb-52e4-42e9-80c2-989ef5a58bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:18.297149 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b0ceb-52e4-42e9-80c2-989ef5a58bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:18.297729 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b0ceb-52e4-42e9-80c2-989ef5a58bf3 admin admin] PATH_INFO: `/v3/users/7f20b8f6cc244c3ea24400ae77e36fe8` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:18.300487 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b0ceb-52e4-42e9-80c2-989ef5a58bf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f20b8f6cc244c3ea24400ae77e36fe8)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:18.303248 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b0ceb-52e4-42e9-80c2-989ef5a58bf3 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:18.320954 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fa1ff-ff93-46c5-9e05-fca4310cc3c1 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:18.322528 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-6b5fa1ff-ff93-46c5-9e05-fca4310cc3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:18.503007 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0c9b0ceb-52e4-42e9-80c2-989ef5a58bf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f20b8f6cc244c3ea24400ae77e36fe8'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:18.570085 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fa1ff-ff93-46c5-9e05-fca4310cc3c1 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:18.585379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0c9b0ceb-52e4-42e9-80c2-989ef5a58bf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f20b8f6cc244c3ea24400ae77e36fe8'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:18.595992 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0c9b0ceb-52e4-42e9-80c2-989ef5a58bf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f20b8f6cc244c3ea24400ae77e36fe8'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:18.596717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c77a1f-c75c-4761-a3a9-d22cd056c2dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:18.596849 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0c9b0ceb-52e4-42e9-80c2-989ef5a58bf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f20b8f6cc244c3ea24400ae77e36fe8'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:18.597450 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0c9b0ceb-52e4-42e9-80c2-989ef5a58bf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f20b8f6cc244c3ea24400ae77e36fe8'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:18.601505 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c77a1f-c75c-4761-a3a9-d22cd056c2dc service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:18.601808 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c77a1f-c75c-4761-a3a9-d22cd056c2dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:18.602093 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c77a1f-c75c-4761-a3a9-d22cd056c2dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:18.618837 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-86c77a1f-c75c-4761-a3a9-d22cd056c2dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:18.645818 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 818/1646] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:32:18 2022] DELETE /identity/v3/users/7f20b8f6cc244c3ea24400ae77e36fe8 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:18.654314 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c77a1f-c75c-4761-a3a9-d22cd056c2dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:18.657641 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c77a1f-c75c-4761-a3a9-d22cd056c2dc service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:18.679447 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 829/1647] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:32:18.681084 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351d730-3815-4c32-9d87-8c7730d90558 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:18.683697 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351d730-3815-4c32-9d87-8c7730d90558 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:18.684025 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351d730-3815-4c32-9d87-8c7730d90558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:18.687340 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a2498-f47a-441f-a7aa-0409c2225ae0 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:18.687640 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a2498-f47a-441f-a7aa-0409c2225ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:18.687924 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a2498-f47a-441f-a7aa-0409c2225ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:18.736436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-d351d730-3815-4c32-9d87-8c7730d90558 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:18.737701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-d351d730-3815-4c32-9d87-8c7730d90558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:18.829538 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-813a2498-f47a-441f-a7aa-0409c2225ae0 None None] MFA Rules not processed for user `46a97735a3ec4771ad26abba16e91f4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:18.850764 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-813a2498-f47a-441f-a7aa-0409c2225ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:18.921526 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 830/1648] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:18.981635 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351d730-3815-4c32-9d87-8c7730d90558 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:18.983431 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-d351d730-3815-4c32-9d87-8c7730d90558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:19.083734 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:19.124705 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351d730-3815-4c32-9d87-8c7730d90558 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:19.130215 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93cf2e-352b-4953-96b9-65357585279d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:19.131332 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93cf2e-352b-4953-96b9-65357585279d service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:19.131836 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93cf2e-352b-4953-96b9-65357585279d service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:19.132435 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93cf2e-352b-4953-96b9-65357585279d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:19.154916 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93cf2e-352b-4953-96b9-65357585279d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:19.159093 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93cf2e-352b-4953-96b9-65357585279d service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:19.163735 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 819/1649] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:18 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 517 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:19.187193 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 831/1650] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:32:22.118980 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a2498-f47a-441f-a7aa-0409c2225ae0 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:22.123811 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-813a2498-f47a-441f-a7aa-0409c2225ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:22.173549 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a2498-f47a-441f-a7aa-0409c2225ae0 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:22.202383 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbe693-49f3-44df-a390-936e0bc59641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:22.203307 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbe693-49f3-44df-a390-936e0bc59641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:22.203606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbe693-49f3-44df-a390-936e0bc59641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:22.203892 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbe693-49f3-44df-a390-936e0bc59641 admin admin] PATH_INFO: `/v3/projects/d44026158fd9491e914359db8dfab34a` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:22.207813 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bbe693-49f3-44df-a390-936e0bc59641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d44026158fd9491e914359db8dfab34a)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:22.209571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: WARNING py.warnings [None req-23bbe693-49f3-44df-a390-936e0bc59641 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:32:22.209571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: warnings.warn(msg) Jul 19 15:32:22.209571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: Jul 19 15:32:22.214091 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bbe693-49f3-44df-a390-936e0bc59641 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:22.357000 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93cf2e-352b-4953-96b9-65357585279d service neutron] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:22.359255 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-8a93cf2e-352b-4953-96b9-65357585279d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:22.370355 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:22.374963 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-23bbe693-49f3-44df-a390-936e0bc59641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd44026158fd9491e914359db8dfab34a', 'request_id': 'req-23bbe693-49f3-44df-a390-936e0bc59641'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:22.386682 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93cf2e-352b-4953-96b9-65357585279d service neutron] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:22.429983 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-23bbe693-49f3-44df-a390-936e0bc59641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd44026158fd9491e914359db8dfab34a', 'request_id': 'req-23bbe693-49f3-44df-a390-936e0bc59641'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:22.451582 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-23bbe693-49f3-44df-a390-936e0bc59641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd44026158fd9491e914359db8dfab34a', 'request_id': 'req-23bbe693-49f3-44df-a390-936e0bc59641'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:22.495004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-23bbe693-49f3-44df-a390-936e0bc59641 admin admin] The token cache is being invalidate because project d44026158fd9491e914359db8dfab34a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:32:22.495419 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-23bbe693-49f3-44df-a390-936e0bc59641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:22.497407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-23bbe693-49f3-44df-a390-936e0bc59641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:22.502030 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 820/1651] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:32:22 2022] DELETE /identity/v3/projects/d44026158fd9491e914359db8dfab34a => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:22.507701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd77e88-ede5-4c58-a687-8eaa376d8fdf None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:22.507996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd77e88-ede5-4c58-a687-8eaa376d8fdf None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:22.508278 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd77e88-ede5-4c58-a687-8eaa376d8fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:22.586796 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-9dd77e88-ede5-4c58-a687-8eaa376d8fdf None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:22.590204 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-9dd77e88-ede5-4c58-a687-8eaa376d8fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:22.601518 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42944fe7-197c-42b0-954a-a2ee9ba959a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:22.604182 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42944fe7-197c-42b0-954a-a2ee9ba959a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:22.604582 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42944fe7-197c-42b0-954a-a2ee9ba959a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:22.604582 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42944fe7-197c-42b0-954a-a2ee9ba959a4 admin admin] PATH_INFO: `/v3/projects/f321ce34787d43ebb12922bdc08f92f6` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:22.612196 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42944fe7-197c-42b0-954a-a2ee9ba959a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f321ce34787d43ebb12922bdc08f92f6)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:22.614756 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42944fe7-197c-42b0-954a-a2ee9ba959a4 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:22.626582 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 821/1652] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:22.628151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7f994-621d-4980-bf1b-2f9d9b03eb66 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:22.628449 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7f994-621d-4980-bf1b-2f9d9b03eb66 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:22.630782 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7f994-621d-4980-bf1b-2f9d9b03eb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:22.693496 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-8ff7f994-621d-4980-bf1b-2f9d9b03eb66 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:22.694754 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-8ff7f994-621d-4980-bf1b-2f9d9b03eb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:22.727749 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 822/1653] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:22.741339 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7f994-621d-4980-bf1b-2f9d9b03eb66 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:22.777228 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7f994-621d-4980-bf1b-2f9d9b03eb66 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:22.779065 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-42944fe7-197c-42b0-954a-a2ee9ba959a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f321ce34787d43ebb12922bdc08f92f6', 'request_id': 'req-42944fe7-197c-42b0-954a-a2ee9ba959a4'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:22.811705 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-42944fe7-197c-42b0-954a-a2ee9ba959a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f321ce34787d43ebb12922bdc08f92f6', 'request_id': 'req-42944fe7-197c-42b0-954a-a2ee9ba959a4'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:22.833340 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-42944fe7-197c-42b0-954a-a2ee9ba959a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f321ce34787d43ebb12922bdc08f92f6', 'request_id': 'req-42944fe7-197c-42b0-954a-a2ee9ba959a4'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:22.877489 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-42944fe7-197c-42b0-954a-a2ee9ba959a4 admin admin] The token cache is being invalidate because project f321ce34787d43ebb12922bdc08f92f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:32:22.877489 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-42944fe7-197c-42b0-954a-a2ee9ba959a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:22.878258 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-42944fe7-197c-42b0-954a-a2ee9ba959a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:22.887269 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 832/1654] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:32:22 2022] DELETE /identity/v3/projects/f321ce34787d43ebb12922bdc08f92f6 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:32:22.889438 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42944fe7-197c-42b0-954a-a2ee9ba959a4 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:22.893905 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-42944fe7-197c-42b0-954a-a2ee9ba959a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:23.063921 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afbdf2-b43f-4d4d-80cd-a545720abea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:23.066275 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afbdf2-b43f-4d4d-80cd-a545720abea0 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:23.068821 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afbdf2-b43f-4d4d-80cd-a545720abea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:23.069857 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afbdf2-b43f-4d4d-80cd-a545720abea0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:23.071534 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35afbdf2-b43f-4d4d-80cd-a545720abea0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:23.072875 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42944fe7-197c-42b0-954a-a2ee9ba959a4 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:23.074229 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35afbdf2-b43f-4d4d-80cd-a545720abea0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:23.078864 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35afbdf2-b43f-4d4d-80cd-a545720abea0 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:23.092190 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33ca56-5eab-43a6-a333-e57de689aa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:23.093308 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33ca56-5eab-43a6-a333-e57de689aa01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:23.093822 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33ca56-5eab-43a6-a333-e57de689aa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:23.094430 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33ca56-5eab-43a6-a333-e57de689aa01 admin admin] PATH_INFO: `/v3/users/ecdbf1557a07493986b4bc6e22ac5da1` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:23.097845 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33ca56-5eab-43a6-a333-e57de689aa01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecdbf1557a07493986b4bc6e22ac5da1)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:23.100725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33ca56-5eab-43a6-a333-e57de689aa01 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:23.118127 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 823/1655] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:23.119258 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afbdf2-b43f-4d4d-80cd-a545720abea0 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:23.122647 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-35afbdf2-b43f-4d4d-80cd-a545720abea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:23.140313 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:23.152651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afbdf2-b43f-4d4d-80cd-a545720abea0 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:23.163140 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf903270-8183-45ea-b64e-056f58acffc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:23.163941 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf903270-8183-45ea-b64e-056f58acffc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:23.164434 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf903270-8183-45ea-b64e-056f58acffc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:23.165679 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf903270-8183-45ea-b64e-056f58acffc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:23.167250 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf903270-8183-45ea-b64e-056f58acffc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:23.176114 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf903270-8183-45ea-b64e-056f58acffc6 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:23.208640 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-bc33ca56-5eab-43a6-a333-e57de689aa01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecdbf1557a07493986b4bc6e22ac5da1'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:23.236955 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-bc33ca56-5eab-43a6-a333-e57de689aa01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecdbf1557a07493986b4bc6e22ac5da1'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:23.252549 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-bc33ca56-5eab-43a6-a333-e57de689aa01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecdbf1557a07493986b4bc6e22ac5da1'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:23.252898 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 824/1656] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:32:23 2022] POST /identity/v3/projects => generated 367 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:23.253359 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-bc33ca56-5eab-43a6-a333-e57de689aa01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecdbf1557a07493986b4bc6e22ac5da1'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:23.254040 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-bc33ca56-5eab-43a6-a333-e57de689aa01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecdbf1557a07493986b4bc6e22ac5da1'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:23.255466 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf903270-8183-45ea-b64e-056f58acffc6 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:23.264710 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-cf903270-8183-45ea-b64e-056f58acffc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:23.280615 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 833/1657] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:32:22 2022] DELETE /identity/v3/users/ecdbf1557a07493986b4bc6e22ac5da1 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:23.397083 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd84484-4489-4a67-8f40-16701a262fcb None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:23.397677 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd84484-4489-4a67-8f40-16701a262fcb None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:23.397677 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd84484-4489-4a67-8f40-16701a262fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:23.481252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-afd84484-4489-4a67-8f40-16701a262fcb None None] MFA Rules not processed for user `7143c461c94444558d6ac9f5cddfb264`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:23.482811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-afd84484-4489-4a67-8f40-16701a262fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:23.493232 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf903270-8183-45ea-b64e-056f58acffc6 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:23.610363 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:23.634991 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaaeda7-ca7a-4882-9909-edd1bdfa8bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:23.635917 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaaeda7-ca7a-4882-9909-edd1bdfa8bdb admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:23.636277 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaaeda7-ca7a-4882-9909-edd1bdfa8bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:23.636627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaaeda7-ca7a-4882-9909-edd1bdfa8bdb admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:23.637549 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaaeda7-ca7a-4882-9909-edd1bdfa8bdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:23.640163 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaaeda7-ca7a-4882-9909-edd1bdfa8bdb admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:23.641058 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 834/1658] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:23.662185 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd84484-4489-4a67-8f40-16701a262fcb None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:23.663897 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-afd84484-4489-4a67-8f40-16701a262fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:23.675247 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 825/1659] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:32:23 2022] POST /identity/v3/users => generated 284 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:23.676982 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaaeda7-ca7a-4882-9909-edd1bdfa8bdb admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:23.719764 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaaeda7-ca7a-4882-9909-edd1bdfa8bdb admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:23.730733 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89bccf-58db-4060-a5c5-c3c6e639abad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:23.734272 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89bccf-58db-4060-a5c5-c3c6e639abad admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:23.734912 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89bccf-58db-4060-a5c5-c3c6e639abad admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:23.735263 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89bccf-58db-4060-a5c5-c3c6e639abad admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:23.736085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c89bccf-58db-4060-a5c5-c3c6e639abad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:23.742612 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c89bccf-58db-4060-a5c5-c3c6e639abad admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:23.772858 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 826/1660] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:23.776753 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89bccf-58db-4060-a5c5-c3c6e639abad admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:23.817370 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89bccf-58db-4060-a5c5-c3c6e639abad admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:23.833442 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe23fb1-c2f1-44e7-b0f3-ed012759acad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:23.834135 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe23fb1-c2f1-44e7-b0f3-ed012759acad admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:23.834420 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe23fb1-c2f1-44e7-b0f3-ed012759acad admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:23.838866 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe23fb1-c2f1-44e7-b0f3-ed012759acad admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:23.839791 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe23fb1-c2f1-44e7-b0f3-ed012759acad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:23.841886 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe23fb1-c2f1-44e7-b0f3-ed012759acad admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:23.877062 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 827/1661] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:32:23.881110 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe23fb1-c2f1-44e7-b0f3-ed012759acad admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:23.885099 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd84484-4489-4a67-8f40-16701a262fcb None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:23.897177 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88f1e2-d2a0-4a00-9701-3be9cdbdc4b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:23.897879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88f1e2-d2a0-4a00-9701-3be9cdbdc4b6 service nova] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:23.898178 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88f1e2-d2a0-4a00-9701-3be9cdbdc4b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:23.898715 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88f1e2-d2a0-4a00-9701-3be9cdbdc4b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:23.905753 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe23fb1-c2f1-44e7-b0f3-ed012759acad admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:23.911550 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5d07a-2395-4906-84e2-26a63f6946e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:23.912860 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5d07a-2395-4906-84e2-26a63f6946e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:23.913179 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5d07a-2395-4906-84e2-26a63f6946e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:23.913468 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5d07a-2395-4906-84e2-26a63f6946e1 admin admin] PATH_INFO: `/v3/projects/9f7d24f4fb764a14bcd29d233010bb1e/users/f5166eb567c24c75b6e5a27fbeab892d/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:23.927999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88f1e2-d2a0-4a00-9701-3be9cdbdc4b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:23.929785 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88f1e2-d2a0-4a00-9701-3be9cdbdc4b6 service nova] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:23.950700 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 835/1662] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:23.956458 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5d07a-2395-4906-84e2-26a63f6946e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f7d24f4fb764a14bcd29d233010bb1e, user_id=f5166eb567c24c75b6e5a27fbeab892d, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:23.963661 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5d07a-2395-4906-84e2-26a63f6946e1 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:24.017294 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 828/1663] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:23 2022] PUT /identity/v3/projects/9f7d24f4fb764a14bcd29d233010bb1e/users/f5166eb567c24c75b6e5a27fbeab892d/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:32:24.028461 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05a1ce-4869-4737-b386-a6b81f8c7d1f None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:24.028758 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05a1ce-4869-4737-b386-a6b81f8c7d1f None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:24.029203 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05a1ce-4869-4737-b386-a6b81f8c7d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:24.058286 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:24.110471 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb59018-4c24-424f-aa89-73189a8f6788 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:24.111516 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb59018-4c24-424f-aa89-73189a8f6788 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:24.111855 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb59018-4c24-424f-aa89-73189a8f6788 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:24.112120 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-0e05a1ce-4869-4737-b386-a6b81f8c7d1f None None] MFA Rules not processed for user `f5166eb567c24c75b6e5a27fbeab892d`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:24.115077 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 829/1664] 10.222.0.44 () {54 vars in 921 bytes} [Tue Jul 19 15:32:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:24.115317 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-0e05a1ce-4869-4737-b386-a6b81f8c7d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:24.129910 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb59018-4c24-424f-aa89-73189a8f6788 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:24.134513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-afb59018-4c24-424f-aa89-73189a8f6788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:24.321982 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb59018-4c24-424f-aa89-73189a8f6788 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:24.327275 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ebb97e-2d9f-4b3b-89d2-06df14f58add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:24.328463 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebb97e-2d9f-4b3b-89d2-06df14f58add admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:24.328961 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebb97e-2d9f-4b3b-89d2-06df14f58add admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:24.329419 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebb97e-2d9f-4b3b-89d2-06df14f58add admin admin] PATH_INFO: `/v3/projects/eba2ac3a7b524bc0b0332fc3d218513a` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:24.330984 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ebb97e-2d9f-4b3b-89d2-06df14f58add admin admin] RBAC: Authorizing `identity:delete_project(project_id=eba2ac3a7b524bc0b0332fc3d218513a)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:24.333696 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ebb97e-2d9f-4b3b-89d2-06df14f58add admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:24.357096 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 836/1665] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:24.358841 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fce99b-09ed-4b33-a824-7a1d6dcad01c None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:24.361321 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fce99b-09ed-4b33-a824-7a1d6dcad01c None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:24.361640 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fce99b-09ed-4b33-a824-7a1d6dcad01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:24.404439 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-84fce99b-09ed-4b33-a824-7a1d6dcad01c None None] MFA Rules not processed for user `2a27fe78683743c397fe7929e9053c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:24.409137 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-84fce99b-09ed-4b33-a824-7a1d6dcad01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:24.496951 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-e6ebb97e-2d9f-4b3b-89d2-06df14f58add admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eba2ac3a7b524bc0b0332fc3d218513a', 'request_id': 'req-e6ebb97e-2d9f-4b3b-89d2-06df14f58add'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:24.515963 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-e6ebb97e-2d9f-4b3b-89d2-06df14f58add admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eba2ac3a7b524bc0b0332fc3d218513a', 'request_id': 'req-e6ebb97e-2d9f-4b3b-89d2-06df14f58add'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:24.531373 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-e6ebb97e-2d9f-4b3b-89d2-06df14f58add admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eba2ac3a7b524bc0b0332fc3d218513a', 'request_id': 'req-e6ebb97e-2d9f-4b3b-89d2-06df14f58add'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:24.558351 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-e6ebb97e-2d9f-4b3b-89d2-06df14f58add admin admin] The token cache is being invalidate because project eba2ac3a7b524bc0b0332fc3d218513a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:32:24.558351 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-e6ebb97e-2d9f-4b3b-89d2-06df14f58add admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:24.560495 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-e6ebb97e-2d9f-4b3b-89d2-06df14f58add admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:24.569737 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 830/1666] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:32:24 2022] DELETE /identity/v3/projects/eba2ac3a7b524bc0b0332fc3d218513a => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:24.570862 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ebb97e-2d9f-4b3b-89d2-06df14f58add admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:24.572782 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-e6ebb97e-2d9f-4b3b-89d2-06df14f58add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:24.602525 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:24.668613 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 837/1667] 10.222.0.44 () {58 vars in 1018 bytes} [Tue Jul 19 15:32:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:24.669502 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fce99b-09ed-4b33-a824-7a1d6dcad01c None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:24.671333 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-84fce99b-09ed-4b33-a824-7a1d6dcad01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:24.694743 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ebb97e-2d9f-4b3b-89d2-06df14f58add admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:24.700145 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829441c8-edd6-42df-8253-84f617e5578a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:24.700846 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829441c8-edd6-42df-8253-84f617e5578a admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:24.701130 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829441c8-edd6-42df-8253-84f617e5578a admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:24.701417 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829441c8-edd6-42df-8253-84f617e5578a admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:24.702135 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829441c8-edd6-42df-8253-84f617e5578a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:24.704173 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829441c8-edd6-42df-8253-84f617e5578a admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:24.733825 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fce99b-09ed-4b33-a824-7a1d6dcad01c None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:24.743908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f304bc-db88-4766-bbd9-fd43ffe5c8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:24.746031 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f304bc-db88-4766-bbd9-fd43ffe5c8d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:24.746324 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f304bc-db88-4766-bbd9-fd43ffe5c8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:24.746614 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f304bc-db88-4766-bbd9-fd43ffe5c8d7 admin admin] PATH_INFO: `/v3/users/20537318b9ef48b1b1d39e6eeddaec58` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:24.752778 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f304bc-db88-4766-bbd9-fd43ffe5c8d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20537318b9ef48b1b1d39e6eeddaec58)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:24.760751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f304bc-db88-4766-bbd9-fd43ffe5c8d7 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:24.779921 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 831/1668] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:32:24 2022] POST /identity/v3/projects => generated 367 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:24.781144 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf1165-5a0b-4467-92f7-e0c12feba2dd None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:24.781491 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf1165-5a0b-4467-92f7-e0c12feba2dd None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:24.781705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf1165-5a0b-4467-92f7-e0c12feba2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:24.822747 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-c0cf1165-5a0b-4467-92f7-e0c12feba2dd None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:24.828544 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-c0cf1165-5a0b-4467-92f7-e0c12feba2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:24.903053 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-55f304bc-db88-4766-bbd9-fd43ffe5c8d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20537318b9ef48b1b1d39e6eeddaec58'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:24.935336 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-55f304bc-db88-4766-bbd9-fd43ffe5c8d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20537318b9ef48b1b1d39e6eeddaec58'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:24.954237 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-55f304bc-db88-4766-bbd9-fd43ffe5c8d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20537318b9ef48b1b1d39e6eeddaec58'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:24.955372 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-55f304bc-db88-4766-bbd9-fd43ffe5c8d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20537318b9ef48b1b1d39e6eeddaec58'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:24.955372 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-55f304bc-db88-4766-bbd9-fd43ffe5c8d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20537318b9ef48b1b1d39e6eeddaec58'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:24.981492 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 838/1669] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:32:24 2022] DELETE /identity/v3/users/20537318b9ef48b1b1d39e6eeddaec58 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:24.982842 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f304bc-db88-4766-bbd9-fd43ffe5c8d7 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:24.984836 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-55f304bc-db88-4766-bbd9-fd43ffe5c8d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:25.000652 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:25.067707 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 832/1670] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:25.067980 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864bb87-a218-4932-b8d8-12d50bea87ad None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:25.069204 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864bb87-a218-4932-b8d8-12d50bea87ad None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:25.069596 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864bb87-a218-4932-b8d8-12d50bea87ad None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:25.078755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 833/1671] 10.222.0.44 () {54 vars in 961 bytes} [Tue Jul 19 15:32:25 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:25.083983 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba127b4-c3b0-4a2b-a332-2f9f85f8ccaa None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:25.084303 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba127b4-c3b0-4a2b-a332-2f9f85f8ccaa None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:25.084588 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba127b4-c3b0-4a2b-a332-2f9f85f8ccaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:25.153022 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-7ba127b4-c3b0-4a2b-a332-2f9f85f8ccaa None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:25.157845 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-7ba127b4-c3b0-4a2b-a332-2f9f85f8ccaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:25.185253 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f304bc-db88-4766-bbd9-fd43ffe5c8d7 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:25.200000 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e617d-2bf2-4746-8201-514d063fada2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:25.200706 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e617d-2bf2-4746-8201-514d063fada2 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:25.200999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e617d-2bf2-4746-8201-514d063fada2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:25.201280 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e617d-2bf2-4746-8201-514d063fada2 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:25.201999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e617d-2bf2-4746-8201-514d063fada2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:25.204021 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e617d-2bf2-4746-8201-514d063fada2 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:25.238429 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 839/1672] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:32:24 2022] POST /identity/v3/users => generated 290 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:25.239792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e300a1-8a39-4628-99b2-760167940319 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:25.240088 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e300a1-8a39-4628-99b2-760167940319 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:25.240373 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e300a1-8a39-4628-99b2-760167940319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:25.280752 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 834/1673] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:25.282244 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd275b4c-1c2b-49c3-9d6b-23b756fb17dc None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:25.282540 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd275b4c-1c2b-49c3-9d6b-23b756fb17dc None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:25.282852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd275b4c-1c2b-49c3-9d6b-23b756fb17dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:25.296401 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-76e300a1-8a39-4628-99b2-760167940319 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:25.297660 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-76e300a1-8a39-4628-99b2-760167940319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:25.316434 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-fd275b4c-1c2b-49c3-9d6b-23b756fb17dc None None] MFA Rules not processed for user `2a27fe78683743c397fe7929e9053c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:25.318725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 840/1674] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:25.319424 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-fd275b4c-1c2b-49c3-9d6b-23b756fb17dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:25.322910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e300a1-8a39-4628-99b2-760167940319 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:25.353009 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e300a1-8a39-4628-99b2-760167940319 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:25.368081 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da7764-2739-4014-9b05-599365a6d883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:25.368803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da7764-2739-4014-9b05-599365a6d883 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:25.369093 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da7764-2739-4014-9b05-599365a6d883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:25.369376 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da7764-2739-4014-9b05-599365a6d883 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:25.370141 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da7764-2739-4014-9b05-599365a6d883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:25.371828 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da7764-2739-4014-9b05-599365a6d883 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:25.388562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 841/1675] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:25.389445 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da7764-2739-4014-9b05-599365a6d883 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:25.417461 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da7764-2739-4014-9b05-599365a6d883 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:25.420715 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:25.432893 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08e377-3f17-434a-af84-e67642321488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:25.433593 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08e377-3f17-434a-af84-e67642321488 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:25.433887 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08e377-3f17-434a-af84-e67642321488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:25.434168 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08e377-3f17-434a-af84-e67642321488 admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:25.434923 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08e377-3f17-434a-af84-e67642321488 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:25.435299 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08e377-3f17-434a-af84-e67642321488 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:25.436907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08e377-3f17-434a-af84-e67642321488 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:25.465528 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 842/1676] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:25.466488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08e377-3f17-434a-af84-e67642321488 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:25.489610 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08e377-3f17-434a-af84-e67642321488 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:25.493056 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 835/1677] 10.222.0.44 () {58 vars in 1058 bytes} [Tue Jul 19 15:32:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:25.494296 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd275b4c-1c2b-49c3-9d6b-23b756fb17dc None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:25.498645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-fd275b4c-1c2b-49c3-9d6b-23b756fb17dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:25.508156 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be6628-4379-404c-a970-a6fb1ed05f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:25.509078 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be6628-4379-404c-a970-a6fb1ed05f0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:25.509367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be6628-4379-404c-a970-a6fb1ed05f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:25.509655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be6628-4379-404c-a970-a6fb1ed05f0f admin admin] PATH_INFO: `/v3/projects/d7112d71cc25441eaa2ef90f2e132bf4/users/bcb9bada33f149f1a4408a507b532f1d/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:25.544100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be6628-4379-404c-a970-a6fb1ed05f0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7112d71cc25441eaa2ef90f2e132bf4, user_id=bcb9bada33f149f1a4408a507b532f1d, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:25.548272 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be6628-4379-404c-a970-a6fb1ed05f0f admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:25.577730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 843/1678] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:25 2022] PUT /identity/v3/projects/d7112d71cc25441eaa2ef90f2e132bf4/users/bcb9bada33f149f1a4408a507b532f1d/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:25.578576 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be6628-4379-404c-a970-a6fb1ed05f0f admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:25.628412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd275b4c-1c2b-49c3-9d6b-23b756fb17dc None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:25.699963 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd8ebe-c357-463b-83bf-bf2e44fc4391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:25.700686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd8ebe-c357-463b-83bf-bf2e44fc4391 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:25.701053 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd8ebe-c357-463b-83bf-bf2e44fc4391 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:25.701409 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd8ebe-c357-463b-83bf-bf2e44fc4391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:25.704744 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be6628-4379-404c-a970-a6fb1ed05f0f admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:25.710045 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57ad2c-6ff8-4d1d-b12f-8e5534e2de29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:25.710736 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57ad2c-6ff8-4d1d-b12f-8e5534e2de29 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:25.711026 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57ad2c-6ff8-4d1d-b12f-8e5534e2de29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:25.711449 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57ad2c-6ff8-4d1d-b12f-8e5534e2de29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:25.712182 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57ad2c-6ff8-4d1d-b12f-8e5534e2de29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:25.712770 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd8ebe-c357-463b-83bf-bf2e44fc4391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:25.714264 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57ad2c-6ff8-4d1d-b12f-8e5534e2de29 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:25.714413 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd8ebe-c357-463b-83bf-bf2e44fc4391 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:25.726698 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 836/1679] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:25.727850 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd8ebe-c357-463b-83bf-bf2e44fc4391 service neutron] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:25.751995 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 844/1680] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:32:25 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:25.751995 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57ad2c-6ff8-4d1d-b12f-8e5534e2de29 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:25.792817 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:25.848786 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57ad2c-6ff8-4d1d-b12f-8e5534e2de29 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:25.858893 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4c919-fb47-4054-9ae5-22e0c02b7e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:25.859770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4c919-fb47-4054-9ae5-22e0c02b7e82 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:25.860064 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4c919-fb47-4054-9ae5-22e0c02b7e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:25.860353 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4c919-fb47-4054-9ae5-22e0c02b7e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:25.861163 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4c919-fb47-4054-9ae5-22e0c02b7e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:25.862875 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4c919-fb47-4054-9ae5-22e0c02b7e82 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:25.888797 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 845/1681] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:25.889496 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4c919-fb47-4054-9ae5-22e0c02b7e82 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:25.902784 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd8ebe-c357-463b-83bf-bf2e44fc4391 service neutron] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:25.914292 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4c919-fb47-4054-9ae5-22e0c02b7e82 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:25.933388 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f3f4c-a69e-420c-8158-53a9d8833da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:25.934645 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f3f4c-a69e-420c-8158-53a9d8833da8 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:25.934645 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f3f4c-a69e-420c-8158-53a9d8833da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:25.934872 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f3f4c-a69e-420c-8158-53a9d8833da8 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:25.935437 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f3f4c-a69e-420c-8158-53a9d8833da8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:25.937458 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f3f4c-a69e-420c-8158-53a9d8833da8 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:25.984563 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 846/1682] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:32:25 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:25.985484 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f3f4c-a69e-420c-8158-53a9d8833da8 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:25.989879 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:26.005822 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f3f4c-a69e-420c-8158-53a9d8833da8 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:26.016265 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbba921-82f4-4c75-b8cc-ab74f7a4726e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:26.024364 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbba921-82f4-4c75-b8cc-ab74f7a4726e admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:26.024995 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbba921-82f4-4c75-b8cc-ab74f7a4726e admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:26.025147 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbba921-82f4-4c75-b8cc-ab74f7a4726e admin admin] PATH_INFO: `/v3/projects/d7112d71cc25441eaa2ef90f2e132bf4/users/bcb9bada33f149f1a4408a507b532f1d/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:26.037339 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbba921-82f4-4c75-b8cc-ab74f7a4726e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7112d71cc25441eaa2ef90f2e132bf4, user_id=bcb9bada33f149f1a4408a507b532f1d, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:26.046168 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbba921-82f4-4c75-b8cc-ab74f7a4726e admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:26.048816 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0605d3-3690-4f81-9868-2a0160881022 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a27fe78683743c397fe7929e9053c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:26.049425 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0605d3-3690-4f81-9868-2a0160881022 service placement] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:26.049883 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0605d3-3690-4f81-9868-2a0160881022 service placement] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:26.050514 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0605d3-3690-4f81-9868-2a0160881022 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:26.057323 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-af0605d3-3690-4f81-9868-2a0160881022 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:26.078756 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 847/1683] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:25 2022] PUT /identity/v3/projects/d7112d71cc25441eaa2ef90f2e132bf4/users/bcb9bada33f149f1a4408a507b532f1d/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:26.085237 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0605d3-3690-4f81-9868-2a0160881022 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:26.089938 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0605d3-3690-4f81-9868-2a0160881022 service placement] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:26.110294 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbba921-82f4-4c75-b8cc-ab74f7a4726e admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:26.117416 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 837/1684] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:26.118520 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8640b-212e-4fb8-8d73-e1702b8fd708 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:26.118879 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8640b-212e-4fb8-8d73-e1702b8fd708 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:26.119237 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8640b-212e-4fb8-8d73-e1702b8fd708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:26.156750 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-f0c8640b-212e-4fb8-8d73-e1702b8fd708 None None] MFA Rules not processed for user `bcb9bada33f149f1a4408a507b532f1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:26.158068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-f0c8640b-212e-4fb8-8d73-e1702b8fd708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:26.278140 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbba921-82f4-4c75-b8cc-ab74f7a4726e admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:26.289418 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c844660-a23c-4e2e-b4e6-5714a2063c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:26.290459 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c844660-a23c-4e2e-b4e6-5714a2063c1d admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:26.291014 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c844660-a23c-4e2e-b4e6-5714a2063c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:26.291500 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c844660-a23c-4e2e-b4e6-5714a2063c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:26.293848 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c844660-a23c-4e2e-b4e6-5714a2063c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:26.296729 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c844660-a23c-4e2e-b4e6-5714a2063c1d admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:26.318588 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 848/1685] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:26.320431 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c844660-a23c-4e2e-b4e6-5714a2063c1d admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:26.342072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c844660-a23c-4e2e-b4e6-5714a2063c1d admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:26.361989 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5fd1a-4697-4bc8-ba2f-82d877966279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:26.363098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5fd1a-4697-4bc8-ba2f-82d877966279 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:26.363611 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5fd1a-4697-4bc8-ba2f-82d877966279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:26.364044 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5fd1a-4697-4bc8-ba2f-82d877966279 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:26.365852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5fd1a-4697-4bc8-ba2f-82d877966279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:26.369430 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5fd1a-4697-4bc8-ba2f-82d877966279 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:26.374957 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 838/1686] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:26 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:26.393754 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8640b-212e-4fb8-8d73-e1702b8fd708 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:26.400008 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-f0c8640b-212e-4fb8-8d73-e1702b8fd708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:26.417989 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 849/1687] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:26.421433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5fd1a-4697-4bc8-ba2f-82d877966279 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:26.458355 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5fd1a-4697-4bc8-ba2f-82d877966279 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:26.472145 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e3652-c528-47a9-b331-d89fce274890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:26.476347 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e3652-c528-47a9-b331-d89fce274890 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:26.476887 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e3652-c528-47a9-b331-d89fce274890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:26.477926 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e3652-c528-47a9-b331-d89fce274890 admin admin] PATH_INFO: `/v3/projects/dc707948bd964d5295fc704613807d1c/users/4f24b025f60747019dd461be6b1a1639/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:26.534240 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e3652-c528-47a9-b331-d89fce274890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc707948bd964d5295fc704613807d1c, user_id=4f24b025f60747019dd461be6b1a1639, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:26.542007 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e3652-c528-47a9-b331-d89fce274890 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:26.581420 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 850/1688] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:26 2022] PUT /identity/v3/projects/dc707948bd964d5295fc704613807d1c/users/4f24b025f60747019dd461be6b1a1639/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:26.585030 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc3537-9b23-4cef-b69a-ddcf2c24c664 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:26.586998 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc3537-9b23-4cef-b69a-ddcf2c24c664 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:26.587530 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc3537-9b23-4cef-b69a-ddcf2c24c664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:26.599534 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8640b-212e-4fb8-8d73-e1702b8fd708 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:26.652377 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-74dc3537-9b23-4cef-b69a-ddcf2c24c664 None None] MFA Rules not processed for user `4f24b025f60747019dd461be6b1a1639`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:26.653905 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-74dc3537-9b23-4cef-b69a-ddcf2c24c664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:26.720888 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2ced0-4bfb-4408-a61e-915de7dc50ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:26.721581 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2ced0-4bfb-4408-a61e-915de7dc50ee service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:26.721872 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2ced0-4bfb-4408-a61e-915de7dc50ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:26.722212 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2ced0-4bfb-4408-a61e-915de7dc50ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:26.759679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:26.794618 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:26.829816 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 851/1689] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:26.829816 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc3537-9b23-4cef-b69a-ddcf2c24c664 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:26.896392 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2ced0-4bfb-4408-a61e-915de7dc50ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:26.898444 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2ced0-4bfb-4408-a61e-915de7dc50ee service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:26.922985 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 839/1690] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:26 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:26.924324 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb2adc-d265-4dce-a27a-384f285e94fb None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:26.926978 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb2adc-d265-4dce-a27a-384f285e94fb None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:26.928351 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb2adc-d265-4dce-a27a-384f285e94fb None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:26.932193 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 840/1691] 10.222.0.44 () {54 vars in 921 bytes} [Tue Jul 19 15:32:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:26.960856 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc3537-9b23-4cef-b69a-ddcf2c24c664 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:26.966627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0dcf7-730b-4ddf-9c79-27c8a3fdd444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:26.967569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0dcf7-730b-4ddf-9c79-27c8a3fdd444 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:26.967871 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0dcf7-730b-4ddf-9c79-27c8a3fdd444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:26.968400 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0dcf7-730b-4ddf-9c79-27c8a3fdd444 admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:26.969231 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0dcf7-730b-4ddf-9c79-27c8a3fdd444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:26.971259 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0dcf7-730b-4ddf-9c79-27c8a3fdd444 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:27.013439 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 852/1692] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:32:26 2022] POST /identity/v3/projects => generated 371 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:27.017286 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb2adc-d265-4dce-a27a-384f285e94fb None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:27.022104 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab3e50-9627-4d2d-a71e-90e6852e48d0 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:27.022394 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab3e50-9627-4d2d-a71e-90e6852e48d0 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:27.022690 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab3e50-9627-4d2d-a71e-90e6852e48d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:27.055548 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-b0ab3e50-9627-4d2d-a71e-90e6852e48d0 None None] MFA Rules not processed for user `2a27fe78683743c397fe7929e9053c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:27.056976 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-b0ab3e50-9627-4d2d-a71e-90e6852e48d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:27.168970 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb2adc-d265-4dce-a27a-384f285e94fb None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:27.179617 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e504b-458b-4a68-aa1c-8ad9c84e99e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:27.181686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e504b-458b-4a68-aa1c-8ad9c84e99e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:27.183346 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e504b-458b-4a68-aa1c-8ad9c84e99e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:27.183715 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e504b-458b-4a68-aa1c-8ad9c84e99e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:27.184490 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e504b-458b-4a68-aa1c-8ad9c84e99e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:27.187332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e504b-458b-4a68-aa1c-8ad9c84e99e5 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:27.210541 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 853/1693] 10.222.0.44 () {58 vars in 1018 bytes} [Tue Jul 19 15:32:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:27.211521 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab3e50-9627-4d2d-a71e-90e6852e48d0 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:27.215151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-b0ab3e50-9627-4d2d-a71e-90e6852e48d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:27.225767 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 841/1694] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:32:27 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:27.231867 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e504b-458b-4a68-aa1c-8ad9c84e99e5 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:27.251885 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab3e50-9627-4d2d-a71e-90e6852e48d0 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:27.261958 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b10374-4083-4481-89e0-86b9c84c5f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:27.262861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b10374-4083-4481-89e0-86b9c84c5f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:27.263144 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b10374-4083-4481-89e0-86b9c84c5f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:27.263557 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b10374-4083-4481-89e0-86b9c84c5f75 admin admin] PATH_INFO: `/v3/users/b45daa47d2e7412a9363846a07b6039c` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:27.268271 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b10374-4083-4481-89e0-86b9c84c5f75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b45daa47d2e7412a9363846a07b6039c)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:27.270422 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b10374-4083-4481-89e0-86b9c84c5f75 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:27.300732 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e504b-458b-4a68-aa1c-8ad9c84e99e5 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:27.317019 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb8198-bb5a-4792-a701-906493f48f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:27.317876 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb8198-bb5a-4792-a701-906493f48f69 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:27.318234 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb8198-bb5a-4792-a701-906493f48f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:27.318838 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb8198-bb5a-4792-a701-906493f48f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:27.320432 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb8198-bb5a-4792-a701-906493f48f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:27.322323 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb8198-bb5a-4792-a701-906493f48f69 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:27.351486 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 842/1695] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:27.352583 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb8198-bb5a-4792-a701-906493f48f69 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:27.373676 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-15b10374-4083-4481-89e0-86b9c84c5f75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b45daa47d2e7412a9363846a07b6039c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:27.388796 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:27.404718 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-15b10374-4083-4481-89e0-86b9c84c5f75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b45daa47d2e7412a9363846a07b6039c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:27.411236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb8198-bb5a-4792-a701-906493f48f69 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:27.421529 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-15b10374-4083-4481-89e0-86b9c84c5f75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b45daa47d2e7412a9363846a07b6039c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:27.423236 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-15b10374-4083-4481-89e0-86b9c84c5f75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b45daa47d2e7412a9363846a07b6039c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:27.429772 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-15b10374-4083-4481-89e0-86b9c84c5f75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b45daa47d2e7412a9363846a07b6039c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:27.435407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6d886-0083-4f43-82e0-c6b3243c524b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a27fe78683743c397fe7929e9053c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:27.437969 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6d886-0083-4f43-82e0-c6b3243c524b service placement] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:27.444673 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6d886-0083-4f43-82e0-c6b3243c524b service placement] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:27.445747 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6d886-0083-4f43-82e0-c6b3243c524b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:27.456472 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-5ae6d886-0083-4f43-82e0-c6b3243c524b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:27.460576 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 854/1696] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:32:27 2022] DELETE /identity/v3/users/b45daa47d2e7412a9363846a07b6039c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:27.463159 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b10374-4083-4481-89e0-86b9c84c5f75 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:27.470709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-15b10374-4083-4481-89e0-86b9c84c5f75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:27.509056 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6d886-0083-4f43-82e0-c6b3243c524b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:27.518650 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6d886-0083-4f43-82e0-c6b3243c524b service placement] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:27.548833 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 843/1697] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:27.647181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b10374-4083-4481-89e0-86b9c84c5f75 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:27.655118 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20feb8fe-7fc7-4d7e-b54e-bc048b4d2e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:27.656194 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20feb8fe-7fc7-4d7e-b54e-bc048b4d2e6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:27.656579 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20feb8fe-7fc7-4d7e-b54e-bc048b4d2e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:27.656864 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20feb8fe-7fc7-4d7e-b54e-bc048b4d2e6a admin admin] PATH_INFO: `/v3/projects/2b11b6483c5c48cfbe80caf8a624354f/users/19ae3f4c6d58473dbb516b9d524aad4f/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:27.681664 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20feb8fe-7fc7-4d7e-b54e-bc048b4d2e6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b11b6483c5c48cfbe80caf8a624354f, user_id=19ae3f4c6d58473dbb516b9d524aad4f, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:27.687428 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20feb8fe-7fc7-4d7e-b54e-bc048b4d2e6a admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:27.718013 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 855/1698] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:27 2022] PUT /identity/v3/projects/2b11b6483c5c48cfbe80caf8a624354f/users/19ae3f4c6d58473dbb516b9d524aad4f/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:27.723651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6d886-0083-4f43-82e0-c6b3243c524b service placement] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:27.740036 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6d886-0083-4f43-82e0-c6b3243c524b service placement] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:27.840211 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018de8f1-66b7-4964-9189-f1acb00e7f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:27.841311 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018de8f1-66b7-4964-9189-f1acb00e7f0e admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:27.841690 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018de8f1-66b7-4964-9189-f1acb00e7f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:27.842257 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018de8f1-66b7-4964-9189-f1acb00e7f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:27.843126 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018de8f1-66b7-4964-9189-f1acb00e7f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:27.850991 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018de8f1-66b7-4964-9189-f1acb00e7f0e admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:27.903868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 844/1699] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:27.909606 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20feb8fe-7fc7-4d7e-b54e-bc048b4d2e6a admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:27.924987 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20feb8fe-7fc7-4d7e-b54e-bc048b4d2e6a admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:27.939879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78ffb0-ca12-45dd-8c05-640878ce43e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:27.940978 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78ffb0-ca12-45dd-8c05-640878ce43e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:27.941440 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78ffb0-ca12-45dd-8c05-640878ce43e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:27.942611 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78ffb0-ca12-45dd-8c05-640878ce43e2 admin admin] PATH_INFO: `/v3/projects/2b11b6483c5c48cfbe80caf8a624354f/users/19ae3f4c6d58473dbb516b9d524aad4f/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:27.951478 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78ffb0-ca12-45dd-8c05-640878ce43e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b11b6483c5c48cfbe80caf8a624354f, user_id=19ae3f4c6d58473dbb516b9d524aad4f, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:27.954862 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78ffb0-ca12-45dd-8c05-640878ce43e2 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:27.999804 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 856/1700] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:27 2022] PUT /identity/v3/projects/2b11b6483c5c48cfbe80caf8a624354f/users/19ae3f4c6d58473dbb516b9d524aad4f/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:28.005583 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519d1fe-e1d2-4bed-a06d-21284bfc28cb None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:28.005583 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519d1fe-e1d2-4bed-a06d-21284bfc28cb None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:28.005583 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519d1fe-e1d2-4bed-a06d-21284bfc28cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:28.062731 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-2519d1fe-e1d2-4bed-a06d-21284bfc28cb None None] MFA Rules not processed for user `19ae3f4c6d58473dbb516b9d524aad4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:28.068680 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-2519d1fe-e1d2-4bed-a06d-21284bfc28cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:28.098611 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:28.308564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 845/1701] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:28 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:32:28.319486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78ffb0-ca12-45dd-8c05-640878ce43e2 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:28.321590 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-cf78ffb0-ca12-45dd-8c05-640878ce43e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:28.394142 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519d1fe-e1d2-4bed-a06d-21284bfc28cb None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:28.396061 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-2519d1fe-e1d2-4bed-a06d-21284bfc28cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:28.527813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78ffb0-ca12-45dd-8c05-640878ce43e2 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:28.540873 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2662f8-7bd5-4e77-b332-b9c39cad30e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:28.542544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2662f8-7bd5-4e77-b332-b9c39cad30e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:28.543931 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2662f8-7bd5-4e77-b332-b9c39cad30e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:28.544967 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2662f8-7bd5-4e77-b332-b9c39cad30e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:28.545267 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519d1fe-e1d2-4bed-a06d-21284bfc28cb None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:28.556098 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff1c41-34ad-4e81-b162-eeaefbbb4ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:28.557092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff1c41-34ad-4e81-b162-eeaefbbb4ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:28.557447 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff1c41-34ad-4e81-b162-eeaefbbb4ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:28.557745 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff1c41-34ad-4e81-b162-eeaefbbb4ae4 admin admin] PATH_INFO: `/v3/projects/1df69107e3734efc8c76253f79d581e8` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:28.560612 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff1c41-34ad-4e81-b162-eeaefbbb4ae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1df69107e3734efc8c76253f79d581e8)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:28.562682 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff1c41-34ad-4e81-b162-eeaefbbb4ae4 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:28.574214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2662f8-7bd5-4e77-b332-b9c39cad30e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:28.577977 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2662f8-7bd5-4e77-b332-b9c39cad30e9 service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:28.628728 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 857/1702] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:28 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:28.671451 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2662f8-7bd5-4e77-b332-b9c39cad30e9 service cinder] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:28.672860 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-cf2662f8-7bd5-4e77-b332-b9c39cad30e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:28.692705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-f9ff1c41-34ad-4e81-b162-eeaefbbb4ae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1df69107e3734efc8c76253f79d581e8', 'request_id': 'req-f9ff1c41-34ad-4e81-b162-eeaefbbb4ae4'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:28.703377 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-f9ff1c41-34ad-4e81-b162-eeaefbbb4ae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1df69107e3734efc8c76253f79d581e8', 'request_id': 'req-f9ff1c41-34ad-4e81-b162-eeaefbbb4ae4'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:28.709040 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2662f8-7bd5-4e77-b332-b9c39cad30e9 service cinder] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:28.724341 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-f9ff1c41-34ad-4e81-b162-eeaefbbb4ae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1df69107e3734efc8c76253f79d581e8', 'request_id': 'req-f9ff1c41-34ad-4e81-b162-eeaefbbb4ae4'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:28.755671 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-f9ff1c41-34ad-4e81-b162-eeaefbbb4ae4 admin admin] The token cache is being invalidate because project 1df69107e3734efc8c76253f79d581e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:32:28.755964 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-f9ff1c41-34ad-4e81-b162-eeaefbbb4ae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:28.756880 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-f9ff1c41-34ad-4e81-b162-eeaefbbb4ae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:28.763531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 846/1703] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:32:28 2022] DELETE /identity/v3/projects/1df69107e3734efc8c76253f79d581e8 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:32:28.769236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958b0c2-31cc-4134-aad9-9871409940a6 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:28.769539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958b0c2-31cc-4134-aad9-9871409940a6 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:28.769829 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958b0c2-31cc-4134-aad9-9871409940a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:28.809791 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-0958b0c2-31cc-4134-aad9-9871409940a6 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:28.814179 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-0958b0c2-31cc-4134-aad9-9871409940a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:28.880582 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:28.909149 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:28.921367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5cdc6-5110-4609-a2fc-ac12b435d2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:28.924199 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5cdc6-5110-4609-a2fc-ac12b435d2c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:28.928854 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5cdc6-5110-4609-a2fc-ac12b435d2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:28.931159 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5cdc6-5110-4609-a2fc-ac12b435d2c5 admin admin] PATH_INFO: `/v3/users/98556b3197704897ae7d09403e60fe7e` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:28.936553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b5cdc6-5110-4609-a2fc-ac12b435d2c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98556b3197704897ae7d09403e60fe7e)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:28.950825 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b5cdc6-5110-4609-a2fc-ac12b435d2c5 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:29.006925 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 847/1704] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:32:29.010749 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75ed22-7bd0-4f59-a93e-0faeb432afd7 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:29.010749 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75ed22-7bd0-4f59-a93e-0faeb432afd7 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:29.010749 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75ed22-7bd0-4f59-a93e-0faeb432afd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:29.068027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-6f75ed22-7bd0-4f59-a93e-0faeb432afd7 None None] MFA Rules not processed for user `7143c461c94444558d6ac9f5cddfb264`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:29.070888 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-6f75ed22-7bd0-4f59-a93e-0faeb432afd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:29.076967 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-37b5cdc6-5110-4609-a2fc-ac12b435d2c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98556b3197704897ae7d09403e60fe7e'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:29.110045 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-37b5cdc6-5110-4609-a2fc-ac12b435d2c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98556b3197704897ae7d09403e60fe7e'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:29.127193 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-37b5cdc6-5110-4609-a2fc-ac12b435d2c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98556b3197704897ae7d09403e60fe7e'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:29.130177 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-37b5cdc6-5110-4609-a2fc-ac12b435d2c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98556b3197704897ae7d09403e60fe7e'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:29.131209 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-37b5cdc6-5110-4609-a2fc-ac12b435d2c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98556b3197704897ae7d09403e60fe7e'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:29.161318 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 858/1705] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:32:28 2022] DELETE /identity/v3/users/98556b3197704897ae7d09403e60fe7e => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:29.162323 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5cdc6-5110-4609-a2fc-ac12b435d2c5 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:29.166412 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-37b5cdc6-5110-4609-a2fc-ac12b435d2c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:29.234039 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 848/1706] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:29.234039 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371cbdb-1aa8-46f9-a04f-89c980cf4fb8 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:29.234039 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371cbdb-1aa8-46f9-a04f-89c980cf4fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:29.234039 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371cbdb-1aa8-46f9-a04f-89c980cf4fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:29.280853 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-0371cbdb-1aa8-46f9-a04f-89c980cf4fb8 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:29.284265 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-0371cbdb-1aa8-46f9-a04f-89c980cf4fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:29.330773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5cdc6-5110-4609-a2fc-ac12b435d2c5 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:29.359661 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fce72c-d665-420e-96e1-331904c7f257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:29.361479 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fce72c-d665-420e-96e1-331904c7f257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:29.361968 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fce72c-d665-420e-96e1-331904c7f257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:29.362485 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fce72c-d665-420e-96e1-331904c7f257 admin admin] PATH_INFO: `/v3/projects/45b6302bfa2146abbb4d0739d3cb3473` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:29.365649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fce72c-d665-420e-96e1-331904c7f257 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45b6302bfa2146abbb4d0739d3cb3473)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:29.374053 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fce72c-d665-420e-96e1-331904c7f257 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:29.477371 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 849/1707] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:29.485212 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbec8c-a6b8-4cea-b308-ed223884eba8 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:29.491129 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbec8c-a6b8-4cea-b308-ed223884eba8 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:29.491489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbec8c-a6b8-4cea-b308-ed223884eba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:29.526562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-c1fce72c-d665-420e-96e1-331904c7f257 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45b6302bfa2146abbb4d0739d3cb3473', 'request_id': 'req-c1fce72c-d665-420e-96e1-331904c7f257'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:29.551471 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-c1fce72c-d665-420e-96e1-331904c7f257 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45b6302bfa2146abbb4d0739d3cb3473', 'request_id': 'req-c1fce72c-d665-420e-96e1-331904c7f257'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:29.558918 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-1ebbec8c-a6b8-4cea-b308-ed223884eba8 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:29.569510 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-1ebbec8c-a6b8-4cea-b308-ed223884eba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:29.578112 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-c1fce72c-d665-420e-96e1-331904c7f257 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45b6302bfa2146abbb4d0739d3cb3473', 'request_id': 'req-c1fce72c-d665-420e-96e1-331904c7f257'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:29.587396 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:29.610253 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-c1fce72c-d665-420e-96e1-331904c7f257 admin admin] The token cache is being invalidate because project 45b6302bfa2146abbb4d0739d3cb3473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:32:29.612091 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-c1fce72c-d665-420e-96e1-331904c7f257 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:29.614352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-c1fce72c-d665-420e-96e1-331904c7f257 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:29.621309 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 859/1708] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:32:29 2022] DELETE /identity/v3/projects/45b6302bfa2146abbb4d0739d3cb3473 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:29.624510 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fce72c-d665-420e-96e1-331904c7f257 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:29.631783 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-c1fce72c-d665-420e-96e1-331904c7f257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:29.747573 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 850/1709] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:29.748583 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbec8c-a6b8-4cea-b308-ed223884eba8 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:29.750830 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-1ebbec8c-a6b8-4cea-b308-ed223884eba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:29.798717 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbec8c-a6b8-4cea-b308-ed223884eba8 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:29.816099 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f8ec9-e496-4e6e-824d-10f3b13ee455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:29.822422 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f8ec9-e496-4e6e-824d-10f3b13ee455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:29.822656 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f8ec9-e496-4e6e-824d-10f3b13ee455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:29.822930 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f8ec9-e496-4e6e-824d-10f3b13ee455 admin admin] PATH_INFO: `/v3/users/46a97735a3ec4771ad26abba16e91f4b` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:29.826404 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f8ec9-e496-4e6e-824d-10f3b13ee455 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46a97735a3ec4771ad26abba16e91f4b)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:29.833904 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fce72c-d665-420e-96e1-331904c7f257 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:29.838840 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f8ec9-e496-4e6e-824d-10f3b13ee455 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:29.872870 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28e78e-96ee-40f6-9d3c-0f271a2cbc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:29.873601 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28e78e-96ee-40f6-9d3c-0f271a2cbc26 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:29.873892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28e78e-96ee-40f6-9d3c-0f271a2cbc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:29.874173 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28e78e-96ee-40f6-9d3c-0f271a2cbc26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:29.874926 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28e78e-96ee-40f6-9d3c-0f271a2cbc26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:29.875263 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28e78e-96ee-40f6-9d3c-0f271a2cbc26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:29.876944 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28e78e-96ee-40f6-9d3c-0f271a2cbc26 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:29.888596 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:29.925863 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 860/1710] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:29.929498 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28e78e-96ee-40f6-9d3c-0f271a2cbc26 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:29.940377 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-1a28e78e-96ee-40f6-9d3c-0f271a2cbc26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:29.942318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-dd2f8ec9-e496-4e6e-824d-10f3b13ee455 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46a97735a3ec4771ad26abba16e91f4b'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:29.970667 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-dd2f8ec9-e496-4e6e-824d-10f3b13ee455 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46a97735a3ec4771ad26abba16e91f4b'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:29.988369 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-dd2f8ec9-e496-4e6e-824d-10f3b13ee455 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46a97735a3ec4771ad26abba16e91f4b'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:29.989320 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28e78e-96ee-40f6-9d3c-0f271a2cbc26 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:29.989559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-dd2f8ec9-e496-4e6e-824d-10f3b13ee455 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46a97735a3ec4771ad26abba16e91f4b'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:29.990378 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-dd2f8ec9-e496-4e6e-824d-10f3b13ee455 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46a97735a3ec4771ad26abba16e91f4b'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:30.021788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9a62b-ef75-400e-83fa-afd93916453b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:30.023443 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9a62b-ef75-400e-83fa-afd93916453b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:30.023881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9a62b-ef75-400e-83fa-afd93916453b admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:30.024298 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9a62b-ef75-400e-83fa-afd93916453b admin admin] PATH_INFO: `/v3/users/4f24b025f60747019dd461be6b1a1639` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:30.030613 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 851/1711] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:32:29 2022] DELETE /identity/v3/users/46a97735a3ec4771ad26abba16e91f4b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:30.033825 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f8ec9-e496-4e6e-824d-10f3b13ee455 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:30.033907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9a62b-ef75-400e-83fa-afd93916453b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f24b025f60747019dd461be6b1a1639)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:30.034156 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9a62b-ef75-400e-83fa-afd93916453b admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:30.039893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-dd2f8ec9-e496-4e6e-824d-10f3b13ee455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:30.195256 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-eed9a62b-ef75-400e-83fa-afd93916453b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f24b025f60747019dd461be6b1a1639'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:30.247873 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-eed9a62b-ef75-400e-83fa-afd93916453b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f24b025f60747019dd461be6b1a1639'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:30.250240 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f8ec9-e496-4e6e-824d-10f3b13ee455 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:30.270471 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539848eb-8040-49ad-85cb-2d2827ea0b98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:30.271162 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539848eb-8040-49ad-85cb-2d2827ea0b98 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:30.271467 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539848eb-8040-49ad-85cb-2d2827ea0b98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:30.271746 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539848eb-8040-49ad-85cb-2d2827ea0b98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:30.276681 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-eed9a62b-ef75-400e-83fa-afd93916453b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f24b025f60747019dd461be6b1a1639'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:30.280169 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-539848eb-8040-49ad-85cb-2d2827ea0b98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:30.281645 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-eed9a62b-ef75-400e-83fa-afd93916453b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f24b025f60747019dd461be6b1a1639'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:30.283997 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-eed9a62b-ef75-400e-83fa-afd93916453b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f24b025f60747019dd461be6b1a1639'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:30.314380 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 861/1712] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:32:29 2022] DELETE /identity/v3/users/4f24b025f60747019dd461be6b1a1639 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:30.317044 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9a62b-ef75-400e-83fa-afd93916453b admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:30.320681 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-eed9a62b-ef75-400e-83fa-afd93916453b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:30.437115 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539848eb-8040-49ad-85cb-2d2827ea0b98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:30.438652 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539848eb-8040-49ad-85cb-2d2827ea0b98 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:30.466957 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 852/1713] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:30.468228 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cee97d-d6ce-4149-bf84-94c5c536ee1d None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:30.470339 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cee97d-d6ce-4149-bf84-94c5c536ee1d None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:30.470734 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cee97d-d6ce-4149-bf84-94c5c536ee1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:30.478401 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9a62b-ef75-400e-83fa-afd93916453b admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:30.493511 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e80bea-1bca-4eff-b1d8-e1310f07aca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:30.494352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e80bea-1bca-4eff-b1d8-e1310f07aca2 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:30.494663 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e80bea-1bca-4eff-b1d8-e1310f07aca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:30.495019 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e80bea-1bca-4eff-b1d8-e1310f07aca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:30.496033 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e80bea-1bca-4eff-b1d8-e1310f07aca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:30.503174 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e80bea-1bca-4eff-b1d8-e1310f07aca2 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:30.509653 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-f9cee97d-d6ce-4149-bf84-94c5c536ee1d None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:30.510683 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-f9cee97d-d6ce-4149-bf84-94c5c536ee1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:30.515149 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:30.534651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 853/1714] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:30.543575 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cee97d-d6ce-4149-bf84-94c5c536ee1d None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:30.546869 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-f9cee97d-d6ce-4149-bf84-94c5c536ee1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:30.561223 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cee97d-d6ce-4149-bf84-94c5c536ee1d None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:30.563604 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 862/1715] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:32:30 2022] POST /identity/v3/projects => generated 383 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:30.566565 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e80bea-1bca-4eff-b1d8-e1310f07aca2 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:30.614102 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:30.644989 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab60b2f-8176-4364-a7ea-b752ffb904f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:30.646102 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab60b2f-8176-4364-a7ea-b752ffb904f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:30.646389 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab60b2f-8176-4364-a7ea-b752ffb904f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:30.646673 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab60b2f-8176-4364-a7ea-b752ffb904f9 admin admin] PATH_INFO: `/v3/users/f5166eb567c24c75b6e5a27fbeab892d` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:30.648357 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab60b2f-8176-4364-a7ea-b752ffb904f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5166eb567c24c75b6e5a27fbeab892d)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:30.651082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab60b2f-8176-4364-a7ea-b752ffb904f9 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:30.698793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e80bea-1bca-4eff-b1d8-e1310f07aca2 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:30.705957 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b7afb-60a7-4176-9005-6519ce407b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:30.706864 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b7afb-60a7-4176-9005-6519ce407b12 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:30.708336 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b7afb-60a7-4176-9005-6519ce407b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:30.709318 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b7afb-60a7-4176-9005-6519ce407b12 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:30.710610 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b7afb-60a7-4176-9005-6519ce407b12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:30.713669 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b7afb-60a7-4176-9005-6519ce407b12 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:30.749806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-9ab60b2f-8176-4364-a7ea-b752ffb904f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5166eb567c24c75b6e5a27fbeab892d'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:30.764153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 863/1716] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:32:30 2022] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:30.765335 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b7afb-60a7-4176-9005-6519ce407b12 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:30.767241 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-549b7afb-60a7-4176-9005-6519ce407b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:30.792049 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-9ab60b2f-8176-4364-a7ea-b752ffb904f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5166eb567c24c75b6e5a27fbeab892d'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:30.813561 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-9ab60b2f-8176-4364-a7ea-b752ffb904f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5166eb567c24c75b6e5a27fbeab892d'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:30.815102 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-9ab60b2f-8176-4364-a7ea-b752ffb904f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5166eb567c24c75b6e5a27fbeab892d'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:30.817998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-9ab60b2f-8176-4364-a7ea-b752ffb904f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5166eb567c24c75b6e5a27fbeab892d'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:30.859386 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 854/1717] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:32:30 2022] DELETE /identity/v3/users/f5166eb567c24c75b6e5a27fbeab892d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:30.864668 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab60b2f-8176-4364-a7ea-b752ffb904f9 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:30.868134 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-9ab60b2f-8176-4364-a7ea-b752ffb904f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:30.914750 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b7afb-60a7-4176-9005-6519ce407b12 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:30.969598 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab60b2f-8176-4364-a7ea-b752ffb904f9 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:30.976901 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497518f9-f56c-4266-9b32-04477ffb0b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:30.978310 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497518f9-f56c-4266-9b32-04477ffb0b32 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:30.978310 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497518f9-f56c-4266-9b32-04477ffb0b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:30.978755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497518f9-f56c-4266-9b32-04477ffb0b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:30.980031 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497518f9-f56c-4266-9b32-04477ffb0b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:30.981945 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497518f9-f56c-4266-9b32-04477ffb0b32 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:31.002356 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 855/1718] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:31.005114 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f7ea2-12bb-4790-b239-bbc4e488a6f0 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:31.005114 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f7ea2-12bb-4790-b239-bbc4e488a6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:31.006351 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f7ea2-12bb-4790-b239-bbc4e488a6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:31.013141 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e76e13-3a47-42c5-840b-e6d6066adfc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:31.013836 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e76e13-3a47-42c5-840b-e6d6066adfc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:31.014173 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e76e13-3a47-42c5-840b-e6d6066adfc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:31.030210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e76e13-3a47-42c5-840b-e6d6066adfc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:31.037824 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-c36f7ea2-12bb-4790-b239-bbc4e488a6f0 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:31.039301 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-c36f7ea2-12bb-4790-b239-bbc4e488a6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:31.040932 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-52e76e13-3a47-42c5-840b-e6d6066adfc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:31.049426 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 856/1719] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:31.054575 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f7ea2-12bb-4790-b239-bbc4e488a6f0 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:31.056183 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-c36f7ea2-12bb-4790-b239-bbc4e488a6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:31.065658 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e76e13-3a47-42c5-840b-e6d6066adfc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:31.067969 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e76e13-3a47-42c5-840b-e6d6066adfc7 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:31.073547 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f7ea2-12bb-4790-b239-bbc4e488a6f0 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:31.080675 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed9860-ecad-4509-8a02-8ef87d822214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:31.081728 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed9860-ecad-4509-8a02-8ef87d822214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:31.082147 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed9860-ecad-4509-8a02-8ef87d822214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:31.082550 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed9860-ecad-4509-8a02-8ef87d822214 admin admin] PATH_INFO: `/v3/projects/b651f2774dfb4dacb9ec151fcccb84ca` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:31.085031 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed9860-ecad-4509-8a02-8ef87d822214 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b651f2774dfb4dacb9ec151fcccb84ca)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:31.087391 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed9860-ecad-4509-8a02-8ef87d822214 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:31.094566 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 864/1720] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:31.096330 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158683a-710c-4528-99a1-9bca85f1ceb2 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:31.096776 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158683a-710c-4528-99a1-9bca85f1ceb2 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:31.097216 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158683a-710c-4528-99a1-9bca85f1ceb2 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:31.102206 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 865/1721] 10.222.0.44 () {54 vars in 912 bytes} [Tue Jul 19 15:32:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:31.103304 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158683a-710c-4528-99a1-9bca85f1ceb2 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:31.147277 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158683a-710c-4528-99a1-9bca85f1ceb2 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:31.162843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48701617-e12b-4b74-8b13-ac54564fc485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:31.163982 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48701617-e12b-4b74-8b13-ac54564fc485 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:31.164280 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48701617-e12b-4b74-8b13-ac54564fc485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:31.164577 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48701617-e12b-4b74-8b13-ac54564fc485 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:31.165352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48701617-e12b-4b74-8b13-ac54564fc485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:31.167913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48701617-e12b-4b74-8b13-ac54564fc485 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:31.178221 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:31.194100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 866/1722] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:31.198768 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48701617-e12b-4b74-8b13-ac54564fc485 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:31.207044 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-48701617-e12b-4b74-8b13-ac54564fc485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:31.247480 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-37ed9860-ecad-4509-8a02-8ef87d822214 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b651f2774dfb4dacb9ec151fcccb84ca', 'request_id': 'req-37ed9860-ecad-4509-8a02-8ef87d822214'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:31.248912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48701617-e12b-4b74-8b13-ac54564fc485 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:31.279173 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-37ed9860-ecad-4509-8a02-8ef87d822214 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b651f2774dfb4dacb9ec151fcccb84ca', 'request_id': 'req-37ed9860-ecad-4509-8a02-8ef87d822214'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:31.313233 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:31.314529 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-37ed9860-ecad-4509-8a02-8ef87d822214 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b651f2774dfb4dacb9ec151fcccb84ca', 'request_id': 'req-37ed9860-ecad-4509-8a02-8ef87d822214'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:31.355667 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-37ed9860-ecad-4509-8a02-8ef87d822214 admin admin] The token cache is being invalidate because project b651f2774dfb4dacb9ec151fcccb84ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:32:31.356021 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-37ed9860-ecad-4509-8a02-8ef87d822214 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:31.357490 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-37ed9860-ecad-4509-8a02-8ef87d822214 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:31.364026 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 857/1723] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:32:31 2022] DELETE /identity/v3/projects/b651f2774dfb4dacb9ec151fcccb84ca => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:31.373098 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5c9fa-df7b-4b17-ac3e-0829f3540ff0 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:31.373437 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5c9fa-df7b-4b17-ac3e-0829f3540ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:31.377055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5c9fa-df7b-4b17-ac3e-0829f3540ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:31.401362 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e009e-ae9e-417b-9af1-7311fe67d0a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:31.402414 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e009e-ae9e-417b-9af1-7311fe67d0a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:31.402915 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e009e-ae9e-417b-9af1-7311fe67d0a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:31.403434 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e009e-ae9e-417b-9af1-7311fe67d0a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:31.409272 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-6d0e009e-ae9e-417b-9af1-7311fe67d0a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:31.468991 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-07f5c9fa-df7b-4b17-ac3e-0829f3540ff0 None None] MFA Rules not processed for user `c89e7fbcc22c478c98d74b802f4bf8f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:31.470652 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-07f5c9fa-df7b-4b17-ac3e-0829f3540ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:31.502100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 858/1724] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jul 19 15:32:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:31.502733 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5c9fa-df7b-4b17-ac3e-0829f3540ff0 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:31.506107 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-07f5c9fa-df7b-4b17-ac3e-0829f3540ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:31.582728 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e009e-ae9e-417b-9af1-7311fe67d0a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:31.584908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e009e-ae9e-417b-9af1-7311fe67d0a7 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:31.604256 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 867/1725] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:31.607759 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ef2d3-7dff-48ba-baf7-d6e25dda94cc None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:31.608302 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ef2d3-7dff-48ba-baf7-d6e25dda94cc None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:31.608999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ef2d3-7dff-48ba-baf7-d6e25dda94cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:31.653551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-815ef2d3-7dff-48ba-baf7-d6e25dda94cc None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:31.655021 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-815ef2d3-7dff-48ba-baf7-d6e25dda94cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:31.668233 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 868/1726] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:31.670225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ef2d3-7dff-48ba-baf7-d6e25dda94cc None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:31.671825 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-815ef2d3-7dff-48ba-baf7-d6e25dda94cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:31.682259 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5c9fa-df7b-4b17-ac3e-0829f3540ff0 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:31.687944 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ef2d3-7dff-48ba-baf7-d6e25dda94cc None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:31.690036 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a97f3e-2bc4-4eb9-99b7-ab5d7cae1fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:31.691155 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a97f3e-2bc4-4eb9-99b7-ab5d7cae1fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:31.692481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a97f3e-2bc4-4eb9-99b7-ab5d7cae1fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:31.694292 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a97f3e-2bc4-4eb9-99b7-ab5d7cae1fe4 admin admin] PATH_INFO: `/v3/projects/7b6443a359a7492f80b33518b1d0aa21/users/ef48f446fd1142d8b9ce986b00fe850c/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:31.703655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09916f4-1ac0-4599-8489-10ddc5de9422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:31.704519 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09916f4-1ac0-4599-8489-10ddc5de9422 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:31.704929 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09916f4-1ac0-4599-8489-10ddc5de9422 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:31.705895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09916f4-1ac0-4599-8489-10ddc5de9422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:31.728067 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09916f4-1ac0-4599-8489-10ddc5de9422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:31.729955 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09916f4-1ac0-4599-8489-10ddc5de9422 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:31.736915 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a97f3e-2bc4-4eb9-99b7-ab5d7cae1fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b6443a359a7492f80b33518b1d0aa21, user_id=ef48f446fd1142d8b9ce986b00fe850c, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:31.749580 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a97f3e-2bc4-4eb9-99b7-ab5d7cae1fe4 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:31.758027 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 869/1727] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:31.759627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00afa0c-e9e9-4360-904d-a1673ec83ca7 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:31.760032 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00afa0c-e9e9-4360-904d-a1673ec83ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:31.760423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00afa0c-e9e9-4360-904d-a1673ec83ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:31.793617 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 859/1728] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:31 2022] PUT /identity/v3/projects/7b6443a359a7492f80b33518b1d0aa21/users/ef48f446fd1142d8b9ce986b00fe850c/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:31.804900 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0345540-6027-4e17-a96b-d4090d5db893 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:31.805199 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0345540-6027-4e17-a96b-d4090d5db893 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:31.805482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0345540-6027-4e17-a96b-d4090d5db893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:31.806783 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-f00afa0c-e9e9-4360-904d-a1673ec83ca7 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:31.812451 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-f00afa0c-e9e9-4360-904d-a1673ec83ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:31.878453 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-b0345540-6027-4e17-a96b-d4090d5db893 None None] MFA Rules not processed for user `ef48f446fd1142d8b9ce986b00fe850c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:31.881468 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-b0345540-6027-4e17-a96b-d4090d5db893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:31.978223 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 870/1729] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:31.985044 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00afa0c-e9e9-4360-904d-a1673ec83ca7 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:32.009523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00afa0c-e9e9-4360-904d-a1673ec83ca7 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:32.033016 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188665f8-9f2c-48cd-9c67-3fd9e3d6c5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:32.034481 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188665f8-9f2c-48cd-9c67-3fd9e3d6c5ce admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:32.034856 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188665f8-9f2c-48cd-9c67-3fd9e3d6c5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:32.035818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188665f8-9f2c-48cd-9c67-3fd9e3d6c5ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:32.037183 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188665f8-9f2c-48cd-9c67-3fd9e3d6c5ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:32.037895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188665f8-9f2c-48cd-9c67-3fd9e3d6c5ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:32.040155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188665f8-9f2c-48cd-9c67-3fd9e3d6c5ce admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:32.064049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 871/1730] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:32.068970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188665f8-9f2c-48cd-9c67-3fd9e3d6c5ce admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:32.080929 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 860/1731] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:32.086220 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0345540-6027-4e17-a96b-d4090d5db893 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:32.088357 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188665f8-9f2c-48cd-9c67-3fd9e3d6c5ce admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:32.099911 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf425d6-b32a-49a0-b1af-6ed64d279ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:32.100823 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf425d6-b32a-49a0-b1af-6ed64d279ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:32.101273 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf425d6-b32a-49a0-b1af-6ed64d279ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:32.101746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf425d6-b32a-49a0-b1af-6ed64d279ed6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:32.102791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf425d6-b32a-49a0-b1af-6ed64d279ed6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:32.105626 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf425d6-b32a-49a0-b1af-6ed64d279ed6 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:32.129504 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0345540-6027-4e17-a96b-d4090d5db893 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:32.136672 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d281b-9abb-42bd-a89c-0cfa9229bdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:32.138398 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d281b-9abb-42bd-a89c-0cfa9229bdb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:32.138840 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d281b-9abb-42bd-a89c-0cfa9229bdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:32.139351 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d281b-9abb-42bd-a89c-0cfa9229bdb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:32.140225 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d281b-9abb-42bd-a89c-0cfa9229bdb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:32.143098 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d281b-9abb-42bd-a89c-0cfa9229bdb1 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:32.188597 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 872/1732] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:32:32 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:32.196616 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf425d6-b32a-49a0-b1af-6ed64d279ed6 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:32.207357 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 861/1733] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:32:32 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:32.214419 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d281b-9abb-42bd-a89c-0cfa9229bdb1 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:32.224864 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:32.324632 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:32.426587 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d281b-9abb-42bd-a89c-0cfa9229bdb1 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:32.431704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf3b10-f1c8-4d02-a9bf-cdd3e3365e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:32.432453 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf3b10-f1c8-4d02-a9bf-cdd3e3365e88 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:32.432742 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf3b10-f1c8-4d02-a9bf-cdd3e3365e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:32.433021 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf3b10-f1c8-4d02-a9bf-cdd3e3365e88 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:32.433725 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf3b10-f1c8-4d02-a9bf-cdd3e3365e88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:32.441803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf3b10-f1c8-4d02-a9bf-cdd3e3365e88 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:32.456236 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf425d6-b32a-49a0-b1af-6ed64d279ed6 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:32.474161 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d321c0-d806-4113-8107-2cf30d6d5602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:32.475514 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d321c0-d806-4113-8107-2cf30d6d5602 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:32.476085 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d321c0-d806-4113-8107-2cf30d6d5602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:32.476590 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d321c0-d806-4113-8107-2cf30d6d5602 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:32.477607 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d321c0-d806-4113-8107-2cf30d6d5602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:32.482165 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d321c0-d806-4113-8107-2cf30d6d5602 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:32.486372 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 862/1734] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:32:32 2022] POST /identity/v3/users => generated 297 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:32.490632 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf3b10-f1c8-4d02-a9bf-cdd3e3365e88 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:32.523392 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf3b10-f1c8-4d02-a9bf-cdd3e3365e88 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:32.537171 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 873/1735] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:32:32 2022] POST /identity/v3/users => generated 294 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:32.540904 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d321c0-d806-4113-8107-2cf30d6d5602 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:32.558732 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20feff-6edd-4055-886e-9186813a3b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:32.559792 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20feff-6edd-4055-886e-9186813a3b52 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:32.560087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20feff-6edd-4055-886e-9186813a3b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:32.560753 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20feff-6edd-4055-886e-9186813a3b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:32.564004 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d321c0-d806-4113-8107-2cf30d6d5602 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:32.564841 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20feff-6edd-4055-886e-9186813a3b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:32.578563 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20feff-6edd-4055-886e-9186813a3b52 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:32.583149 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eeccf3-1ade-45f1-acce-823236583e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:32.585999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eeccf3-1ade-45f1-acce-823236583e9e admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:32.589269 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eeccf3-1ade-45f1-acce-823236583e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:32.592972 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eeccf3-1ade-45f1-acce-823236583e9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:32.594214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eeccf3-1ade-45f1-acce-823236583e9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:32.601534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eeccf3-1ade-45f1-acce-823236583e9e admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:32.633484 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 863/1736] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:32.643121 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20feff-6edd-4055-886e-9186813a3b52 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:32.643741 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 874/1737] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:32.646426 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eeccf3-1ade-45f1-acce-823236583e9e admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:32.680269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20feff-6edd-4055-886e-9186813a3b52 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:32.730367 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd94fdd-8b32-42ef-b06e-7936bc1ef34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:32.738815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd94fdd-8b32-42ef-b06e-7936bc1ef34e admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:32.743911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd94fdd-8b32-42ef-b06e-7936bc1ef34e admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:32.744440 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd94fdd-8b32-42ef-b06e-7936bc1ef34e admin admin] PATH_INFO: `/v3/projects/bd30c3faf4e34c05bc2fe0c59033229f/users/5b7b894016c84c0b9e7a00154d72c9e3/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:32.754654 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eeccf3-1ade-45f1-acce-823236583e9e admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:32.772410 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ace8c-287d-4d4b-98be-94c13b587bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:32.773401 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ace8c-287d-4d4b-98be-94c13b587bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:32.773739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ace8c-287d-4d4b-98be-94c13b587bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:32.774020 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ace8c-287d-4d4b-98be-94c13b587bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:32.774808 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ace8c-287d-4d4b-98be-94c13b587bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:32.779051 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ace8c-287d-4d4b-98be-94c13b587bc8 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:32.811502 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd94fdd-8b32-42ef-b06e-7936bc1ef34e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd30c3faf4e34c05bc2fe0c59033229f, user_id=5b7b894016c84c0b9e7a00154d72c9e3, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:32.815114 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 875/1738] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:32.816128 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ace8c-287d-4d4b-98be-94c13b587bc8 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:32.821948 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd94fdd-8b32-42ef-b06e-7936bc1ef34e admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:32.824407 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-e94ace8c-287d-4d4b-98be-94c13b587bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:32.860177 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 864/1739] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:32 2022] PUT /identity/v3/projects/bd30c3faf4e34c05bc2fe0c59033229f/users/5b7b894016c84c0b9e7a00154d72c9e3/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:32.860177 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd94fdd-8b32-42ef-b06e-7936bc1ef34e admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:32.871943 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ace8c-287d-4d4b-98be-94c13b587bc8 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:33.102546 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6582d-bc24-453a-bd48-1a89af84f700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:33.103494 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6582d-bc24-453a-bd48-1a89af84f700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:33.103786 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6582d-bc24-453a-bd48-1a89af84f700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:33.104065 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6582d-bc24-453a-bd48-1a89af84f700 admin admin] PATH_INFO: `/v3/projects/a3e4d7fdc7ee4616ad8a50b177c444e6` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:33.105351 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6582d-bc24-453a-bd48-1a89af84f700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3e4d7fdc7ee4616ad8a50b177c444e6)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:33.107342 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6582d-bc24-453a-bd48-1a89af84f700 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:33.117387 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd94fdd-8b32-42ef-b06e-7936bc1ef34e admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:33.134749 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46c554-4bc4-4f29-927f-81fa382969ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:33.136001 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46c554-4bc4-4f29-927f-81fa382969ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:33.136398 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46c554-4bc4-4f29-927f-81fa382969ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:33.136969 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46c554-4bc4-4f29-927f-81fa382969ca admin admin] PATH_INFO: `/v3/projects/a980be1932ff42cfaf87762c6eb95616/users/f26ea5a9a3a9420eaf6cc0f06226d478/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:33.196587 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46c554-4bc4-4f29-927f-81fa382969ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=a980be1932ff42cfaf87762c6eb95616, user_id=f26ea5a9a3a9420eaf6cc0f06226d478, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:33.199778 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46c554-4bc4-4f29-927f-81fa382969ca admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:33.217643 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2bb6582d-bc24-453a-bd48-1a89af84f700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3e4d7fdc7ee4616ad8a50b177c444e6', 'request_id': 'req-2bb6582d-bc24-453a-bd48-1a89af84f700'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:33.234057 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 865/1740] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:32 2022] PUT /identity/v3/projects/a980be1932ff42cfaf87762c6eb95616/users/f26ea5a9a3a9420eaf6cc0f06226d478/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:33.236521 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46c554-4bc4-4f29-927f-81fa382969ca admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:33.252799 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2bb6582d-bc24-453a-bd48-1a89af84f700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3e4d7fdc7ee4616ad8a50b177c444e6', 'request_id': 'req-2bb6582d-bc24-453a-bd48-1a89af84f700'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:33.295492 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2bb6582d-bc24-453a-bd48-1a89af84f700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3e4d7fdc7ee4616ad8a50b177c444e6', 'request_id': 'req-2bb6582d-bc24-453a-bd48-1a89af84f700'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:33.328930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2bb6582d-bc24-453a-bd48-1a89af84f700 admin admin] The token cache is being invalidate because project a3e4d7fdc7ee4616ad8a50b177c444e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:32:33.329408 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2bb6582d-bc24-453a-bd48-1a89af84f700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:33.331006 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2bb6582d-bc24-453a-bd48-1a89af84f700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:33.339114 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 876/1741] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:32:32 2022] DELETE /identity/v3/projects/a3e4d7fdc7ee4616ad8a50b177c444e6 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:33.345656 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:33.346042 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b98f8-647a-49ed-adfd-72cb80b131d6 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:33.346376 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b98f8-647a-49ed-adfd-72cb80b131d6 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:33.346669 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b98f8-647a-49ed-adfd-72cb80b131d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:33.399524 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46c554-4bc4-4f29-927f-81fa382969ca admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:33.413204 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7957b-53d5-4c42-937c-8f93d333fe50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:33.414117 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7957b-53d5-4c42-937c-8f93d333fe50 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:33.414568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7957b-53d5-4c42-937c-8f93d333fe50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:33.414986 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7957b-53d5-4c42-937c-8f93d333fe50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:33.420284 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7957b-53d5-4c42-937c-8f93d333fe50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:33.431460 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7957b-53d5-4c42-937c-8f93d333fe50 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:33.466124 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 866/1742] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:33.467797 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6747c-04b2-4b9c-81ee-a2f2eb0aaa40 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:33.468966 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-d65b98f8-647a-49ed-adfd-72cb80b131d6 None None] MFA Rules not processed for user `f26ea5a9a3a9420eaf6cc0f06226d478`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:33.469408 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6747c-04b2-4b9c-81ee-a2f2eb0aaa40 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:33.469800 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6747c-04b2-4b9c-81ee-a2f2eb0aaa40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:33.470247 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-d65b98f8-647a-49ed-adfd-72cb80b131d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:33.502252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:33.546927 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-34d6747c-04b2-4b9c-81ee-a2f2eb0aaa40 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:33.552972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-34d6747c-04b2-4b9c-81ee-a2f2eb0aaa40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:33.579382 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 867/1743] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:33.580457 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6747c-04b2-4b9c-81ee-a2f2eb0aaa40 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:33.587286 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-34d6747c-04b2-4b9c-81ee-a2f2eb0aaa40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:33.602922 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6747c-04b2-4b9c-81ee-a2f2eb0aaa40 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:33.613536 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f30bad-844a-4dcd-ac3d-e5425bbeb181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:33.614760 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f30bad-844a-4dcd-ac3d-e5425bbeb181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:33.615139 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f30bad-844a-4dcd-ac3d-e5425bbeb181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:33.615521 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f30bad-844a-4dcd-ac3d-e5425bbeb181 admin admin] PATH_INFO: `/v3/projects/9f7d24f4fb764a14bcd29d233010bb1e` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:33.616940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f30bad-844a-4dcd-ac3d-e5425bbeb181 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f7d24f4fb764a14bcd29d233010bb1e)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:33.619466 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f30bad-844a-4dcd-ac3d-e5425bbeb181 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:33.677634 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 877/1744] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:33.678505 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b98f8-647a-49ed-adfd-72cb80b131d6 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:33.680711 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-d65b98f8-647a-49ed-adfd-72cb80b131d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:33.714561 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b98f8-647a-49ed-adfd-72cb80b131d6 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:33.720987 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-53f30bad-844a-4dcd-ac3d-e5425bbeb181 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f7d24f4fb764a14bcd29d233010bb1e', 'request_id': 'req-53f30bad-844a-4dcd-ac3d-e5425bbeb181'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:33.731815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-53f30bad-844a-4dcd-ac3d-e5425bbeb181 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f7d24f4fb764a14bcd29d233010bb1e', 'request_id': 'req-53f30bad-844a-4dcd-ac3d-e5425bbeb181'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:33.744736 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-53f30bad-844a-4dcd-ac3d-e5425bbeb181 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f7d24f4fb764a14bcd29d233010bb1e', 'request_id': 'req-53f30bad-844a-4dcd-ac3d-e5425bbeb181'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:33.762981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-53f30bad-844a-4dcd-ac3d-e5425bbeb181 admin admin] The token cache is being invalidate because project 9f7d24f4fb764a14bcd29d233010bb1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:32:33.765880 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-53f30bad-844a-4dcd-ac3d-e5425bbeb181 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:33.767735 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-53f30bad-844a-4dcd-ac3d-e5425bbeb181 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:33.777114 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 868/1745] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:32:33 2022] DELETE /identity/v3/projects/9f7d24f4fb764a14bcd29d233010bb1e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:33.781828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dfedf-c58b-46d9-8df0-dbc419b7e57e None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:33.782167 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dfedf-c58b-46d9-8df0-dbc419b7e57e None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:33.782453 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dfedf-c58b-46d9-8df0-dbc419b7e57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:33.858184 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-031dfedf-c58b-46d9-8df0-dbc419b7e57e None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:33.869214 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-031dfedf-c58b-46d9-8df0-dbc419b7e57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:33.876999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c580b-1391-474a-8c28-43769feb77d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:33.882656 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c580b-1391-474a-8c28-43769feb77d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:33.883101 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c580b-1391-474a-8c28-43769feb77d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:33.884791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c580b-1391-474a-8c28-43769feb77d0 admin admin] PATH_INFO: `/v3/projects/bd30c3faf4e34c05bc2fe0c59033229f/users/5b7b894016c84c0b9e7a00154d72c9e3/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:33.885959 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c580b-1391-474a-8c28-43769feb77d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd30c3faf4e34c05bc2fe0c59033229f, user_id=5b7b894016c84c0b9e7a00154d72c9e3, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:33.889296 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c580b-1391-474a-8c28-43769feb77d0 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:33.890327 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 869/1746] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:33.892602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dfedf-c58b-46d9-8df0-dbc419b7e57e None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:33.898602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-031dfedf-c58b-46d9-8df0-dbc419b7e57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:33.911845 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 878/1747] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:33 2022] PUT /identity/v3/projects/bd30c3faf4e34c05bc2fe0c59033229f/users/5b7b894016c84c0b9e7a00154d72c9e3/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:33.912890 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c580b-1391-474a-8c28-43769feb77d0 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:33.915045 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-873c580b-1391-474a-8c28-43769feb77d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:33.946711 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dfedf-c58b-46d9-8df0-dbc419b7e57e None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:34.064925 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c580b-1391-474a-8c28-43769feb77d0 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:34.081896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe81180-ca09-415f-9cae-d1ce4bcbfe3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:34.083769 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe81180-ca09-415f-9cae-d1ce4bcbfe3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:34.084184 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe81180-ca09-415f-9cae-d1ce4bcbfe3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:34.085367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe81180-ca09-415f-9cae-d1ce4bcbfe3a admin admin] PATH_INFO: `/v3/users/bcb9bada33f149f1a4408a507b532f1d` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:34.091316 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe81180-ca09-415f-9cae-d1ce4bcbfe3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcb9bada33f149f1a4408a507b532f1d)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:34.093520 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57456e5a-e851-4d6f-8476-8a98a9f829af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:34.095647 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57456e5a-e851-4d6f-8476-8a98a9f829af admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:34.096121 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57456e5a-e851-4d6f-8476-8a98a9f829af admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:34.096548 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57456e5a-e851-4d6f-8476-8a98a9f829af admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:34.097481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57456e5a-e851-4d6f-8476-8a98a9f829af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:34.099578 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe81180-ca09-415f-9cae-d1ce4bcbfe3a admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:34.100806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57456e5a-e851-4d6f-8476-8a98a9f829af admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:34.170418 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 870/1748] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:32:33 2022] POST /identity/v3/projects => generated 385 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:34.171627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57456e5a-e851-4d6f-8476-8a98a9f829af admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:34.221572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:34.271351 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57456e5a-e851-4d6f-8476-8a98a9f829af admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:34.277417 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d4609-53e5-4050-90ea-4f70617bbba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:34.279166 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d4609-53e5-4050-90ea-4f70617bbba7 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:34.279701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d4609-53e5-4050-90ea-4f70617bbba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:34.280154 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d4609-53e5-4050-90ea-4f70617bbba7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:34.281085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d4609-53e5-4050-90ea-4f70617bbba7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:34.281531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d4609-53e5-4050-90ea-4f70617bbba7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:34.286181 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d4609-53e5-4050-90ea-4f70617bbba7 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:34.294696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:34.304476 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ebe81180-ca09-415f-9cae-d1ce4bcbfe3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcb9bada33f149f1a4408a507b532f1d'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:34.313706 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 871/1749] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:34.315519 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3e63d-511b-451f-aae3-8c6513aaa3b3 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:34.315816 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3e63d-511b-451f-aae3-8c6513aaa3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:34.316611 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3e63d-511b-451f-aae3-8c6513aaa3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:34.330555 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ebe81180-ca09-415f-9cae-d1ce4bcbfe3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcb9bada33f149f1a4408a507b532f1d'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:34.340653 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ebe81180-ca09-415f-9cae-d1ce4bcbfe3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcb9bada33f149f1a4408a507b532f1d'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:34.343302 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ebe81180-ca09-415f-9cae-d1ce4bcbfe3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcb9bada33f149f1a4408a507b532f1d'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:34.344181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ebe81180-ca09-415f-9cae-d1ce4bcbfe3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcb9bada33f149f1a4408a507b532f1d'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:34.367042 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-d4b3e63d-511b-451f-aae3-8c6513aaa3b3 None None] MFA Rules not processed for user `5b7b894016c84c0b9e7a00154d72c9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:34.370665 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-d4b3e63d-511b-451f-aae3-8c6513aaa3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:34.374942 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 879/1750] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:32:33 2022] DELETE /identity/v3/users/bcb9bada33f149f1a4408a507b532f1d => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:34.376231 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe81180-ca09-415f-9cae-d1ce4bcbfe3a admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:34.380869 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-ebe81180-ca09-415f-9cae-d1ce4bcbfe3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:34.577800 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe81180-ca09-415f-9cae-d1ce4bcbfe3a admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:34.585446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 872/1751] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:34.588352 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3e63d-511b-451f-aae3-8c6513aaa3b3 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:34.590308 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-d4b3e63d-511b-451f-aae3-8c6513aaa3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:34.597264 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587dc4b-ccad-4f52-98df-831af3eca4bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a27fe78683743c397fe7929e9053c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:34.597996 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587dc4b-ccad-4f52-98df-831af3eca4bf service placement] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:34.598452 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587dc4b-ccad-4f52-98df-831af3eca4bf service placement] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:34.598928 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587dc4b-ccad-4f52-98df-831af3eca4bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:34.603140 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-3587dc4b-ccad-4f52-98df-831af3eca4bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:34.617868 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3587dc4b-ccad-4f52-98df-831af3eca4bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:34.619516 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3587dc4b-ccad-4f52-98df-831af3eca4bf service placement] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:34.633797 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 880/1752] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:34.634728 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587dc4b-ccad-4f52-98df-831af3eca4bf service placement] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:34.636154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-3587dc4b-ccad-4f52-98df-831af3eca4bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:34.641120 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3e63d-511b-451f-aae3-8c6513aaa3b3 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:34.730463 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587dc4b-ccad-4f52-98df-831af3eca4bf service placement] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:34.736118 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb26b0a-f857-4aa2-8197-7aaa6f27469e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:34.737037 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb26b0a-f857-4aa2-8197-7aaa6f27469e admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:34.737427 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb26b0a-f857-4aa2-8197-7aaa6f27469e admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:34.737808 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb26b0a-f857-4aa2-8197-7aaa6f27469e admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:34.739206 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb26b0a-f857-4aa2-8197-7aaa6f27469e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:34.741426 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb26b0a-f857-4aa2-8197-7aaa6f27469e admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:34.784451 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 881/1753] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:32:34 2022] POST /identity/v3/projects => generated 407 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:34.785598 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb26b0a-f857-4aa2-8197-7aaa6f27469e admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:34.787672 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-2bb26b0a-f857-4aa2-8197-7aaa6f27469e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:34.807094 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f99aff-7186-4d76-a7a5-2b4f6d383c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:34.809079 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f99aff-7186-4d76-a7a5-2b4f6d383c88 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:34.809572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f99aff-7186-4d76-a7a5-2b4f6d383c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:34.809987 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f99aff-7186-4d76-a7a5-2b4f6d383c88 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:34.810872 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f99aff-7186-4d76-a7a5-2b4f6d383c88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:34.815903 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f99aff-7186-4d76-a7a5-2b4f6d383c88 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:34.869301 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 873/1754] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:32:34 2022] POST /identity/v3/users => generated 293 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:34.874330 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f99aff-7186-4d76-a7a5-2b4f6d383c88 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:34.878080 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-35f99aff-7186-4d76-a7a5-2b4f6d383c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:34.904563 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:35.004452 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb26b0a-f857-4aa2-8197-7aaa6f27469e admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:35.012048 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa9b73-c9c6-482f-9975-9abffdcf6390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:35.013411 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa9b73-c9c6-482f-9975-9abffdcf6390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:35.014186 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa9b73-c9c6-482f-9975-9abffdcf6390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:35.014812 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa9b73-c9c6-482f-9975-9abffdcf6390 admin admin] PATH_INFO: `/v3/projects/dc707948bd964d5295fc704613807d1c` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:35.016313 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa9b73-c9c6-482f-9975-9abffdcf6390 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc707948bd964d5295fc704613807d1c)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:35.022108 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa9b73-c9c6-482f-9975-9abffdcf6390 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:35.035637 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:35.086540 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f99aff-7186-4d76-a7a5-2b4f6d383c88 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:35.259537 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-60aa9b73-c9c6-482f-9975-9abffdcf6390 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc707948bd964d5295fc704613807d1c', 'request_id': 'req-60aa9b73-c9c6-482f-9975-9abffdcf6390'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:35.272751 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a4cbb-76b7-4818-ad89-988104efc169 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:35.273870 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a4cbb-76b7-4818-ad89-988104efc169 service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:35.274256 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a4cbb-76b7-4818-ad89-988104efc169 service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:35.274638 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a4cbb-76b7-4818-ad89-988104efc169 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:35.291956 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-60aa9b73-c9c6-482f-9975-9abffdcf6390 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc707948bd964d5295fc704613807d1c', 'request_id': 'req-60aa9b73-c9c6-482f-9975-9abffdcf6390'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:35.316145 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-60aa9b73-c9c6-482f-9975-9abffdcf6390 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc707948bd964d5295fc704613807d1c', 'request_id': 'req-60aa9b73-c9c6-482f-9975-9abffdcf6390'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:35.369791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-60aa9b73-c9c6-482f-9975-9abffdcf6390 admin admin] The token cache is being invalidate because project dc707948bd964d5295fc704613807d1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:32:35.370153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-60aa9b73-c9c6-482f-9975-9abffdcf6390 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:35.374654 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-60aa9b73-c9c6-482f-9975-9abffdcf6390 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:35.383476 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 882/1755] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:32:34 2022] DELETE /identity/v3/projects/dc707948bd964d5295fc704613807d1c => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:35.386530 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa9b73-c9c6-482f-9975-9abffdcf6390 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:35.389989 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-60aa9b73-c9c6-482f-9975-9abffdcf6390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:35.455817 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a4cbb-76b7-4818-ad89-988104efc169 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:35.464394 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a4cbb-76b7-4818-ad89-988104efc169 service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:35.492399 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 874/1756] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:35.494303 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a4cbb-76b7-4818-ad89-988104efc169 service cinder] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:35.517515 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a4cbb-76b7-4818-ad89-988104efc169 service cinder] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:35.632472 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa9b73-c9c6-482f-9975-9abffdcf6390 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:35.641380 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3a016-1a1b-4676-af5d-efa3a1719416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:35.642631 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3a016-1a1b-4676-af5d-efa3a1719416 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:35.643151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3a016-1a1b-4676-af5d-efa3a1719416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:35.643694 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3a016-1a1b-4676-af5d-efa3a1719416 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:35.645516 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3a016-1a1b-4676-af5d-efa3a1719416 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:35.650923 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3a016-1a1b-4676-af5d-efa3a1719416 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:35.682803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 883/1757] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:32:35 2022] POST /identity/v3/users => generated 304 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:35.682803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3a016-1a1b-4676-af5d-efa3a1719416 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:35.687542 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-82a3a016-1a1b-4676-af5d-efa3a1719416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:35.704738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3a016-1a1b-4676-af5d-efa3a1719416 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:35.712979 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a37ace-3740-464e-9015-83a1938c78e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:35.716434 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a37ace-3740-464e-9015-83a1938c78e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:35.716791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a37ace-3740-464e-9015-83a1938c78e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:35.717085 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a37ace-3740-464e-9015-83a1938c78e2 admin admin] PATH_INFO: `/v3/projects/d7112d71cc25441eaa2ef90f2e132bf4` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:35.718386 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398f176-cee0-4321-b4f6-c380543508c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:35.719096 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398f176-cee0-4321-b4f6-c380543508c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:35.719418 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398f176-cee0-4321-b4f6-c380543508c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:35.719700 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398f176-cee0-4321-b4f6-c380543508c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:35.720474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398f176-cee0-4321-b4f6-c380543508c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:35.722907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a37ace-3740-464e-9015-83a1938c78e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7112d71cc25441eaa2ef90f2e132bf4)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:35.724996 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a37ace-3740-464e-9015-83a1938c78e2 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:35.726061 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398f176-cee0-4321-b4f6-c380543508c1 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:35.763593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 875/1758] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:35.763593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398f176-cee0-4321-b4f6-c380543508c1 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:35.767908 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-9398f176-cee0-4321-b4f6-c380543508c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:35.801689 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398f176-cee0-4321-b4f6-c380543508c1 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:35.820827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6fbb2-5640-415a-a872-8d2ec9e3e5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:35.822856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6fbb2-5640-415a-a872-8d2ec9e3e5e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:35.824213 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6fbb2-5640-415a-a872-8d2ec9e3e5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:35.824684 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6fbb2-5640-415a-a872-8d2ec9e3e5e0 admin admin] PATH_INFO: `/v3/users/19ae3f4c6d58473dbb516b9d524aad4f` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:35.829332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6fbb2-5640-415a-a872-8d2ec9e3e5e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19ae3f4c6d58473dbb516b9d524aad4f)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:35.834375 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6fbb2-5640-415a-a872-8d2ec9e3e5e0 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:35.880422 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-b9a37ace-3740-464e-9015-83a1938c78e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7112d71cc25441eaa2ef90f2e132bf4', 'request_id': 'req-b9a37ace-3740-464e-9015-83a1938c78e2'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:35.881950 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:35.898685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-b9a37ace-3740-464e-9015-83a1938c78e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7112d71cc25441eaa2ef90f2e132bf4', 'request_id': 'req-b9a37ace-3740-464e-9015-83a1938c78e2'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:35.915517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-b9a37ace-3740-464e-9015-83a1938c78e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7112d71cc25441eaa2ef90f2e132bf4', 'request_id': 'req-b9a37ace-3740-464e-9015-83a1938c78e2'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:35.960353 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-b9a37ace-3740-464e-9015-83a1938c78e2 admin admin] The token cache is being invalidate because project d7112d71cc25441eaa2ef90f2e132bf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:32:35.960897 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:35.964014 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-b9a37ace-3740-464e-9015-83a1938c78e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:35.972035 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-b9a37ace-3740-464e-9015-83a1938c78e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:35.974638 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 884/1759] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:32:35 2022] DELETE /identity/v3/projects/d7112d71cc25441eaa2ef90f2e132bf4 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:35.975857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a37ace-3740-464e-9015-83a1938c78e2 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:35.979701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-b9a37ace-3740-464e-9015-83a1938c78e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:35.985905 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-85a6fbb2-5640-415a-a872-8d2ec9e3e5e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19ae3f4c6d58473dbb516b9d524aad4f'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:36.008055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-85a6fbb2-5640-415a-a872-8d2ec9e3e5e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19ae3f4c6d58473dbb516b9d524aad4f'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:36.022315 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-85a6fbb2-5640-415a-a872-8d2ec9e3e5e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19ae3f4c6d58473dbb516b9d524aad4f'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:36.024446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-85a6fbb2-5640-415a-a872-8d2ec9e3e5e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19ae3f4c6d58473dbb516b9d524aad4f'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:36.025327 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-85a6fbb2-5640-415a-a872-8d2ec9e3e5e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19ae3f4c6d58473dbb516b9d524aad4f'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:36.048066 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 876/1760] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:32:35 2022] DELETE /identity/v3/users/19ae3f4c6d58473dbb516b9d524aad4f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:36.051376 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6fbb2-5640-415a-a872-8d2ec9e3e5e0 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:36.053054 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-85a6fbb2-5640-415a-a872-8d2ec9e3e5e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:36.106831 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a37ace-3740-464e-9015-83a1938c78e2 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:36.141318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6fbb2-5640-415a-a872-8d2ec9e3e5e0 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:36.148940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19ff52-47ce-4a43-9368-6b62ce864417 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:36.150201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19ff52-47ce-4a43-9368-6b62ce864417 service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:36.150650 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19ff52-47ce-4a43-9368-6b62ce864417 service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:36.151038 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19ff52-47ce-4a43-9368-6b62ce864417 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:36.153794 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-ce19ff52-47ce-4a43-9368-6b62ce864417 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:36.210894 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc53cd-bb1d-4e3c-a8bb-fa2a2e202d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:36.211728 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc53cd-bb1d-4e3c-a8bb-fa2a2e202d14 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:36.212152 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc53cd-bb1d-4e3c-a8bb-fa2a2e202d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:36.212562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc53cd-bb1d-4e3c-a8bb-fa2a2e202d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:36.213344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc53cd-bb1d-4e3c-a8bb-fa2a2e202d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:36.215845 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc53cd-bb1d-4e3c-a8bb-fa2a2e202d14 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:36.233516 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 885/1761] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:36.233516 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc53cd-bb1d-4e3c-a8bb-fa2a2e202d14 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:36.236500 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-5fbc53cd-bb1d-4e3c-a8bb-fa2a2e202d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:36.282535 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc53cd-bb1d-4e3c-a8bb-fa2a2e202d14 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:36.293023 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8abcf3-4d97-429d-adde-d0c95c4327f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:36.293850 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8abcf3-4d97-429d-adde-d0c95c4327f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:36.294175 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8abcf3-4d97-429d-adde-d0c95c4327f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:36.294492 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8abcf3-4d97-429d-adde-d0c95c4327f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:36.295420 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8abcf3-4d97-429d-adde-d0c95c4327f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:36.297459 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8abcf3-4d97-429d-adde-d0c95c4327f0 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:36.330363 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19ff52-47ce-4a43-9368-6b62ce864417 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:36.332047 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19ff52-47ce-4a43-9368-6b62ce864417 service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:36.342098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 886/1762] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:36.347513 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630dc32d-2b05-4bce-99cc-49b0a83cee7a None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:36.348078 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630dc32d-2b05-4bce-99cc-49b0a83cee7a None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:36.349721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630dc32d-2b05-4bce-99cc-49b0a83cee7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:36.354956 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 877/1763] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:36.357723 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d07125-1d84-4f8a-bc0a-62199b3638af None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:36.357723 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d07125-1d84-4f8a-bc0a-62199b3638af None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:36.357723 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d07125-1d84-4f8a-bc0a-62199b3638af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:36.383541 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-d3d07125-1d84-4f8a-bc0a-62199b3638af None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:36.385549 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-d3d07125-1d84-4f8a-bc0a-62199b3638af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:36.402342 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 878/1764] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:36.411423 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d07125-1d84-4f8a-bc0a-62199b3638af None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:36.415949 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-d3d07125-1d84-4f8a-bc0a-62199b3638af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:36.432705 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-630dc32d-2b05-4bce-99cc-49b0a83cee7a None None] MFA Rules not processed for user `7dbd6ff526844272b3f48e49991039ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:36.435142 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-630dc32d-2b05-4bce-99cc-49b0a83cee7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:36.463376 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d07125-1d84-4f8a-bc0a-62199b3638af None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:36.474666 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5c4e4-2e6b-452f-8213-8b0771fdf835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:36.476482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5c4e4-2e6b-452f-8213-8b0771fdf835 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:36.476482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5c4e4-2e6b-452f-8213-8b0771fdf835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:36.476715 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5c4e4-2e6b-452f-8213-8b0771fdf835 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:36.477940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5c4e4-2e6b-452f-8213-8b0771fdf835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:36.483656 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5c4e4-2e6b-452f-8213-8b0771fdf835 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:36.546019 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 879/1765] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:36.551942 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d3662-c54f-426b-a901-f506e0692306 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:36.552482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d3662-c54f-426b-a901-f506e0692306 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:36.557452 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d3662-c54f-426b-a901-f506e0692306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:36.578742 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:36.595095 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 887/1766] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:36.600573 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630dc32d-2b05-4bce-99cc-49b0a83cee7a None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:36.637234 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-b76d3662-c54f-426b-a901-f506e0692306 None None] MFA Rules not processed for user `dcd12611b7d144e28fa1358f927c9f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:36.638579 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-b76d3662-c54f-426b-a901-f506e0692306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:36.649177 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630dc32d-2b05-4bce-99cc-49b0a83cee7a None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:36.663829 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003436f1-3b39-41d9-98af-456b1998b54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:36.665119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003436f1-3b39-41d9-98af-456b1998b54e admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:36.667555 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003436f1-3b39-41d9-98af-456b1998b54e admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:36.667970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003436f1-3b39-41d9-98af-456b1998b54e admin admin] PATH_INFO: `/v3/projects/9f07f18679164c7daa7d3a8cbd539ac6/users/478cd95541684a3da1c73ca6f8047895/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:36.713124 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003436f1-3b39-41d9-98af-456b1998b54e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f07f18679164c7daa7d3a8cbd539ac6, user_id=478cd95541684a3da1c73ca6f8047895, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:36.717027 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003436f1-3b39-41d9-98af-456b1998b54e admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:36.767259 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 888/1767] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:36 2022] PUT /identity/v3/projects/9f07f18679164c7daa7d3a8cbd539ac6/users/478cd95541684a3da1c73ca6f8047895/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:36.767259 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4d5ea-34cd-45c4-b655-6dcbc43e283e None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:36.775600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4d5ea-34cd-45c4-b655-6dcbc43e283e None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:36.775600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4d5ea-34cd-45c4-b655-6dcbc43e283e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:36.780778 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:36.893005 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 880/1768] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:36.893005 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d3662-c54f-426b-a901-f506e0692306 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:36.900193 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-97f4d5ea-34cd-45c4-b655-6dcbc43e283e None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:36.903905 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-97f4d5ea-34cd-45c4-b655-6dcbc43e283e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:36.953035 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d3662-c54f-426b-a901-f506e0692306 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:37.113936 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 889/1769] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:37.113936 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9580c0-5664-41f3-a63b-e8baa40ae605 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:37.113936 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9580c0-5664-41f3-a63b-e8baa40ae605 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:37.113936 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9580c0-5664-41f3-a63b-e8baa40ae605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:37.157550 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-fb9580c0-5664-41f3-a63b-e8baa40ae605 None None] MFA Rules not processed for user `7dbd6ff526844272b3f48e49991039ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:37.158232 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-fb9580c0-5664-41f3-a63b-e8baa40ae605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:37.179167 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b83a7-13a9-49b6-b96b-b0a1d3aa1d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:37.184804 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b83a7-13a9-49b6-b96b-b0a1d3aa1d53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:37.185299 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b83a7-13a9-49b6-b96b-b0a1d3aa1d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:37.185792 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b83a7-13a9-49b6-b96b-b0a1d3aa1d53 admin admin] PATH_INFO: `/v3/projects/a169ea9c31ad461d8f353535778c5129/users/f44c5f26820b48579d9b63311b5b017c/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:37.259612 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b83a7-13a9-49b6-b96b-b0a1d3aa1d53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a169ea9c31ad461d8f353535778c5129, user_id=f44c5f26820b48579d9b63311b5b017c, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:37.265990 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b83a7-13a9-49b6-b96b-b0a1d3aa1d53 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:37.293878 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 890/1770] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:37.295488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495935ca-a732-40e3-b050-a134666cbc26 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:37.295791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495935ca-a732-40e3-b050-a134666cbc26 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:37.296326 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495935ca-a732-40e3-b050-a134666cbc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:37.331482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 881/1771] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:36 2022] PUT /identity/v3/projects/a169ea9c31ad461d8f353535778c5129/users/f44c5f26820b48579d9b63311b5b017c/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:37.331482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b83a7-13a9-49b6-b96b-b0a1d3aa1d53 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:37.334491 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-f78b83a7-13a9-49b6-b96b-b0a1d3aa1d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:37.334854 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-495935ca-a732-40e3-b050-a134666cbc26 None None] MFA Rules not processed for user `478cd95541684a3da1c73ca6f8047895`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:37.338455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-495935ca-a732-40e3-b050-a134666cbc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:37.466647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 891/1772] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:37.473636 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6fa0e-8c37-45ec-99b2-32562983e9cc None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:37.473948 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6fa0e-8c37-45ec-99b2-32562983e9cc None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:37.474268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6fa0e-8c37-45ec-99b2-32562983e9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:37.485382 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b83a7-13a9-49b6-b96b-b0a1d3aa1d53 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:37.492223 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910f576-1622-488a-9ce2-ffe650a6e7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:37.493539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910f576-1622-488a-9ce2-ffe650a6e7ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:37.494055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910f576-1622-488a-9ce2-ffe650a6e7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:37.494511 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910f576-1622-488a-9ce2-ffe650a6e7ab admin admin] PATH_INFO: `/v3/projects/2b11b6483c5c48cfbe80caf8a624354f` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:37.496116 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910f576-1622-488a-9ce2-ffe650a6e7ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b11b6483c5c48cfbe80caf8a624354f)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:37.499070 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910f576-1622-488a-9ce2-ffe650a6e7ab admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:37.506718 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-5fe6fa0e-8c37-45ec-99b2-32562983e9cc None None] MFA Rules not processed for user `dcd12611b7d144e28fa1358f927c9f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:37.509285 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-5fe6fa0e-8c37-45ec-99b2-32562983e9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:37.520625 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:37.579922 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-2910f576-1622-488a-9ce2-ffe650a6e7ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b11b6483c5c48cfbe80caf8a624354f', 'request_id': 'req-2910f576-1622-488a-9ce2-ffe650a6e7ab'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:37.588668 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-2910f576-1622-488a-9ce2-ffe650a6e7ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b11b6483c5c48cfbe80caf8a624354f', 'request_id': 'req-2910f576-1622-488a-9ce2-ffe650a6e7ab'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:37.599989 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-2910f576-1622-488a-9ce2-ffe650a6e7ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b11b6483c5c48cfbe80caf8a624354f', 'request_id': 'req-2910f576-1622-488a-9ce2-ffe650a6e7ab'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:37.605861 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:37.621743 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-2910f576-1622-488a-9ce2-ffe650a6e7ab admin admin] The token cache is being invalidate because project 2b11b6483c5c48cfbe80caf8a624354f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:32:37.622273 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-2910f576-1622-488a-9ce2-ffe650a6e7ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:37.623547 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-2910f576-1622-488a-9ce2-ffe650a6e7ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:37.629287 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 892/1773] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:37.629478 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 882/1774] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:32:37 2022] DELETE /identity/v3/projects/2b11b6483c5c48cfbe80caf8a624354f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:37.629478 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910f576-1622-488a-9ce2-ffe650a6e7ab admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:37.629478 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-2910f576-1622-488a-9ce2-ffe650a6e7ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:37.630863 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6fa0e-8c37-45ec-99b2-32562983e9cc None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:37.645711 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6fa0e-8c37-45ec-99b2-32562983e9cc None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:37.766597 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434549f9-c73f-4383-8e16-b036d627e509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:37.768372 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434549f9-c73f-4383-8e16-b036d627e509 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:37.769190 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434549f9-c73f-4383-8e16-b036d627e509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:37.770362 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434549f9-c73f-4383-8e16-b036d627e509 admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:37.771487 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434549f9-c73f-4383-8e16-b036d627e509 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:37.771817 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434549f9-c73f-4383-8e16-b036d627e509 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:37.773895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434549f9-c73f-4383-8e16-b036d627e509 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:37.792000 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 893/1775] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:37.793975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95973c4-44c3-4e46-82ff-e0673c7dd01f None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:37.794370 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95973c4-44c3-4e46-82ff-e0673c7dd01f None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:37.794661 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95973c4-44c3-4e46-82ff-e0673c7dd01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:37.809306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910f576-1622-488a-9ce2-ffe650a6e7ab admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:37.817802 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e09c14-234d-43bb-9471-7ad0c94fefb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:37.818575 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e09c14-234d-43bb-9471-7ad0c94fefb9 service nova] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:37.818820 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e09c14-234d-43bb-9471-7ad0c94fefb9 service nova] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:37.819048 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e09c14-234d-43bb-9471-7ad0c94fefb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:37.821933 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-26e09c14-234d-43bb-9471-7ad0c94fefb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:37.859606 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-b95973c4-44c3-4e46-82ff-e0673c7dd01f None None] MFA Rules not processed for user `f44c5f26820b48579d9b63311b5b017c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:37.861407 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-b95973c4-44c3-4e46-82ff-e0673c7dd01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:37.949936 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e09c14-234d-43bb-9471-7ad0c94fefb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:37.952815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e09c14-234d-43bb-9471-7ad0c94fefb9 service nova] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:37.965699 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 883/1776] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:37.966608 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e09c14-234d-43bb-9471-7ad0c94fefb9 service nova] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:37.970436 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-26e09c14-234d-43bb-9471-7ad0c94fefb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:37.989348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e09c14-234d-43bb-9471-7ad0c94fefb9 service nova] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:37.996290 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc2a4f-3aa0-4ead-88d5-46eb7538954c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:37.997621 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc2a4f-3aa0-4ead-88d5-46eb7538954c admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:37.997926 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc2a4f-3aa0-4ead-88d5-46eb7538954c admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:37.998210 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc2a4f-3aa0-4ead-88d5-46eb7538954c admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:37.998954 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc2a4f-3aa0-4ead-88d5-46eb7538954c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:38.001570 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc2a4f-3aa0-4ead-88d5-46eb7538954c admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:38.063238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 884/1777] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:32:37 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:38.064857 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75a68f-870f-48b3-9e66-3fc5038ba82a None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:38.065172 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75a68f-870f-48b3-9e66-3fc5038ba82a None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:38.065425 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75a68f-870f-48b3-9e66-3fc5038ba82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:38.117189 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-8a75a68f-870f-48b3-9e66-3fc5038ba82a None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:38.119350 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-8a75a68f-870f-48b3-9e66-3fc5038ba82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:38.121064 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 894/1778] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:37 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:38.122604 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95973c4-44c3-4e46-82ff-e0673c7dd01f None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:38.137137 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-b95973c4-44c3-4e46-82ff-e0673c7dd01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:38.199996 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95973c4-44c3-4e46-82ff-e0673c7dd01f None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:38.326205 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 885/1779] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:38.327408 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75a68f-870f-48b3-9e66-3fc5038ba82a None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:38.333075 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-8a75a68f-870f-48b3-9e66-3fc5038ba82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:38.382013 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75a68f-870f-48b3-9e66-3fc5038ba82a None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:38.401110 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2077be5-37d4-4af7-b326-809df11a7567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:38.401865 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2077be5-37d4-4af7-b326-809df11a7567 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:38.402130 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2077be5-37d4-4af7-b326-809df11a7567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:38.402410 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2077be5-37d4-4af7-b326-809df11a7567 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:38.403132 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2077be5-37d4-4af7-b326-809df11a7567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:38.410637 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:38.414474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2077be5-37d4-4af7-b326-809df11a7567 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:38.436443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:38.526052 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 886/1780] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:32:38 2022] POST /identity/v3/projects => generated 387 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:38.532893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2077be5-37d4-4af7-b326-809df11a7567 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:38.543171 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee691645-c61e-4ca3-bab4-3b8b4145b73d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:38.547753 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee691645-c61e-4ca3-bab4-3b8b4145b73d service nova] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:38.548047 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee691645-c61e-4ca3-bab4-3b8b4145b73d service nova] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:38.552528 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee691645-c61e-4ca3-bab4-3b8b4145b73d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:38.565094 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-ee691645-c61e-4ca3-bab4-3b8b4145b73d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:38.800741 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee691645-c61e-4ca3-bab4-3b8b4145b73d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:38.802361 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee691645-c61e-4ca3-bab4-3b8b4145b73d service nova] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:38.807071 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2077be5-37d4-4af7-b326-809df11a7567 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:38.821625 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 895/1781] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:38.823031 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee691645-c61e-4ca3-bab4-3b8b4145b73d service nova] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:38.824849 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-ee691645-c61e-4ca3-bab4-3b8b4145b73d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:38.835260 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973eba1b-04ae-4c80-b415-9a6e83c8d1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:38.836215 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973eba1b-04ae-4c80-b415-9a6e83c8d1bf admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:38.843450 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973eba1b-04ae-4c80-b415-9a6e83c8d1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:38.843967 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973eba1b-04ae-4c80-b415-9a6e83c8d1bf admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:38.845888 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973eba1b-04ae-4c80-b415-9a6e83c8d1bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:38.849388 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee691645-c61e-4ca3-bab4-3b8b4145b73d service nova] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:38.857713 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973eba1b-04ae-4c80-b415-9a6e83c8d1bf admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:38.867781 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb816fd5-a157-4c28-8350-8e7be65ebb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:38.869087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb816fd5-a157-4c28-8350-8e7be65ebb41 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:38.869438 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb816fd5-a157-4c28-8350-8e7be65ebb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:38.869668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb816fd5-a157-4c28-8350-8e7be65ebb41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:38.874029 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb816fd5-a157-4c28-8350-8e7be65ebb41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:38.880746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb816fd5-a157-4c28-8350-8e7be65ebb41 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:38.926579 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 887/1782] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:32:38 2022] POST /identity/v3/users => generated 299 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:38.929593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3922d38-4892-42a0-868e-da9f920bc88c None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:38.930082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3922d38-4892-42a0-868e-da9f920bc88c None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:38.930544 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3922d38-4892-42a0-868e-da9f920bc88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:38.981148 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 896/1783] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:32:38 2022] POST /identity/v3/projects => generated 407 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:38.984203 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb816fd5-a157-4c28-8350-8e7be65ebb41 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:39.013251 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-d3922d38-4892-42a0-868e-da9f920bc88c None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:39.016325 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-d3922d38-4892-42a0-868e-da9f920bc88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:39.157228 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb816fd5-a157-4c28-8350-8e7be65ebb41 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:39.173012 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ddd1a-0ae9-4df4-882e-74ebeede7c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:39.174493 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ddd1a-0ae9-4df4-882e-74ebeede7c63 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:39.174851 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ddd1a-0ae9-4df4-882e-74ebeede7c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:39.175208 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ddd1a-0ae9-4df4-882e-74ebeede7c63 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:39.176294 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ddd1a-0ae9-4df4-882e-74ebeede7c63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:39.179094 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ddd1a-0ae9-4df4-882e-74ebeede7c63 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:39.230950 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 897/1784] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:32:38 2022] POST /identity/v3/users => generated 294 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:39.232394 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01387f-112d-445c-8f1b-6a0a6f62ee73 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:39.232694 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01387f-112d-445c-8f1b-6a0a6f62ee73 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:39.232983 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01387f-112d-445c-8f1b-6a0a6f62ee73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:39.242134 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 888/1785] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:39.243804 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3922d38-4892-42a0-868e-da9f920bc88c None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:39.283099 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3922d38-4892-42a0-868e-da9f920bc88c None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:39.301705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526b03b-636a-410a-aa16-82103c92a1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:39.302865 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526b03b-636a-410a-aa16-82103c92a1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:39.303384 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526b03b-636a-410a-aa16-82103c92a1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:39.303878 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526b03b-636a-410a-aa16-82103c92a1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:39.305261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526b03b-636a-410a-aa16-82103c92a1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:39.313482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526b03b-636a-410a-aa16-82103c92a1e0 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:39.355772 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 889/1786] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:39.369947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526b03b-636a-410a-aa16-82103c92a1e0 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:39.401824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-6c01387f-112d-445c-8f1b-6a0a6f62ee73 None None] MFA Rules not processed for user `cea1d8409c754ec797d6c694481a3112`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:39.404167 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-6c01387f-112d-445c-8f1b-6a0a6f62ee73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:39.423138 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526b03b-636a-410a-aa16-82103c92a1e0 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:39.447471 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6921bb-2b07-46a1-94be-f0cadc628e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:39.448990 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6921bb-2b07-46a1-94be-f0cadc628e19 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:39.449870 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6921bb-2b07-46a1-94be-f0cadc628e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:39.450376 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6921bb-2b07-46a1-94be-f0cadc628e19 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:39.452202 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6921bb-2b07-46a1-94be-f0cadc628e19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:39.456246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6921bb-2b07-46a1-94be-f0cadc628e19 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:39.470041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:39.526310 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 890/1787] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:32:39 2022] POST /identity/v3/users => generated 310 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:39.529236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6921bb-2b07-46a1-94be-f0cadc628e19 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:39.576054 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6921bb-2b07-46a1-94be-f0cadc628e19 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:39.603286 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03143d-5b8e-439d-82ca-a17914629a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:39.604399 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03143d-5b8e-439d-82ca-a17914629a46 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:39.604889 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03143d-5b8e-439d-82ca-a17914629a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:39.605370 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03143d-5b8e-439d-82ca-a17914629a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:39.606670 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03143d-5b8e-439d-82ca-a17914629a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:39.610056 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 898/1788] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jul 19 15:32:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:39.610056 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01387f-112d-445c-8f1b-6a0a6f62ee73 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:39.654788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01387f-112d-445c-8f1b-6a0a6f62ee73 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:39.660667 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03143d-5b8e-439d-82ca-a17914629a46 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:39.667678 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f860f-cdf2-45b1-9a36-94e7d2b7f12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:39.670484 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f860f-cdf2-45b1-9a36-94e7d2b7f12c admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:39.670937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f860f-cdf2-45b1-9a36-94e7d2b7f12c admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:39.671355 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f860f-cdf2-45b1-9a36-94e7d2b7f12c admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:39.673545 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f860f-cdf2-45b1-9a36-94e7d2b7f12c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:39.677611 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f860f-cdf2-45b1-9a36-94e7d2b7f12c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:39.679529 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f860f-cdf2-45b1-9a36-94e7d2b7f12c admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:39.713808 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 899/1789] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:39.715160 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f860f-cdf2-45b1-9a36-94e7d2b7f12c admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:39.733831 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 891/1790] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:39.740910 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03143d-5b8e-439d-82ca-a17914629a46 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:39.752290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f860f-cdf2-45b1-9a36-94e7d2b7f12c admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:39.771467 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabeaa1-15f1-4078-b2e5-bb19e2717ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:39.775927 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabeaa1-15f1-4078-b2e5-bb19e2717ea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:39.776339 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabeaa1-15f1-4078-b2e5-bb19e2717ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:39.776727 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabeaa1-15f1-4078-b2e5-bb19e2717ea7 admin admin] PATH_INFO: `/v3/projects/46e95f1607e948e49be498a787497306/users/e0e9f1c4d685483d9807a2c87d443474/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:39.780875 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03143d-5b8e-439d-82ca-a17914629a46 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:39.802821 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715728f-dc5f-40d5-9fdd-647cd28bd984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:39.803969 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715728f-dc5f-40d5-9fdd-647cd28bd984 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:39.804461 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715728f-dc5f-40d5-9fdd-647cd28bd984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:39.804957 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715728f-dc5f-40d5-9fdd-647cd28bd984 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:39.806316 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715728f-dc5f-40d5-9fdd-647cd28bd984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:39.813812 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cabeaa1-15f1-4078-b2e5-bb19e2717ea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46e95f1607e948e49be498a787497306, user_id=e0e9f1c4d685483d9807a2c87d443474, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:39.814612 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715728f-dc5f-40d5-9fdd-647cd28bd984 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:39.818752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cabeaa1-15f1-4078-b2e5-bb19e2717ea7 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:39.855998 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 900/1791] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:39 2022] PUT /identity/v3/projects/46e95f1607e948e49be498a787497306/users/e0e9f1c4d685483d9807a2c87d443474/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:39.857247 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabeaa1-15f1-4078-b2e5-bb19e2717ea7 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:39.864353 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-3cabeaa1-15f1-4078-b2e5-bb19e2717ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:39.873920 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 892/1792] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:39.881272 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715728f-dc5f-40d5-9fdd-647cd28bd984 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:39.934689 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715728f-dc5f-40d5-9fdd-647cd28bd984 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:40.009820 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:40.072891 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabeaa1-15f1-4078-b2e5-bb19e2717ea7 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:40.077265 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c0dad-a220-4a26-a650-51281761987c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:40.078749 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c0dad-a220-4a26-a650-51281761987c admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:40.079370 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c0dad-a220-4a26-a650-51281761987c admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:40.082894 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237efbc-3f2e-4c9c-b180-f02679798ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:40.083997 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c0dad-a220-4a26-a650-51281761987c admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:40.084135 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237efbc-3f2e-4c9c-b180-f02679798ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:40.084542 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237efbc-3f2e-4c9c-b180-f02679798ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:40.084907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237efbc-3f2e-4c9c-b180-f02679798ab1 admin admin] PATH_INFO: `/v3/users/ef48f446fd1142d8b9ce986b00fe850c` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:40.085604 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c0dad-a220-4a26-a650-51281761987c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:40.086469 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237efbc-3f2e-4c9c-b180-f02679798ab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef48f446fd1142d8b9ce986b00fe850c)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:40.088273 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c0dad-a220-4a26-a650-51281761987c admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:40.090669 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237efbc-3f2e-4c9c-b180-f02679798ab1 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:40.161051 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 893/1793] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:32:39 2022] POST /identity/v3/projects => generated 363 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:40.162692 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c0dad-a220-4a26-a650-51281761987c admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:40.259438 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-a237efbc-3f2e-4c9c-b180-f02679798ab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef48f446fd1142d8b9ce986b00fe850c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:40.285101 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-a237efbc-3f2e-4c9c-b180-f02679798ab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef48f446fd1142d8b9ce986b00fe850c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:40.304742 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-a237efbc-3f2e-4c9c-b180-f02679798ab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef48f446fd1142d8b9ce986b00fe850c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:40.311267 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-a237efbc-3f2e-4c9c-b180-f02679798ab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef48f446fd1142d8b9ce986b00fe850c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:40.313511 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-a237efbc-3f2e-4c9c-b180-f02679798ab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef48f446fd1142d8b9ce986b00fe850c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:40.338827 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:40.364266 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 901/1794] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:32:39 2022] DELETE /identity/v3/users/ef48f446fd1142d8b9ce986b00fe850c => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:40.367440 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237efbc-3f2e-4c9c-b180-f02679798ab1 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:40.370813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-a237efbc-3f2e-4c9c-b180-f02679798ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:40.421164 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c0dad-a220-4a26-a650-51281761987c admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:40.563527 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a1601-67b2-4085-97b7-5e2a998aaeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:40.564566 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a1601-67b2-4085-97b7-5e2a998aaeb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:40.565293 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a1601-67b2-4085-97b7-5e2a998aaeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:40.566789 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a1601-67b2-4085-97b7-5e2a998aaeb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:40.568229 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a1601-67b2-4085-97b7-5e2a998aaeb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:40.571132 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a1601-67b2-4085-97b7-5e2a998aaeb1 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:40.602444 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 894/1795] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 445 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:40.604025 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a1601-67b2-4085-97b7-5e2a998aaeb1 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:40.609465 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-661a1601-67b2-4085-97b7-5e2a998aaeb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:40.622313 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237efbc-3f2e-4c9c-b180-f02679798ab1 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:40.639273 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de187aaf-ea26-4542-bef7-e30a2bd7bdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:40.639976 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de187aaf-ea26-4542-bef7-e30a2bd7bdc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:40.640266 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de187aaf-ea26-4542-bef7-e30a2bd7bdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:40.640543 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de187aaf-ea26-4542-bef7-e30a2bd7bdc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:40.641306 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de187aaf-ea26-4542-bef7-e30a2bd7bdc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:40.647305 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de187aaf-ea26-4542-bef7-e30a2bd7bdc8 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:40.652455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a1601-67b2-4085-97b7-5e2a998aaeb1 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:40.676127 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 902/1796] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:40.676127 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de187aaf-ea26-4542-bef7-e30a2bd7bdc8 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:40.676751 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23012c5b-2b57-4425-90f2-215cbe717d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:40.679453 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-de187aaf-ea26-4542-bef7-e30a2bd7bdc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:40.679692 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23012c5b-2b57-4425-90f2-215cbe717d36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:40.680240 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23012c5b-2b57-4425-90f2-215cbe717d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:40.681331 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23012c5b-2b57-4425-90f2-215cbe717d36 admin admin] PATH_INFO: `/v3/projects/e8f64b2d281a437db5a8b5038378e376/users/e1e7f4b1154b474da051a75a6084e473/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:40.730138 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23012c5b-2b57-4425-90f2-215cbe717d36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f64b2d281a437db5a8b5038378e376, user_id=e1e7f4b1154b474da051a75a6084e473, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:40.736948 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23012c5b-2b57-4425-90f2-215cbe717d36 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:40.783479 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 895/1797] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:40 2022] PUT /identity/v3/projects/e8f64b2d281a437db5a8b5038378e376/users/e1e7f4b1154b474da051a75a6084e473/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:40.789067 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23012c5b-2b57-4425-90f2-215cbe717d36 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:40.795696 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-23012c5b-2b57-4425-90f2-215cbe717d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:40.880746 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:40.949711 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de187aaf-ea26-4542-bef7-e30a2bd7bdc8 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:40.976402 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23012c5b-2b57-4425-90f2-215cbe717d36 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:41.002781 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391cab6-9a03-4017-b847-3533183a55b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:41.003628 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391cab6-9a03-4017-b847-3533183a55b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:41.003909 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391cab6-9a03-4017-b847-3533183a55b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:41.004130 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391cab6-9a03-4017-b847-3533183a55b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:41.004846 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391cab6-9a03-4017-b847-3533183a55b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:41.013223 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391cab6-9a03-4017-b847-3533183a55b9 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:41.076201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 896/1798] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:32:40 2022] POST /identity/v3/users => generated 282 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:41.079277 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d767c-3f41-48d5-82f1-078f63f26a5b None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:41.081508 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d767c-3f41-48d5-82f1-078f63f26a5b None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:41.084444 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d767c-3f41-48d5-82f1-078f63f26a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:41.128202 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-507d767c-3f41-48d5-82f1-078f63f26a5b None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:41.129580 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-507d767c-3f41-48d5-82f1-078f63f26a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:41.150976 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 897/1799] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:41.151689 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d767c-3f41-48d5-82f1-078f63f26a5b None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:41.153336 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-507d767c-3f41-48d5-82f1-078f63f26a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:41.171349 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4af425-36b0-4081-a0bf-666a7a36dc3b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1dceaddb6e414faef0e0448cdf1be8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:41.172293 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4af425-36b0-4081-a0bf-666a7a36dc3b service swift] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:41.172756 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4af425-36b0-4081-a0bf-666a7a36dc3b service swift] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:41.173227 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4af425-36b0-4081-a0bf-666a7a36dc3b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:41.177366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-aa4af425-36b0-4081-a0bf-666a7a36dc3b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:41.221847 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d767c-3f41-48d5-82f1-078f63f26a5b None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:41.230403 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:41.265642 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79813892-6202-41ef-96e3-c73185d7bb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:41.267205 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79813892-6202-41ef-96e3-c73185d7bb6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:41.267842 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79813892-6202-41ef-96e3-c73185d7bb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:41.268362 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79813892-6202-41ef-96e3-c73185d7bb6a admin admin] PATH_INFO: `/v3/projects/3c89e2c3fd334d3eb61040ef67927464/users/c364c0140c1f4858a10d22dc200f383a/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:41.339339 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4af425-36b0-4081-a0bf-666a7a36dc3b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:41.343525 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4af425-36b0-4081-a0bf-666a7a36dc3b service swift] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:41.361661 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79813892-6202-41ef-96e3-c73185d7bb6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c89e2c3fd334d3eb61040ef67927464, user_id=c364c0140c1f4858a10d22dc200f383a, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:41.366911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79813892-6202-41ef-96e3-c73185d7bb6a admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:41.382601 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 903/1800] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jul 19 15:32:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 711 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:32:41.385668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4af425-36b0-4081-a0bf-666a7a36dc3b service swift] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:41.430236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 898/1801] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:41 2022] PUT /identity/v3/projects/3c89e2c3fd334d3eb61040ef67927464/users/c364c0140c1f4858a10d22dc200f383a/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:41.431744 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4af425-36b0-4081-a0bf-666a7a36dc3b service swift] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:41.431950 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79813892-6202-41ef-96e3-c73185d7bb6a admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:41.665566 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07bf8d-58ce-4f47-9b71-58301a0a7f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:41.665566 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07bf8d-58ce-4f47-9b71-58301a0a7f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:41.665566 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07bf8d-58ce-4f47-9b71-58301a0a7f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:41.665566 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07bf8d-58ce-4f47-9b71-58301a0a7f25 admin admin] PATH_INFO: `/v3/projects/46e95f1607e948e49be498a787497306/users/e0e9f1c4d685483d9807a2c87d443474/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:41.668744 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07bf8d-58ce-4f47-9b71-58301a0a7f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46e95f1607e948e49be498a787497306, user_id=e0e9f1c4d685483d9807a2c87d443474, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:41.677209 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07bf8d-58ce-4f47-9b71-58301a0a7f25 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:41.704904 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 904/1802] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:41 2022] PUT /identity/v3/projects/46e95f1607e948e49be498a787497306/users/e0e9f1c4d685483d9807a2c87d443474/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:41.706204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7d829-9c04-407e-8c34-a7a6e28aefb5 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:41.707128 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7d829-9c04-407e-8c34-a7a6e28aefb5 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:41.717215 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7d829-9c04-407e-8c34-a7a6e28aefb5 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:41.719089 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 905/1803] 10.222.0.44 () {54 vars in 912 bytes} [Tue Jul 19 15:32:41 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:41.720130 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7d829-9c04-407e-8c34-a7a6e28aefb5 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:41.752954 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79813892-6202-41ef-96e3-c73185d7bb6a admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:41.904925 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7d829-9c04-407e-8c34-a7a6e28aefb5 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:41.923756 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207a28c-a825-4f2c-a2ab-a413d255c8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:41.924580 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207a28c-a825-4f2c-a2ab-a413d255c8aa admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:41.925748 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207a28c-a825-4f2c-a2ab-a413d255c8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:41.925748 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207a28c-a825-4f2c-a2ab-a413d255c8aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:41.926181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207a28c-a825-4f2c-a2ab-a413d255c8aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:41.928045 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207a28c-a825-4f2c-a2ab-a413d255c8aa admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:41.981888 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 906/1804] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:41.983202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207a28c-a825-4f2c-a2ab-a413d255c8aa admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:41.994566 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-1207a28c-a825-4f2c-a2ab-a413d255c8aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:42.025272 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857190f-b58a-46c0-ade2-64b0460bb5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:42.025531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857190f-b58a-46c0-ade2-64b0460bb5bf admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:42.031704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857190f-b58a-46c0-ade2-64b0460bb5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:42.032200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857190f-b58a-46c0-ade2-64b0460bb5bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:42.038442 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e857190f-b58a-46c0-ade2-64b0460bb5bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:42.048642 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e857190f-b58a-46c0-ade2-64b0460bb5bf admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:42.105939 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 899/1805] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 675 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:42.108608 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8baff-db5a-4f57-819a-6e3171360593 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:42.111998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8baff-db5a-4f57-819a-6e3171360593 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:42.112494 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8baff-db5a-4f57-819a-6e3171360593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:42.154975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:42.162170 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207a28c-a825-4f2c-a2ab-a413d255c8aa admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:42.179275 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d7104-e0a5-427a-bbc3-f490fa132dc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:42.180014 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d7104-e0a5-427a-bbc3-f490fa132dc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:42.180519 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d7104-e0a5-427a-bbc3-f490fa132dc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:42.180901 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d7104-e0a5-427a-bbc3-f490fa132dc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:42.208666 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d7104-e0a5-427a-bbc3-f490fa132dc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:42.210177 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d7104-e0a5-427a-bbc3-f490fa132dc0 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:42.216331 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-fdc8baff-db5a-4f57-819a-6e3171360593 None None] MFA Rules not processed for user `c364c0140c1f4858a10d22dc200f383a`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:42.218892 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-fdc8baff-db5a-4f57-819a-6e3171360593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:42.249840 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 907/1806] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:42.251894 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229226c-730e-4eaf-a796-024a06c08f98 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:42.252713 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229226c-730e-4eaf-a796-024a06c08f98 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:42.253283 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229226c-730e-4eaf-a796-024a06c08f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:42.286621 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:42.382215 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-f229226c-730e-4eaf-a796-024a06c08f98 None None] MFA Rules not processed for user `e0e9f1c4d685483d9807a2c87d443474`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:42.383889 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-f229226c-730e-4eaf-a796-024a06c08f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:42.516752 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 900/1807] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:42.520267 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06102b-48ee-4690-b9bb-3f4a17eb8f8a None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:42.531668 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06102b-48ee-4690-b9bb-3f4a17eb8f8a None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:42.531993 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06102b-48ee-4690-b9bb-3f4a17eb8f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:42.573795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 908/1808] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:42.574868 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229226c-730e-4eaf-a796-024a06c08f98 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:42.606559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-9f06102b-48ee-4690-b9bb-3f4a17eb8f8a None None] MFA Rules not processed for user `c89e7fbcc22c478c98d74b802f4bf8f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:42.607390 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-9f06102b-48ee-4690-b9bb-3f4a17eb8f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:42.625897 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229226c-730e-4eaf-a796-024a06c08f98 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:42.638008 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b76bf-213e-4a35-b105-dabe45ccca83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:42.639105 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b76bf-213e-4a35-b105-dabe45ccca83 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:42.639631 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b76bf-213e-4a35-b105-dabe45ccca83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:42.640142 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b76bf-213e-4a35-b105-dabe45ccca83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:42.641104 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b76bf-213e-4a35-b105-dabe45ccca83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:42.642783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 901/1809] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jul 19 15:32:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:42.643880 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b76bf-213e-4a35-b105-dabe45ccca83 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:42.644002 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06102b-48ee-4690-b9bb-3f4a17eb8f8a None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:42.673693 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 909/1810] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:42.674954 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b76bf-213e-4a35-b105-dabe45ccca83 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:42.698939 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06102b-48ee-4690-b9bb-3f4a17eb8f8a None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:42.714837 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b76bf-213e-4a35-b105-dabe45ccca83 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:42.721151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7f7f5-9d34-4031-b0a6-cd5098f00246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:42.722730 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7f7f5-9d34-4031-b0a6-cd5098f00246 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:42.723155 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7f7f5-9d34-4031-b0a6-cd5098f00246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:42.723472 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7f7f5-9d34-4031-b0a6-cd5098f00246 admin admin] PATH_INFO: `/v3/projects/e8f64b2d281a437db5a8b5038378e376/users/e1e7f4b1154b474da051a75a6084e473/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:42.735666 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a27dd5-2cef-4b41-bd19-2964b4a0fa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:42.737422 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a27dd5-2cef-4b41-bd19-2964b4a0fa4c admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:42.738776 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a27dd5-2cef-4b41-bd19-2964b4a0fa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:42.740258 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7f7f5-9d34-4031-b0a6-cd5098f00246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f64b2d281a437db5a8b5038378e376, user_id=e1e7f4b1154b474da051a75a6084e473, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:42.741354 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a27dd5-2cef-4b41-bd19-2964b4a0fa4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:42.742970 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7f7f5-9d34-4031-b0a6-cd5098f00246 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:42.748690 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a27dd5-2cef-4b41-bd19-2964b4a0fa4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:42.752139 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a27dd5-2cef-4b41-bd19-2964b4a0fa4c admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:42.786737 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 902/1811] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:42 2022] PUT /identity/v3/projects/e8f64b2d281a437db5a8b5038378e376/users/e1e7f4b1154b474da051a75a6084e473/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:42.787816 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7f7f5-9d34-4031-b0a6-cd5098f00246 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:42.801050 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-3fa7f7f5-9d34-4031-b0a6-cd5098f00246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:42.833993 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 910/1812] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:32:42 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:42.839783 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a27dd5-2cef-4b41-bd19-2964b4a0fa4c admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:43.032109 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7f7f5-9d34-4031-b0a6-cd5098f00246 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:43.071094 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a27dd5-2cef-4b41-bd19-2964b4a0fa4c admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:43.085863 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa41934-1fbe-4ce1-b584-40d6e3469fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:43.086934 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa41934-1fbe-4ce1-b584-40d6e3469fc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:43.087394 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa41934-1fbe-4ce1-b584-40d6e3469fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:43.087685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa41934-1fbe-4ce1-b584-40d6e3469fc3 admin admin] PATH_INFO: `/v3/projects/a4a04b8a0e5248b28ef657bdb3abaf00/users/b6b069ae102042b7b62939d0f7f0203c/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:43.123962 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa41934-1fbe-4ce1-b584-40d6e3469fc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4a04b8a0e5248b28ef657bdb3abaf00, user_id=b6b069ae102042b7b62939d0f7f0203c, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:43.127127 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa41934-1fbe-4ce1-b584-40d6e3469fc3 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:43.188455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 911/1813] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:42 2022] PUT /identity/v3/projects/a4a04b8a0e5248b28ef657bdb3abaf00/users/b6b069ae102042b7b62939d0f7f0203c/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:43.191365 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa41934-1fbe-4ce1-b584-40d6e3469fc3 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:43.192997 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0310bac-ede3-4bad-b489-676ddb55fe0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:43.193673 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0310bac-ede3-4bad-b489-676ddb55fe0a service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:43.193959 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0310bac-ede3-4bad-b489-676ddb55fe0a service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:43.197116 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-6aa41934-1fbe-4ce1-b584-40d6e3469fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:43.206464 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0310bac-ede3-4bad-b489-676ddb55fe0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:43.302596 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:43.389405 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa41934-1fbe-4ce1-b584-40d6e3469fc3 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:43.394432 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9cfb1-2277-4145-9482-94be39fd817e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:43.395405 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9cfb1-2277-4145-9482-94be39fd817e service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:43.396083 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9cfb1-2277-4145-9482-94be39fd817e service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:43.396357 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9cfb1-2277-4145-9482-94be39fd817e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:43.417682 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9cfb1-2277-4145-9482-94be39fd817e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:43.419374 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9cfb1-2277-4145-9482-94be39fd817e service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:43.420777 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0310bac-ede3-4bad-b489-676ddb55fe0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:43.425161 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0310bac-ede3-4bad-b489-676ddb55fe0a service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:43.438721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 912/1814] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:43.440518 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e56d2f-9a9f-465f-b89b-cba5dc8f24a5 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:43.441508 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e56d2f-9a9f-465f-b89b-cba5dc8f24a5 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:43.447742 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e56d2f-9a9f-465f-b89b-cba5dc8f24a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:43.469854 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 903/1815] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:43.471999 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0310bac-ede3-4bad-b489-676ddb55fe0a service cinder] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:43.512307 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0310bac-ede3-4bad-b489-676ddb55fe0a service cinder] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:43.554342 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-86e56d2f-9a9f-465f-b89b-cba5dc8f24a5 None None] MFA Rules not processed for user `e1e7f4b1154b474da051a75a6084e473`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:43.555646 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-86e56d2f-9a9f-465f-b89b-cba5dc8f24a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:43.567580 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:43.783861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 913/1816] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:43 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:43.783861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93d4b3-4a7b-4dc4-af4f-903f882e3ed4 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:43.783861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93d4b3-4a7b-4dc4-af4f-903f882e3ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:43.785269 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93d4b3-4a7b-4dc4-af4f-903f882e3ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:43.800815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd75db-f0e1-49e6-b1ab-59350fd96f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:43.802371 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd75db-f0e1-49e6-b1ab-59350fd96f6c admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:43.802959 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd75db-f0e1-49e6-b1ab-59350fd96f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:43.804227 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd75db-f0e1-49e6-b1ab-59350fd96f6c admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:43.805244 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd75db-f0e1-49e6-b1ab-59350fd96f6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:43.807965 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd75db-f0e1-49e6-b1ab-59350fd96f6c admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:43.859815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 904/1817] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:32:43 2022] POST /identity/v3/users => generated 298 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:43.866701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9166a17-e3d6-4b31-b1ad-4abcf1130d2c None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:43.870093 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9166a17-e3d6-4b31-b1ad-4abcf1130d2c None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:43.871500 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-fa93d4b3-4a7b-4dc4-af4f-903f882e3ed4 None None] MFA Rules not processed for user `b6b069ae102042b7b62939d0f7f0203c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:43.873161 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-fa93d4b3-4a7b-4dc4-af4f-903f882e3ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:43.882397 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9166a17-e3d6-4b31-b1ad-4abcf1130d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:43.952830 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-f9166a17-e3d6-4b31-b1ad-4abcf1130d2c None None] MFA Rules not processed for user `c89e7fbcc22c478c98d74b802f4bf8f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:43.955077 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-f9166a17-e3d6-4b31-b1ad-4abcf1130d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:43.977690 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 905/1818] 10.222.0.40 () {58 vars in 1015 bytes} [Tue Jul 19 15:32:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:43.981192 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9166a17-e3d6-4b31-b1ad-4abcf1130d2c None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:43.992045 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-f9166a17-e3d6-4b31-b1ad-4abcf1130d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:44.149622 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 914/1819] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:43 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:44.151856 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93d4b3-4a7b-4dc4-af4f-903f882e3ed4 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:44.185371 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9166a17-e3d6-4b31-b1ad-4abcf1130d2c None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:44.199647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93d4b3-4a7b-4dc4-af4f-903f882e3ed4 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:44.200367 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604ece9-2c52-45a9-b4ca-9a88f37bced2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:44.201610 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604ece9-2c52-45a9-b4ca-9a88f37bced2 service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:44.202056 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604ece9-2c52-45a9-b4ca-9a88f37bced2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:44.202501 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604ece9-2c52-45a9-b4ca-9a88f37bced2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:44.221465 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7a80b-e5f0-43f6-bbd4-36b98e8d20ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:44.226206 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7a80b-e5f0-43f6-bbd4-36b98e8d20ba admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:44.226498 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7a80b-e5f0-43f6-bbd4-36b98e8d20ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:44.226795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7a80b-e5f0-43f6-bbd4-36b98e8d20ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:44.227603 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af7a80b-e5f0-43f6-bbd4-36b98e8d20ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:44.228432 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7604ece9-2c52-45a9-b4ca-9a88f37bced2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:44.230912 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7604ece9-2c52-45a9-b4ca-9a88f37bced2 service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:44.234619 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af7a80b-e5f0-43f6-bbd4-36b98e8d20ba admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:44.270953 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 915/1820] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:44.276950 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 906/1821] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:43 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:44.279578 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7a80b-e5f0-43f6-bbd4-36b98e8d20ba admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:44.280620 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604ece9-2c52-45a9-b4ca-9a88f37bced2 service cinder] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:44.302658 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7a80b-e5f0-43f6-bbd4-36b98e8d20ba admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:44.306252 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604ece9-2c52-45a9-b4ca-9a88f37bced2 service cinder] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:44.320616 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a40a0e-4059-4fe5-8dc8-6f6d9015eb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:44.321333 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a40a0e-4059-4fe5-8dc8-6f6d9015eb6a admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:44.321620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a40a0e-4059-4fe5-8dc8-6f6d9015eb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:44.321911 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a40a0e-4059-4fe5-8dc8-6f6d9015eb6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:44.322638 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a40a0e-4059-4fe5-8dc8-6f6d9015eb6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:44.324633 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a40a0e-4059-4fe5-8dc8-6f6d9015eb6a admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:44.324922 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0999fa-4321-4b4c-bd79-d2464c639527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:44.326184 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0999fa-4321-4b4c-bd79-d2464c639527 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:44.326677 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0999fa-4321-4b4c-bd79-d2464c639527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:44.327117 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0999fa-4321-4b4c-bd79-d2464c639527 admin admin] PATH_INFO: `/v3/projects/ef68946cea62434e99555021c5d693a6/users/6a681790ec7145be9a3811748d55e558/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:44.380956 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 916/1822] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:32:44 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:44.384774 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a40a0e-4059-4fe5-8dc8-6f6d9015eb6a admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:44.404626 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:44.426775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0999fa-4321-4b4c-bd79-d2464c639527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef68946cea62434e99555021c5d693a6, user_id=6a681790ec7145be9a3811748d55e558, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:44.429710 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0999fa-4321-4b4c-bd79-d2464c639527 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:44.472080 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 907/1823] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:44 2022] PUT /identity/v3/projects/ef68946cea62434e99555021c5d693a6/users/6a681790ec7145be9a3811748d55e558/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:44.473609 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0999fa-4321-4b4c-bd79-d2464c639527 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:44.619830 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a40a0e-4059-4fe5-8dc8-6f6d9015eb6a admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:44.635074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0999fa-4321-4b4c-bd79-d2464c639527 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:44.651677 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb6246-ff35-4452-afa2-3ccebedba854 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:44.664277 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb6246-ff35-4452-afa2-3ccebedba854 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:44.664277 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb6246-ff35-4452-afa2-3ccebedba854 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:44.664277 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb6246-ff35-4452-afa2-3ccebedba854 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:44.675154 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb6246-ff35-4452-afa2-3ccebedba854 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:44.683814 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb6246-ff35-4452-afa2-3ccebedba854 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:44.723353 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 908/1824] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:44.724454 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb6246-ff35-4452-afa2-3ccebedba854 service neutron] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:44.779434 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:44.902565 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034bf61a-e92c-48af-978f-09d5f2acc036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:44.903678 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bf61a-e92c-48af-978f-09d5f2acc036 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:44.904707 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bf61a-e92c-48af-978f-09d5f2acc036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:44.907927 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bf61a-e92c-48af-978f-09d5f2acc036 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:44.909218 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034bf61a-e92c-48af-978f-09d5f2acc036 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:44.911837 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034bf61a-e92c-48af-978f-09d5f2acc036 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:44.996303 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 917/1825] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:32:44 2022] POST /identity/v3/users => generated 288 bytes in 611 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:44.997454 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034bf61a-e92c-48af-978f-09d5f2acc036 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:45.002131 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-034bf61a-e92c-48af-978f-09d5f2acc036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:45.042382 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034bf61a-e92c-48af-978f-09d5f2acc036 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:45.052044 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929d716-7254-4814-864b-c1f159d1fdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:45.053094 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929d716-7254-4814-864b-c1f159d1fdff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:45.053387 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929d716-7254-4814-864b-c1f159d1fdff admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:45.053675 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929d716-7254-4814-864b-c1f159d1fdff admin admin] PATH_INFO: `/v3/projects/7b6443a359a7492f80b33518b1d0aa21` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:45.056076 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2929d716-7254-4814-864b-c1f159d1fdff admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b6443a359a7492f80b33518b1d0aa21)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:45.058107 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2929d716-7254-4814-864b-c1f159d1fdff admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:45.067446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb6246-ff35-4452-afa2-3ccebedba854 service neutron] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:45.108716 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b44417-a8dc-45c5-b0fd-6d031f180476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:45.108716 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b44417-a8dc-45c5-b0fd-6d031f180476 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:45.109993 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b44417-a8dc-45c5-b0fd-6d031f180476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:45.110624 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b44417-a8dc-45c5-b0fd-6d031f180476 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:45.114274 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b44417-a8dc-45c5-b0fd-6d031f180476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:45.120709 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b44417-a8dc-45c5-b0fd-6d031f180476 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:45.152231 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 909/1826] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:45.164753 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b44417-a8dc-45c5-b0fd-6d031f180476 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:45.195671 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2929d716-7254-4814-864b-c1f159d1fdff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b6443a359a7492f80b33518b1d0aa21', 'request_id': 'req-2929d716-7254-4814-864b-c1f159d1fdff'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:45.203565 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2929d716-7254-4814-864b-c1f159d1fdff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b6443a359a7492f80b33518b1d0aa21', 'request_id': 'req-2929d716-7254-4814-864b-c1f159d1fdff'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:45.214299 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2929d716-7254-4814-864b-c1f159d1fdff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b6443a359a7492f80b33518b1d0aa21', 'request_id': 'req-2929d716-7254-4814-864b-c1f159d1fdff'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:45.239472 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2929d716-7254-4814-864b-c1f159d1fdff admin admin] The token cache is being invalidate because project 7b6443a359a7492f80b33518b1d0aa21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:32:45.240196 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2929d716-7254-4814-864b-c1f159d1fdff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:45.241228 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2929d716-7254-4814-864b-c1f159d1fdff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:45.243100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 918/1827] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:32:44 2022] DELETE /identity/v3/projects/7b6443a359a7492f80b33518b1d0aa21 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:45.244158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929d716-7254-4814-864b-c1f159d1fdff admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:45.247449 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-2929d716-7254-4814-864b-c1f159d1fdff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:45.306830 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:45.387058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b44417-a8dc-45c5-b0fd-6d031f180476 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:45.404316 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929d716-7254-4814-864b-c1f159d1fdff admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:45.422825 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166c17f-e7e9-4274-8fde-a3a4d2bfe1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:45.423823 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166c17f-e7e9-4274-8fde-a3a4d2bfe1d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:45.424073 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166c17f-e7e9-4274-8fde-a3a4d2bfe1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:45.424415 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166c17f-e7e9-4274-8fde-a3a4d2bfe1d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:45.425614 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166c17f-e7e9-4274-8fde-a3a4d2bfe1d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:45.427606 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166c17f-e7e9-4274-8fde-a3a4d2bfe1d4 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:45.478115 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 919/1828] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:45.482798 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166c17f-e7e9-4274-8fde-a3a4d2bfe1d4 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:45.489100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-b166c17f-e7e9-4274-8fde-a3a4d2bfe1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:45.572614 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70adf701-a510-4285-9d3f-ce52b8029ce0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:45.573179 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adf701-a510-4285-9d3f-ce52b8029ce0 service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:45.574531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adf701-a510-4285-9d3f-ce52b8029ce0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:45.575005 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adf701-a510-4285-9d3f-ce52b8029ce0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:45.583357 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-70adf701-a510-4285-9d3f-ce52b8029ce0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:45.624680 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166c17f-e7e9-4274-8fde-a3a4d2bfe1d4 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:45.629802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842eb45-3d1b-4e0e-ad18-beda7cccb57f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:45.630993 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842eb45-3d1b-4e0e-ad18-beda7cccb57f service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:45.631471 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842eb45-3d1b-4e0e-ad18-beda7cccb57f service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:45.631961 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842eb45-3d1b-4e0e-ad18-beda7cccb57f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:45.634478 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-e842eb45-3d1b-4e0e-ad18-beda7cccb57f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:45.667988 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70adf701-a510-4285-9d3f-ce52b8029ce0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:45.669595 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70adf701-a510-4285-9d3f-ce52b8029ce0 service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:45.682430 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 910/1829] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:45 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:45.683587 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70adf701-a510-4285-9d3f-ce52b8029ce0 service cinder] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:45.685197 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-70adf701-a510-4285-9d3f-ce52b8029ce0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:45.709087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70adf701-a510-4285-9d3f-ce52b8029ce0 service cinder] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:45.715148 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da04d2-f947-4311-97c7-f642f31da688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:45.716284 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da04d2-f947-4311-97c7-f642f31da688 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:45.717899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da04d2-f947-4311-97c7-f642f31da688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:45.719792 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da04d2-f947-4311-97c7-f642f31da688 admin admin] PATH_INFO: `/v3/projects/ef68946cea62434e99555021c5d693a6/users/6a681790ec7145be9a3811748d55e558/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:45.725221 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da04d2-f947-4311-97c7-f642f31da688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef68946cea62434e99555021c5d693a6, user_id=6a681790ec7145be9a3811748d55e558, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:45.734151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da04d2-f947-4311-97c7-f642f31da688 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:45.770192 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 911/1830] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:45 2022] PUT /identity/v3/projects/ef68946cea62434e99555021c5d693a6/users/6a681790ec7145be9a3811748d55e558/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:45.771351 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da04d2-f947-4311-97c7-f642f31da688 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:45.781881 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-94da04d2-f947-4311-97c7-f642f31da688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:45.806688 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:45.808829 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842eb45-3d1b-4e0e-ad18-beda7cccb57f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:45.813411 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842eb45-3d1b-4e0e-ad18-beda7cccb57f service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:45.854777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 920/1831] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:45.858215 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b96c7a-47a8-43f4-9315-520846af4021 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:45.860427 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b96c7a-47a8-43f4-9315-520846af4021 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:45.864227 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b96c7a-47a8-43f4-9315-520846af4021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:45.948546 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-11b96c7a-47a8-43f4-9315-520846af4021 None None] MFA Rules not processed for user `dcd12611b7d144e28fa1358f927c9f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:45.953306 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-11b96c7a-47a8-43f4-9315-520846af4021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:46.121976 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da04d2-f947-4311-97c7-f642f31da688 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:46.132685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 921/1832] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:46.137274 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b96c7a-47a8-43f4-9315-520846af4021 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:46.142262 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0f9ac-5644-40e9-a17f-2e7669d88985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:46.149974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0f9ac-5644-40e9-a17f-2e7669d88985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:46.152953 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0f9ac-5644-40e9-a17f-2e7669d88985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:46.153507 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0f9ac-5644-40e9-a17f-2e7669d88985 admin admin] PATH_INFO: `/v3/users/5b7b894016c84c0b9e7a00154d72c9e3` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:46.164378 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0f9ac-5644-40e9-a17f-2e7669d88985 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b7b894016c84c0b9e7a00154d72c9e3)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:46.166229 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b96c7a-47a8-43f4-9315-520846af4021 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:46.173264 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0f9ac-5644-40e9-a17f-2e7669d88985 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:46.181950 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d199d-7064-4245-a570-8080ea0c0772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:46.184337 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d199d-7064-4245-a570-8080ea0c0772 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:46.185444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d199d-7064-4245-a570-8080ea0c0772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:46.187559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d199d-7064-4245-a570-8080ea0c0772 admin admin] PATH_INFO: `/v3/projects/38b483145aba499f95a8db76afada577/users/bd2a160c5ff0459aaa98057c0ba48133/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:46.236100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d199d-7064-4245-a570-8080ea0c0772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38b483145aba499f95a8db76afada577, user_id=bd2a160c5ff0459aaa98057c0ba48133, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:46.243493 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d199d-7064-4245-a570-8080ea0c0772 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:46.292831 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 922/1833] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:46 2022] PUT /identity/v3/projects/38b483145aba499f95a8db76afada577/users/bd2a160c5ff0459aaa98057c0ba48133/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:46.300775 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf542d0d-dfb6-4726-b19a-59e33f4a2ae7 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:46.301631 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf542d0d-dfb6-4726-b19a-59e33f4a2ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:46.302119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf542d0d-dfb6-4726-b19a-59e33f4a2ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:46.318725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:46.414422 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-2fc0f9ac-5644-40e9-a17f-2e7669d88985 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b7b894016c84c0b9e7a00154d72c9e3'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:46.443339 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-cf542d0d-dfb6-4726-b19a-59e33f4a2ae7 None None] MFA Rules not processed for user `6a681790ec7145be9a3811748d55e558`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:46.459456 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-cf542d0d-dfb6-4726-b19a-59e33f4a2ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:46.459571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-2fc0f9ac-5644-40e9-a17f-2e7669d88985 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b7b894016c84c0b9e7a00154d72c9e3'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:46.476973 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-2fc0f9ac-5644-40e9-a17f-2e7669d88985 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b7b894016c84c0b9e7a00154d72c9e3'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:46.477772 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-2fc0f9ac-5644-40e9-a17f-2e7669d88985 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b7b894016c84c0b9e7a00154d72c9e3'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:46.478421 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-2fc0f9ac-5644-40e9-a17f-2e7669d88985 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b7b894016c84c0b9e7a00154d72c9e3'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:46.514532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 912/1834] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:32:45 2022] DELETE /identity/v3/users/5b7b894016c84c0b9e7a00154d72c9e3 => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:46.515736 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0f9ac-5644-40e9-a17f-2e7669d88985 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:46.524320 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-2fc0f9ac-5644-40e9-a17f-2e7669d88985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:46.790840 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0f9ac-5644-40e9-a17f-2e7669d88985 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:46.804689 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e304c-d81b-4825-89e5-650d7d9d5c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:46.805463 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e304c-d81b-4825-89e5-650d7d9d5c88 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:46.805770 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e304c-d81b-4825-89e5-650d7d9d5c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:46.806113 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e304c-d81b-4825-89e5-650d7d9d5c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:46.806880 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e304c-d81b-4825-89e5-650d7d9d5c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:46.809414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e304c-d81b-4825-89e5-650d7d9d5c88 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:46.819961 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 923/1835] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 522 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:46.828026 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 913/1836] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:46.832466 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf542d0d-dfb6-4726-b19a-59e33f4a2ae7 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:46.835998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e304c-d81b-4825-89e5-650d7d9d5c88 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:46.843173 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-387e304c-d81b-4825-89e5-650d7d9d5c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:46.958011 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:47.074062 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e304c-d81b-4825-89e5-650d7d9d5c88 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:47.095338 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a544b0a-cbb5-4d07-b189-a4ede7100ba5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:47.096675 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf542d0d-dfb6-4726-b19a-59e33f4a2ae7 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:47.102889 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a544b0a-cbb5-4d07-b189-a4ede7100ba5 service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:47.104845 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a544b0a-cbb5-4d07-b189-a4ede7100ba5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:47.105589 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a544b0a-cbb5-4d07-b189-a4ede7100ba5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:47.109480 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff147a-ec97-40a8-9d3a-8ee819634039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:47.116349 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff147a-ec97-40a8-9d3a-8ee819634039 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:47.117066 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff147a-ec97-40a8-9d3a-8ee819634039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:47.117249 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff147a-ec97-40a8-9d3a-8ee819634039 admin admin] PATH_INFO: `/v3/projects/38b483145aba499f95a8db76afada577/users/bd2a160c5ff0459aaa98057c0ba48133/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:47.123409 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff147a-ec97-40a8-9d3a-8ee819634039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38b483145aba499f95a8db76afada577, user_id=bd2a160c5ff0459aaa98057c0ba48133, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:47.126297 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff147a-ec97-40a8-9d3a-8ee819634039 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:47.161454 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 924/1837] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:46 2022] PUT /identity/v3/projects/38b483145aba499f95a8db76afada577/users/bd2a160c5ff0459aaa98057c0ba48133/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:32:47.177941 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8761ff-aa49-459c-b6f4-15bfcd889135 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:47.178241 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8761ff-aa49-459c-b6f4-15bfcd889135 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:47.178532 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8761ff-aa49-459c-b6f4-15bfcd889135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:47.260740 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-9d8761ff-aa49-459c-b6f4-15bfcd889135 None None] MFA Rules not processed for user `bd2a160c5ff0459aaa98057c0ba48133`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:47.262287 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-9d8761ff-aa49-459c-b6f4-15bfcd889135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:47.304719 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a544b0a-cbb5-4d07-b189-a4ede7100ba5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:47.309364 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a544b0a-cbb5-4d07-b189-a4ede7100ba5 service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:47.333118 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 914/1838] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:47.408102 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a544b0a-cbb5-4d07-b189-a4ede7100ba5 service cinder] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:47.409717 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-9a544b0a-cbb5-4d07-b189-a4ede7100ba5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:47.436563 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 925/1839] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:47 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:47.440113 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a544b0a-cbb5-4d07-b189-a4ede7100ba5 service cinder] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:47.450439 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8761ff-aa49-459c-b6f4-15bfcd889135 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:47.452653 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-9d8761ff-aa49-459c-b6f4-15bfcd889135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:47.472240 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:47.564625 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72f087-c3ab-474c-9284-3da43c7ebaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:47.565717 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72f087-c3ab-474c-9284-3da43c7ebaa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:47.566778 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72f087-c3ab-474c-9284-3da43c7ebaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:47.567136 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72f087-c3ab-474c-9284-3da43c7ebaa8 admin admin] PATH_INFO: `/v3/users/c364c0140c1f4858a10d22dc200f383a` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:47.569488 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72f087-c3ab-474c-9284-3da43c7ebaa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c364c0140c1f4858a10d22dc200f383a)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:47.572364 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72f087-c3ab-474c-9284-3da43c7ebaa8 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:47.601405 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8761ff-aa49-459c-b6f4-15bfcd889135 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:47.615577 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595a550-b976-4e2d-a609-1da2068abf28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:47.616110 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595a550-b976-4e2d-a609-1da2068abf28 service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:47.619713 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595a550-b976-4e2d-a609-1da2068abf28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:47.620116 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595a550-b976-4e2d-a609-1da2068abf28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:47.654814 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595a550-b976-4e2d-a609-1da2068abf28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:47.656330 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595a550-b976-4e2d-a609-1da2068abf28 service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:47.680171 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-7a72f087-c3ab-474c-9284-3da43c7ebaa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c364c0140c1f4858a10d22dc200f383a'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:47.692786 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 926/1840] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:47 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:32:47.722989 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-7a72f087-c3ab-474c-9284-3da43c7ebaa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c364c0140c1f4858a10d22dc200f383a'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:47.740455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-7a72f087-c3ab-474c-9284-3da43c7ebaa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c364c0140c1f4858a10d22dc200f383a'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:47.741499 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-7a72f087-c3ab-474c-9284-3da43c7ebaa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c364c0140c1f4858a10d22dc200f383a'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:47.742595 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-7a72f087-c3ab-474c-9284-3da43c7ebaa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c364c0140c1f4858a10d22dc200f383a'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:47.758556 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:47.808852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 915/1841] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:32:47 2022] DELETE /identity/v3/users/c364c0140c1f4858a10d22dc200f383a => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:32:47.813805 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ab4f9-f9f5-43e5-bfa1-3d960a8b90cd None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:47.814101 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ab4f9-f9f5-43e5-bfa1-3d960a8b90cd None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:47.814391 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ab4f9-f9f5-43e5-bfa1-3d960a8b90cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:47.870524 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-c52ab4f9-f9f5-43e5-bfa1-3d960a8b90cd None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:47.872806 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-c52ab4f9-f9f5-43e5-bfa1-3d960a8b90cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:48.016399 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 927/1842] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:48.040339 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72f087-c3ab-474c-9284-3da43c7ebaa8 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:48.042251 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-7a72f087-c3ab-474c-9284-3da43c7ebaa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:48.267098 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72f087-c3ab-474c-9284-3da43c7ebaa8 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:48.279798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c43c1-a780-4415-92ad-282e4b5bd833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:48.281091 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c43c1-a780-4415-92ad-282e4b5bd833 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:48.281816 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c43c1-a780-4415-92ad-282e4b5bd833 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:48.282339 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c43c1-a780-4415-92ad-282e4b5bd833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:48.301682 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c43c1-a780-4415-92ad-282e4b5bd833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:48.304103 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c43c1-a780-4415-92ad-282e4b5bd833 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:48.352586 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 916/1843] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:48.515165 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ab4f9-f9f5-43e5-bfa1-3d960a8b90cd None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:48.517420 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-c52ab4f9-f9f5-43e5-bfa1-3d960a8b90cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:48.544988 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ab4f9-f9f5-43e5-bfa1-3d960a8b90cd None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:48.551956 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40605e6d-f205-4a42-88c0-b9637e6b5222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:48.553876 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40605e6d-f205-4a42-88c0-b9637e6b5222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:48.554580 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40605e6d-f205-4a42-88c0-b9637e6b5222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:48.555086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40605e6d-f205-4a42-88c0-b9637e6b5222 admin admin] PATH_INFO: `/v3/projects/bd30c3faf4e34c05bc2fe0c59033229f` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:48.556761 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40605e6d-f205-4a42-88c0-b9637e6b5222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd30c3faf4e34c05bc2fe0c59033229f)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:48.559278 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40605e6d-f205-4a42-88c0-b9637e6b5222 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:48.779775 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-40605e6d-f205-4a42-88c0-b9637e6b5222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd30c3faf4e34c05bc2fe0c59033229f', 'request_id': 'req-40605e6d-f205-4a42-88c0-b9637e6b5222'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:48.808596 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-40605e6d-f205-4a42-88c0-b9637e6b5222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd30c3faf4e34c05bc2fe0c59033229f', 'request_id': 'req-40605e6d-f205-4a42-88c0-b9637e6b5222'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:48.829858 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-40605e6d-f205-4a42-88c0-b9637e6b5222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd30c3faf4e34c05bc2fe0c59033229f', 'request_id': 'req-40605e6d-f205-4a42-88c0-b9637e6b5222'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:48.872652 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-40605e6d-f205-4a42-88c0-b9637e6b5222 admin admin] The token cache is being invalidate because project bd30c3faf4e34c05bc2fe0c59033229f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:32:48.882621 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-40605e6d-f205-4a42-88c0-b9637e6b5222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:48.884352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-40605e6d-f205-4a42-88c0-b9637e6b5222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:48.889406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 928/1844] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:32:48 2022] DELETE /identity/v3/projects/bd30c3faf4e34c05bc2fe0c59033229f => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:48.895542 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2557ae-fb06-4ad6-9b98-16f15150b22b None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:48.896518 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2557ae-fb06-4ad6-9b98-16f15150b22b None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:48.897074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2557ae-fb06-4ad6-9b98-16f15150b22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:48.968057 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-0f2557ae-fb06-4ad6-9b98-16f15150b22b None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:48.975284 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-0f2557ae-fb06-4ad6-9b98-16f15150b22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:49.134868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 917/1845] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:49.147784 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e53ac8-b9ba-4c02-aa0b-70bc92db351d None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:49.148356 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e53ac8-b9ba-4c02-aa0b-70bc92db351d None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:49.149048 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e53ac8-b9ba-4c02-aa0b-70bc92db351d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:49.165686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2557ae-fb06-4ad6-9b98-16f15150b22b None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:49.167697 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-0f2557ae-fb06-4ad6-9b98-16f15150b22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:49.259698 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2557ae-fb06-4ad6-9b98-16f15150b22b None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:49.283200 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-11e53ac8-b9ba-4c02-aa0b-70bc92db351d None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:49.291142 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506955cb-9936-4249-83b9-784d0a8bcbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:49.292330 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506955cb-9936-4249-83b9-784d0a8bcbcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:49.292659 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506955cb-9936-4249-83b9-784d0a8bcbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:49.293084 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506955cb-9936-4249-83b9-784d0a8bcbcc admin admin] PATH_INFO: `/v3/users/b6b069ae102042b7b62939d0f7f0203c` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:49.299555 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-11e53ac8-b9ba-4c02-aa0b-70bc92db351d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:49.307722 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506955cb-9936-4249-83b9-784d0a8bcbcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6b069ae102042b7b62939d0f7f0203c)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:49.310680 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506955cb-9936-4249-83b9-784d0a8bcbcc admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:49.347244 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 929/1846] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:32:49.352508 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e53ac8-b9ba-4c02-aa0b-70bc92db351d None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:49.444070 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e53ac8-b9ba-4c02-aa0b-70bc92db351d None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:49.487117 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c73ed8-8073-471e-ad17-cf2dec79b28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:49.487985 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c73ed8-8073-471e-ad17-cf2dec79b28d admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:49.494240 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c73ed8-8073-471e-ad17-cf2dec79b28d admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:49.494470 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c73ed8-8073-471e-ad17-cf2dec79b28d admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:49.495392 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c73ed8-8073-471e-ad17-cf2dec79b28d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:49.495787 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c73ed8-8073-471e-ad17-cf2dec79b28d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:49.497473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c73ed8-8073-471e-ad17-cf2dec79b28d admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:49.499643 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-506955cb-9936-4249-83b9-784d0a8bcbcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6b069ae102042b7b62939d0f7f0203c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:49.525819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-506955cb-9936-4249-83b9-784d0a8bcbcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6b069ae102042b7b62939d0f7f0203c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:49.543306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-506955cb-9936-4249-83b9-784d0a8bcbcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6b069ae102042b7b62939d0f7f0203c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:49.545660 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-506955cb-9936-4249-83b9-784d0a8bcbcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6b069ae102042b7b62939d0f7f0203c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:49.546830 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-506955cb-9936-4249-83b9-784d0a8bcbcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6b069ae102042b7b62939d0f7f0203c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:49.590369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 930/1847] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:49.600656 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 918/1848] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:32:49 2022] DELETE /identity/v3/users/b6b069ae102042b7b62939d0f7f0203c => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:49.603259 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c73ed8-8073-471e-ad17-cf2dec79b28d admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:49.605286 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c1536-5c88-469e-b3dd-bafcfa9cb3fb None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:49.605654 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c1536-5c88-469e-b3dd-bafcfa9cb3fb None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:49.605986 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c1536-5c88-469e-b3dd-bafcfa9cb3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:49.614344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-85c73ed8-8073-471e-ad17-cf2dec79b28d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:49.646061 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:49.673198 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c73ed8-8073-471e-ad17-cf2dec79b28d admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:49.694431 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-b67c1536-5c88-469e-b3dd-bafcfa9cb3fb None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:49.701052 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-b67c1536-5c88-469e-b3dd-bafcfa9cb3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:49.706590 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:49.858474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094b2b5-93f7-43da-b450-5c78b4a1a6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:49.859794 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094b2b5-93f7-43da-b450-5c78b4a1a6e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:49.860402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094b2b5-93f7-43da-b450-5c78b4a1a6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:49.863835 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094b2b5-93f7-43da-b450-5c78b4a1a6e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:49.865211 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094b2b5-93f7-43da-b450-5c78b4a1a6e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:49.888921 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094b2b5-93f7-43da-b450-5c78b4a1a6e6 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:49.956022 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 919/1849] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:49.985319 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 931/1850] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:32:49 2022] POST /identity/v3/projects => generated 383 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:49.990760 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c1536-5c88-469e-b3dd-bafcfa9cb3fb None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:50.010944 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f97b4-6e48-4d53-a5d4-d9aa042b115f None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:50.011345 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f97b4-6e48-4d53-a5d4-d9aa042b115f None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:50.011839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f97b4-6e48-4d53-a5d4-d9aa042b115f None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:50.013712 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 932/1851] 10.222.0.44 () {54 vars in 921 bytes} [Tue Jul 19 15:32:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:50.017293 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c1536-5c88-469e-b3dd-bafcfa9cb3fb None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:50.029271 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f97b4-6e48-4d53-a5d4-d9aa042b115f None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:50.045928 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-ff8f97b4-6e48-4d53-a5d4-d9aa042b115f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:50.204412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789def7d-a70c-4fa4-8079-d87dfbe5905f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:50.205312 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789def7d-a70c-4fa4-8079-d87dfbe5905f admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:50.205679 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789def7d-a70c-4fa4-8079-d87dfbe5905f admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:50.206019 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789def7d-a70c-4fa4-8079-d87dfbe5905f admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:50.208254 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789def7d-a70c-4fa4-8079-d87dfbe5905f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:50.210361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789def7d-a70c-4fa4-8079-d87dfbe5905f admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:50.235093 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f97b4-6e48-4d53-a5d4-d9aa042b115f None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:50.246274 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336fc55-c203-4b16-a8c5-5a0efe6e75b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:50.247119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336fc55-c203-4b16-a8c5-5a0efe6e75b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:50.247586 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336fc55-c203-4b16-a8c5-5a0efe6e75b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:50.247992 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336fc55-c203-4b16-a8c5-5a0efe6e75b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:50.272350 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1336fc55-c203-4b16-a8c5-5a0efe6e75b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:50.275555 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1336fc55-c203-4b16-a8c5-5a0efe6e75b3 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:50.301421 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 933/1852] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:50.303263 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ae1ec-b930-4830-99b8-17535775fdf0 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:50.303491 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ae1ec-b930-4830-99b8-17535775fdf0 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:50.304127 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ae1ec-b930-4830-99b8-17535775fdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:50.310044 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 920/1853] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:32:49 2022] POST /identity/v3/users => generated 292 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:32:50.313921 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789def7d-a70c-4fa4-8079-d87dfbe5905f admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:50.350448 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-538ae1ec-b930-4830-99b8-17535775fdf0 None None] MFA Rules not processed for user `fef0511f56144ca9945b2dddfa2601a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:50.352547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-538ae1ec-b930-4830-99b8-17535775fdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:50.361009 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789def7d-a70c-4fa4-8079-d87dfbe5905f admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:50.389643 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be27fb2-b9d1-4876-a9c6-1ebfe5bdc0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:50.390392 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be27fb2-b9d1-4876-a9c6-1ebfe5bdc0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:50.394715 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be27fb2-b9d1-4876-a9c6-1ebfe5bdc0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:50.394715 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be27fb2-b9d1-4876-a9c6-1ebfe5bdc0b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:50.394715 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be27fb2-b9d1-4876-a9c6-1ebfe5bdc0b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:50.400240 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be27fb2-b9d1-4876-a9c6-1ebfe5bdc0b7 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:50.447078 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 921/1854] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:50.449181 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be27fb2-b9d1-4876-a9c6-1ebfe5bdc0b7 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:50.471152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be27fb2-b9d1-4876-a9c6-1ebfe5bdc0b7 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:50.488274 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702abeff-a76d-40e7-96ed-cf6f2ffb14d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:50.490092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702abeff-a76d-40e7-96ed-cf6f2ffb14d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:50.490431 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702abeff-a76d-40e7-96ed-cf6f2ffb14d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:50.490701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702abeff-a76d-40e7-96ed-cf6f2ffb14d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:50.493799 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702abeff-a76d-40e7-96ed-cf6f2ffb14d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:50.516293 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702abeff-a76d-40e7-96ed-cf6f2ffb14d2 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:50.558877 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 922/1855] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:50.568263 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702abeff-a76d-40e7-96ed-cf6f2ffb14d2 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:50.601088 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702abeff-a76d-40e7-96ed-cf6f2ffb14d2 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:50.621507 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed9521-6af7-4cbf-adcd-17ef530c84db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:50.622591 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed9521-6af7-4cbf-adcd-17ef530c84db admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:50.622952 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed9521-6af7-4cbf-adcd-17ef530c84db admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:50.623676 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed9521-6af7-4cbf-adcd-17ef530c84db admin admin] PATH_INFO: `/v3/projects/8725398731914f85bc7e8007af14b039/users/cf1b4843f2c8409eb6db58d614acdc7c/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:50.630291 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 934/1856] 10.222.0.44 () {58 vars in 1018 bytes} [Tue Jul 19 15:32:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:50.709633 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed9521-6af7-4cbf-adcd-17ef530c84db admin admin] RBAC: Authorizing `identity:create_grant(project_id=8725398731914f85bc7e8007af14b039, user_id=cf1b4843f2c8409eb6db58d614acdc7c, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:50.760361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed9521-6af7-4cbf-adcd-17ef530c84db admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:50.816690 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ae1ec-b930-4830-99b8-17535775fdf0 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:50.818304 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-538ae1ec-b930-4830-99b8-17535775fdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:50.857424 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ae1ec-b930-4830-99b8-17535775fdf0 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:50.890559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 923/1857] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:50 2022] PUT /identity/v3/projects/8725398731914f85bc7e8007af14b039/users/cf1b4843f2c8409eb6db58d614acdc7c/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:50.900440 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca58a19-e8e9-4085-a8d6-83cbb4c5b884 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:50.903303 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca58a19-e8e9-4085-a8d6-83cbb4c5b884 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:50.919438 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca58a19-e8e9-4085-a8d6-83cbb4c5b884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:50.988448 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:51.087255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-4ca58a19-e8e9-4085-a8d6-83cbb4c5b884 None None] MFA Rules not processed for user `cf1b4843f2c8409eb6db58d614acdc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:51.093192 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-4ca58a19-e8e9-4085-a8d6-83cbb4c5b884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:51.095314 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58f5d3-b0c8-4462-bf6b-46f4b3ad52e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:51.096229 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58f5d3-b0c8-4462-bf6b-46f4b3ad52e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:51.096514 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58f5d3-b0c8-4462-bf6b-46f4b3ad52e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:51.098345 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58f5d3-b0c8-4462-bf6b-46f4b3ad52e1 admin admin] PATH_INFO: `/v3/projects/3c89e2c3fd334d3eb61040ef67927464` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:51.105120 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c58f5d3-b0c8-4462-bf6b-46f4b3ad52e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c89e2c3fd334d3eb61040ef67927464)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:51.105120 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c58f5d3-b0c8-4462-bf6b-46f4b3ad52e1 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:51.277634 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:51.304440 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-6c58f5d3-b0c8-4462-bf6b-46f4b3ad52e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c89e2c3fd334d3eb61040ef67927464', 'request_id': 'req-6c58f5d3-b0c8-4462-bf6b-46f4b3ad52e1'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:51.353167 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-6c58f5d3-b0c8-4462-bf6b-46f4b3ad52e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c89e2c3fd334d3eb61040ef67927464', 'request_id': 'req-6c58f5d3-b0c8-4462-bf6b-46f4b3ad52e1'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:51.378484 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-6c58f5d3-b0c8-4462-bf6b-46f4b3ad52e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c89e2c3fd334d3eb61040ef67927464', 'request_id': 'req-6c58f5d3-b0c8-4462-bf6b-46f4b3ad52e1'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:51.403129 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 924/1858] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 511 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:51.408975 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca58a19-e8e9-4085-a8d6-83cbb4c5b884 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:51.421104 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-6c58f5d3-b0c8-4462-bf6b-46f4b3ad52e1 admin admin] The token cache is being invalidate because project 3c89e2c3fd334d3eb61040ef67927464 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:32:51.421404 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-6c58f5d3-b0c8-4462-bf6b-46f4b3ad52e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:51.436975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-6c58f5d3-b0c8-4462-bf6b-46f4b3ad52e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:51.441792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 935/1859] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:32:50 2022] DELETE /identity/v3/projects/3c89e2c3fd334d3eb61040ef67927464 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:51.446541 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58f5d3-b0c8-4462-bf6b-46f4b3ad52e1 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:51.455307 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-6c58f5d3-b0c8-4462-bf6b-46f4b3ad52e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:51.477362 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca58a19-e8e9-4085-a8d6-83cbb4c5b884 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:51.698953 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd04b9-64db-4522-b374-6edc96f5256a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:51.701608 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd04b9-64db-4522-b374-6edc96f5256a admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:51.703944 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd04b9-64db-4522-b374-6edc96f5256a admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:51.704346 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd04b9-64db-4522-b374-6edc96f5256a admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:51.705628 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd04b9-64db-4522-b374-6edc96f5256a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:51.714828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd04b9-64db-4522-b374-6edc96f5256a admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:51.716463 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58f5d3-b0c8-4462-bf6b-46f4b3ad52e1 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:51.744272 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf521ee-8852-44ff-b356-a4832be011c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:51.749998 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf521ee-8852-44ff-b356-a4832be011c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:51.750449 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf521ee-8852-44ff-b356-a4832be011c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:51.750853 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf521ee-8852-44ff-b356-a4832be011c7 admin admin] PATH_INFO: `/v3/users/6a681790ec7145be9a3811748d55e558` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:51.759366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf521ee-8852-44ff-b356-a4832be011c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a681790ec7145be9a3811748d55e558)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:51.761413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf521ee-8852-44ff-b356-a4832be011c7 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:51.818938 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 925/1860] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:32:51 2022] POST /identity/v3/projects => generated 385 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:51.820098 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd04b9-64db-4522-b374-6edc96f5256a admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:51.825349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-21cd04b9-64db-4522-b374-6edc96f5256a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:52.021328 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2cf521ee-8852-44ff-b356-a4832be011c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a681790ec7145be9a3811748d55e558'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:52.137071 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2cf521ee-8852-44ff-b356-a4832be011c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a681790ec7145be9a3811748d55e558'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:52.157414 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:52.201380 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2cf521ee-8852-44ff-b356-a4832be011c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a681790ec7145be9a3811748d55e558'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:52.210249 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2cf521ee-8852-44ff-b356-a4832be011c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a681790ec7145be9a3811748d55e558'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:52.211698 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2cf521ee-8852-44ff-b356-a4832be011c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a681790ec7145be9a3811748d55e558'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:52.261380 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 936/1861] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:32:51 2022] DELETE /identity/v3/users/6a681790ec7145be9a3811748d55e558 => generated 0 bytes in 819 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:52.264337 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf521ee-8852-44ff-b356-a4832be011c7 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:52.270427 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-2cf521ee-8852-44ff-b356-a4832be011c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:52.387687 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd04b9-64db-4522-b374-6edc96f5256a admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:52.542171 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf521ee-8852-44ff-b356-a4832be011c7 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:52.570398 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e0c82-5e51-4f27-83d9-9e7271fe51f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:52.571427 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e0c82-5e51-4f27-83d9-9e7271fe51f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:52.571869 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e0c82-5e51-4f27-83d9-9e7271fe51f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:52.572343 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e0c82-5e51-4f27-83d9-9e7271fe51f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:52.573225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e0c82-5e51-4f27-83d9-9e7271fe51f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:52.581486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e0c82-5e51-4f27-83d9-9e7271fe51f4 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:52.632548 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:52.667686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2532d1c-4280-4fb8-8823-b40ec357cd2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:52.668556 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2532d1c-4280-4fb8-8823-b40ec357cd2b service nova] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:52.668874 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2532d1c-4280-4fb8-8823-b40ec357cd2b service nova] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:52.669135 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2532d1c-4280-4fb8-8823-b40ec357cd2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:52.676477 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-b2532d1c-4280-4fb8-8823-b40ec357cd2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:52.698945 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 937/1862] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:32:52 2022] POST /identity/v3/users => generated 293 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:52.705243 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c7df3-e5d3-4869-b606-38723040641d None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:52.705664 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c7df3-e5d3-4869-b606-38723040641d None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:52.706495 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c7df3-e5d3-4869-b606-38723040641d None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:52.706602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2532d1c-4280-4fb8-8823-b40ec357cd2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:52.715781 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2532d1c-4280-4fb8-8823-b40ec357cd2b service nova] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:52.723631 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 938/1863] 10.222.0.44 () {54 vars in 921 bytes} [Tue Jul 19 15:32:52 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:32:52.724645 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c7df3-e5d3-4869-b606-38723040641d None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:52.745053 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 926/1864] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 926 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:52.774564 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c7df3-e5d3-4869-b606-38723040641d None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:52.797419 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687660b3-09d7-47a8-bc0d-d9b93a54ea56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:52.798579 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687660b3-09d7-47a8-bc0d-d9b93a54ea56 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:52.799081 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687660b3-09d7-47a8-bc0d-d9b93a54ea56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:52.799678 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687660b3-09d7-47a8-bc0d-d9b93a54ea56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:52.807042 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687660b3-09d7-47a8-bc0d-d9b93a54ea56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:52.811738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687660b3-09d7-47a8-bc0d-d9b93a54ea56 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:52.872311 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2532d1c-4280-4fb8-8823-b40ec357cd2b service nova] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:52.872956 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 939/1865] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:52.892937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef60d81-4365-4666-a06e-e993deb0bf65 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:52.893332 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef60d81-4365-4666-a06e-e993deb0bf65 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:52.894382 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef60d81-4365-4666-a06e-e993deb0bf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:52.903404 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2532d1c-4280-4fb8-8823-b40ec357cd2b service nova] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:52.918240 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ec8f3-e347-47c2-886f-abfa928c0af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:52.918998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ec8f3-e347-47c2-886f-abfa928c0af5 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:52.919321 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ec8f3-e347-47c2-886f-abfa928c0af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:52.919610 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ec8f3-e347-47c2-886f-abfa928c0af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:52.936021 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ec8f3-e347-47c2-886f-abfa928c0af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:52.937768 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ec8f3-e347-47c2-886f-abfa928c0af5 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:52.961874 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-fef60d81-4365-4666-a06e-e993deb0bf65 None None] MFA Rules not processed for user `fef0511f56144ca9945b2dddfa2601a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:52.964431 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-fef60d81-4365-4666-a06e-e993deb0bf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:52.994488 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 927/1866] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:32:52.997454 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ec8f3-e347-47c2-886f-abfa928c0af5 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:53.012195 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 940/1867] 10.222.0.44 () {58 vars in 1018 bytes} [Tue Jul 19 15:32:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:53.031285 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ec8f3-e347-47c2-886f-abfa928c0af5 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:53.047574 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0916d63-9e26-4a56-abc1-ff5cb90d54ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:53.051507 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0916d63-9e26-4a56-abc1-ff5cb90d54ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:53.054230 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0916d63-9e26-4a56-abc1-ff5cb90d54ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:53.055065 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0916d63-9e26-4a56-abc1-ff5cb90d54ca admin admin] PATH_INFO: `/v3/projects/ed7fc1bc5bcc43f38a82d7a4c7d4b412/users/ac2a5ddaa444421bb03b5bc094133617/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:53.094549 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0916d63-9e26-4a56-abc1-ff5cb90d54ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed7fc1bc5bcc43f38a82d7a4c7d4b412, user_id=ac2a5ddaa444421bb03b5bc094133617, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:53.101947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0916d63-9e26-4a56-abc1-ff5cb90d54ca admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:53.139174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 928/1868] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:52 2022] PUT /identity/v3/projects/ed7fc1bc5bcc43f38a82d7a4c7d4b412/users/ac2a5ddaa444421bb03b5bc094133617/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:53.164475 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d9a96-f4ec-4764-b166-870ba74bc586 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:53.164951 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d9a96-f4ec-4764-b166-870ba74bc586 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:53.165400 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d9a96-f4ec-4764-b166-870ba74bc586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:53.220678 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-345d9a96-f4ec-4764-b166-870ba74bc586 None None] MFA Rules not processed for user `ac2a5ddaa444421bb03b5bc094133617`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:53.223915 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-345d9a96-f4ec-4764-b166-870ba74bc586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:53.438246 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 941/1869] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:53.445642 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0916d63-9e26-4a56-abc1-ff5cb90d54ca admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:53.493879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d9a96-f4ec-4764-b166-870ba74bc586 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:53.496339 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-345d9a96-f4ec-4764-b166-870ba74bc586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:53.688736 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:53.723246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0916d63-9e26-4a56-abc1-ff5cb90d54ca admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:53.753515 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac596d-2e16-4d64-9108-55ffabc63ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:53.753992 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac596d-2e16-4d64-9108-55ffabc63ccf admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:53.754281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac596d-2e16-4d64-9108-55ffabc63ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:53.762214 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac596d-2e16-4d64-9108-55ffabc63ccf admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:53.764133 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac596d-2e16-4d64-9108-55ffabc63ccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:53.776102 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac596d-2e16-4d64-9108-55ffabc63ccf admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:53.819894 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d9a96-f4ec-4764-b166-870ba74bc586 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:53.849861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c10b84-4968-441b-a225-d0f731bbd483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:53.856300 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c10b84-4968-441b-a225-d0f731bbd483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:53.856831 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c10b84-4968-441b-a225-d0f731bbd483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:53.857255 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c10b84-4968-441b-a225-d0f731bbd483 admin admin] PATH_INFO: `/v3/projects/a4a04b8a0e5248b28ef657bdb3abaf00` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:53.864807 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c10b84-4968-441b-a225-d0f731bbd483 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4a04b8a0e5248b28ef657bdb3abaf00)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:53.866853 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c10b84-4968-441b-a225-d0f731bbd483 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:53.913986 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 929/1870] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:32:53 2022] POST /identity/v3/projects => generated 385 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:53.917081 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac596d-2e16-4d64-9108-55ffabc63ccf admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:54.049080 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-f5c10b84-4968-441b-a225-d0f731bbd483 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4a04b8a0e5248b28ef657bdb3abaf00', 'request_id': 'req-f5c10b84-4968-441b-a225-d0f731bbd483'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:54.084100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-f5c10b84-4968-441b-a225-d0f731bbd483 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4a04b8a0e5248b28ef657bdb3abaf00', 'request_id': 'req-f5c10b84-4968-441b-a225-d0f731bbd483'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:54.124187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-f5c10b84-4968-441b-a225-d0f731bbd483 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4a04b8a0e5248b28ef657bdb3abaf00', 'request_id': 'req-f5c10b84-4968-441b-a225-d0f731bbd483'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:54.180130 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-f5c10b84-4968-441b-a225-d0f731bbd483 admin admin] The token cache is being invalidate because project a4a04b8a0e5248b28ef657bdb3abaf00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:32:54.182300 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-f5c10b84-4968-441b-a225-d0f731bbd483 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:54.186177 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-f5c10b84-4968-441b-a225-d0f731bbd483 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:54.193357 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 942/1871] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:32:53 2022] DELETE /identity/v3/projects/a4a04b8a0e5248b28ef657bdb3abaf00 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:54.205199 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c10b84-4968-441b-a225-d0f731bbd483 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:54.209761 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac596d-2e16-4d64-9108-55ffabc63ccf admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:54.214043 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-f5c10b84-4968-441b-a225-d0f731bbd483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:54.438046 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:54.489106 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f95a6d-0c40-4fda-b006-60078b72f4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:54.490068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f95a6d-0c40-4fda-b006-60078b72f4f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:54.490500 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f95a6d-0c40-4fda-b006-60078b72f4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:54.493491 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f95a6d-0c40-4fda-b006-60078b72f4f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:54.498177 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f95a6d-0c40-4fda-b006-60078b72f4f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:54.502482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f95a6d-0c40-4fda-b006-60078b72f4f5 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:54.592905 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 930/1872] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:32:53 2022] POST /identity/v3/users => generated 299 bytes in 678 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:54.604716 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f95a6d-0c40-4fda-b006-60078b72f4f5 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:54.611168 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-54f95a6d-0c40-4fda-b006-60078b72f4f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:54.643205 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c10b84-4968-441b-a225-d0f731bbd483 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:54.655640 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ddd84-44ed-4f6a-b180-8451aad2411e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:54.656652 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ddd84-44ed-4f6a-b180-8451aad2411e service nova] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:54.657271 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ddd84-44ed-4f6a-b180-8451aad2411e service nova] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:54.657780 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ddd84-44ed-4f6a-b180-8451aad2411e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:54.660914 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-1b6ddd84-44ed-4f6a-b180-8451aad2411e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:54.661077 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f95a6d-0c40-4fda-b006-60078b72f4f5 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:54.686507 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ddd84-44ed-4f6a-b180-8451aad2411e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:54.688557 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ddd84-44ed-4f6a-b180-8451aad2411e service nova] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:54.700504 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cc176-68a0-47b7-addb-c1c06c79abe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:54.701479 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cc176-68a0-47b7-addb-c1c06c79abe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:54.701769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cc176-68a0-47b7-addb-c1c06c79abe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:54.702055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cc176-68a0-47b7-addb-c1c06c79abe7 admin admin] PATH_INFO: `/v3/users/bd2a160c5ff0459aaa98057c0ba48133` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:54.703067 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 943/1873] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:54.703454 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68cc176-68a0-47b7-addb-c1c06c79abe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd2a160c5ff0459aaa98057c0ba48133)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:54.704573 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ddd84-44ed-4f6a-b180-8451aad2411e service nova] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:54.705437 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68cc176-68a0-47b7-addb-c1c06c79abe7 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:54.706591 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-1b6ddd84-44ed-4f6a-b180-8451aad2411e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:54.723961 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ddd84-44ed-4f6a-b180-8451aad2411e service nova] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:54.729614 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d26210-eef5-46dc-8834-7d2b7429b38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:54.730701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d26210-eef5-46dc-8834-7d2b7429b38e admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:54.731127 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d26210-eef5-46dc-8834-7d2b7429b38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:54.731567 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d26210-eef5-46dc-8834-7d2b7429b38e admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:54.732451 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d26210-eef5-46dc-8834-7d2b7429b38e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:54.734241 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d26210-eef5-46dc-8834-7d2b7429b38e admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:54.751326 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 944/1874] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:54.752440 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d26210-eef5-46dc-8834-7d2b7429b38e admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:54.772187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d26210-eef5-46dc-8834-7d2b7429b38e admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:54.788000 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7af9af-e11a-4c28-a61e-aa8180bbaddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:54.789097 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7af9af-e11a-4c28-a61e-aa8180bbaddd admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:54.789497 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7af9af-e11a-4c28-a61e-aa8180bbaddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:54.790021 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7af9af-e11a-4c28-a61e-aa8180bbaddd admin admin] PATH_INFO: `/v3/projects/a3ec4e48dd2746d0a2771a290be76907/users/614fab54bfb4434ab6faea9bb0416973/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:54.831897 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7af9af-e11a-4c28-a61e-aa8180bbaddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3ec4e48dd2746d0a2771a290be76907, user_id=614fab54bfb4434ab6faea9bb0416973, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:54.837673 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7af9af-e11a-4c28-a61e-aa8180bbaddd admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:54.863537 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-a68cc176-68a0-47b7-addb-c1c06c79abe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd2a160c5ff0459aaa98057c0ba48133'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:54.875644 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 945/1875] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:54 2022] PUT /identity/v3/projects/a3ec4e48dd2746d0a2771a290be76907/users/614fab54bfb4434ab6faea9bb0416973/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:54.876795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7af9af-e11a-4c28-a61e-aa8180bbaddd admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:54.921910 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-a68cc176-68a0-47b7-addb-c1c06c79abe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd2a160c5ff0459aaa98057c0ba48133'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:54.971194 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-a68cc176-68a0-47b7-addb-c1c06c79abe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd2a160c5ff0459aaa98057c0ba48133'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:54.973282 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-a68cc176-68a0-47b7-addb-c1c06c79abe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd2a160c5ff0459aaa98057c0ba48133'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:54.976484 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-a68cc176-68a0-47b7-addb-c1c06c79abe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd2a160c5ff0459aaa98057c0ba48133'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:54.985326 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:55.049118 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 931/1876] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:32:54 2022] DELETE /identity/v3/users/bd2a160c5ff0459aaa98057c0ba48133 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:55.050228 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cc176-68a0-47b7-addb-c1c06c79abe7 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:55.058025 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-a68cc176-68a0-47b7-addb-c1c06c79abe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:55.061401 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7af9af-e11a-4c28-a61e-aa8180bbaddd admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:55.165586 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6fe87-2db7-43e9-a4d5-d11efdd9ff2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:55.167700 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6fe87-2db7-43e9-a4d5-d11efdd9ff2a admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:55.169444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6fe87-2db7-43e9-a4d5-d11efdd9ff2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:55.170997 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6fe87-2db7-43e9-a4d5-d11efdd9ff2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:55.172201 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6fe87-2db7-43e9-a4d5-d11efdd9ff2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:55.174575 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6fe87-2db7-43e9-a4d5-d11efdd9ff2a admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:55.211535 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 946/1877] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:55.212848 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6fe87-2db7-43e9-a4d5-d11efdd9ff2a admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:55.216871 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-aac6fe87-2db7-43e9-a4d5-d11efdd9ff2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:55.248958 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6fe87-2db7-43e9-a4d5-d11efdd9ff2a admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:55.266940 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69567b-25e5-42fc-b97c-afb85b95d01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:55.268067 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69567b-25e5-42fc-b97c-afb85b95d01c admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:55.268524 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69567b-25e5-42fc-b97c-afb85b95d01c admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:55.268898 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69567b-25e5-42fc-b97c-afb85b95d01c admin admin] PATH_INFO: `/v3/projects/a3ec4e48dd2746d0a2771a290be76907/users/614fab54bfb4434ab6faea9bb0416973/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:55.273637 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69567b-25e5-42fc-b97c-afb85b95d01c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3ec4e48dd2746d0a2771a290be76907, user_id=614fab54bfb4434ab6faea9bb0416973, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:55.276226 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cc176-68a0-47b7-addb-c1c06c79abe7 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:55.281423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69567b-25e5-42fc-b97c-afb85b95d01c admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:55.294659 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56c1e4-ae3a-4558-93f0-830158b67f00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:55.295402 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56c1e4-ae3a-4558-93f0-830158b67f00 service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:55.295695 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56c1e4-ae3a-4558-93f0-830158b67f00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:55.295976 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56c1e4-ae3a-4558-93f0-830158b67f00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:55.300904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-be56c1e4-ae3a-4558-93f0-830158b67f00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:55.341292 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 947/1878] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:55 2022] PUT /identity/v3/projects/a3ec4e48dd2746d0a2771a290be76907/users/614fab54bfb4434ab6faea9bb0416973/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:55.348249 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeaf9dc-a585-4136-820b-0d8092ee7db0 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:55.348916 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeaf9dc-a585-4136-820b-0d8092ee7db0 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:55.355633 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeaf9dc-a585-4136-820b-0d8092ee7db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:55.504363 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-dbeaf9dc-a585-4136-820b-0d8092ee7db0 None None] MFA Rules not processed for user `614fab54bfb4434ab6faea9bb0416973`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:55.510585 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-dbeaf9dc-a585-4136-820b-0d8092ee7db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:55.521026 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56c1e4-ae3a-4558-93f0-830158b67f00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:55.526889 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56c1e4-ae3a-4558-93f0-830158b67f00 service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:55.554571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 932/1879] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:55.558808 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56c1e4-ae3a-4558-93f0-830158b67f00 service cinder] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:55.560326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-be56c1e4-ae3a-4558-93f0-830158b67f00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:55.570944 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:55.580336 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56c1e4-ae3a-4558-93f0-830158b67f00 service cinder] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:55.757462 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb618d7c-07d3-4444-b465-8fbff32c0e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:55.758576 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb618d7c-07d3-4444-b465-8fbff32c0e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:55.758875 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb618d7c-07d3-4444-b465-8fbff32c0e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:55.759178 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb618d7c-07d3-4444-b465-8fbff32c0e98 admin admin] PATH_INFO: `/v3/users/f44c5f26820b48579d9b63311b5b017c` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:55.765287 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb618d7c-07d3-4444-b465-8fbff32c0e98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f44c5f26820b48579d9b63311b5b017c)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:55.767314 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb618d7c-07d3-4444-b465-8fbff32c0e98 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:55.923253 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 948/1880] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 579 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:55.937290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeaf9dc-a585-4136-820b-0d8092ee7db0 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:55.943289 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-dbeaf9dc-a585-4136-820b-0d8092ee7db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:55.976213 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-bb618d7c-07d3-4444-b465-8fbff32c0e98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f44c5f26820b48579d9b63311b5b017c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:56.025145 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-bb618d7c-07d3-4444-b465-8fbff32c0e98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f44c5f26820b48579d9b63311b5b017c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:56.047850 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-bb618d7c-07d3-4444-b465-8fbff32c0e98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f44c5f26820b48579d9b63311b5b017c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:56.048978 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-bb618d7c-07d3-4444-b465-8fbff32c0e98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f44c5f26820b48579d9b63311b5b017c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:56.053462 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-bb618d7c-07d3-4444-b465-8fbff32c0e98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f44c5f26820b48579d9b63311b5b017c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:56.092596 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 933/1881] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:32:55 2022] DELETE /identity/v3/users/f44c5f26820b48579d9b63311b5b017c => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:56.094686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb618d7c-07d3-4444-b465-8fbff32c0e98 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:56.109348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-bb618d7c-07d3-4444-b465-8fbff32c0e98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:56.176046 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:56.232520 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb618d7c-07d3-4444-b465-8fbff32c0e98 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:56.239711 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeaf9dc-a585-4136-820b-0d8092ee7db0 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:56.240570 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb224229-8949-4e26-8fe6-7712e206e326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:56.241470 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb224229-8949-4e26-8fe6-7712e206e326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:56.241793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb224229-8949-4e26-8fe6-7712e206e326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:56.242022 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb224229-8949-4e26-8fe6-7712e206e326 admin admin] PATH_INFO: `/v3/projects/ef68946cea62434e99555021c5d693a6` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:56.244327 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb224229-8949-4e26-8fe6-7712e206e326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef68946cea62434e99555021c5d693a6)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:56.247718 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb224229-8949-4e26-8fe6-7712e206e326 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:56.328876 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782dfed5-3d13-4e9b-ab52-c4ed1c43795e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:56.331527 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dfed5-3d13-4e9b-ab52-c4ed1c43795e service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:56.332321 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dfed5-3d13-4e9b-ab52-c4ed1c43795e service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:56.332807 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dfed5-3d13-4e9b-ab52-c4ed1c43795e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:56.335779 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-782dfed5-3d13-4e9b-ab52-c4ed1c43795e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:56.382154 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:56.440429 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782dfed5-3d13-4e9b-ab52-c4ed1c43795e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:56.443464 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782dfed5-3d13-4e9b-ab52-c4ed1c43795e service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:56.444138 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-fb224229-8949-4e26-8fe6-7712e206e326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef68946cea62434e99555021c5d693a6', 'request_id': 'req-fb224229-8949-4e26-8fe6-7712e206e326'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:56.478483 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 949/1882] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:56.487961 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39003927-bf13-4afa-903e-08d711a2cc7b None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:56.488307 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39003927-bf13-4afa-903e-08d711a2cc7b None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:56.488891 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-fb224229-8949-4e26-8fe6-7712e206e326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef68946cea62434e99555021c5d693a6', 'request_id': 'req-fb224229-8949-4e26-8fe6-7712e206e326'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:56.490136 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39003927-bf13-4afa-903e-08d711a2cc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:56.498754 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-fb224229-8949-4e26-8fe6-7712e206e326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef68946cea62434e99555021c5d693a6', 'request_id': 'req-fb224229-8949-4e26-8fe6-7712e206e326'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:56.520902 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-fb224229-8949-4e26-8fe6-7712e206e326 admin admin] The token cache is being invalidate because project ef68946cea62434e99555021c5d693a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:32:56.521675 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-fb224229-8949-4e26-8fe6-7712e206e326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:56.536906 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-fb224229-8949-4e26-8fe6-7712e206e326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:56.538973 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 934/1883] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:32:56 2022] DELETE /identity/v3/projects/ef68946cea62434e99555021c5d693a6 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:56.545914 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a92950-d6fc-4d2a-8638-5c4677d5ed0b None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:56.546571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a92950-d6fc-4d2a-8638-5c4677d5ed0b None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:56.547097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a92950-d6fc-4d2a-8638-5c4677d5ed0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:56.548744 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-39003927-bf13-4afa-903e-08d711a2cc7b None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:56.550015 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-39003927-bf13-4afa-903e-08d711a2cc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:56.592564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-f9a92950-d6fc-4d2a-8638-5c4677d5ed0b None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:56.603750 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-f9a92950-d6fc-4d2a-8638-5c4677d5ed0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:56.695474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 950/1884] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:56.739461 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 935/1885] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:32:56.744517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a88f2c-9058-49c5-8026-a7e04c6a5078 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:56.745369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a88f2c-9058-49c5-8026-a7e04c6a5078 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:56.745732 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a88f2c-9058-49c5-8026-a7e04c6a5078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:56.772221 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a92950-d6fc-4d2a-8638-5c4677d5ed0b None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:56.775692 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-f9a92950-d6fc-4d2a-8638-5c4677d5ed0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:56.791529 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-36a88f2c-9058-49c5-8026-a7e04c6a5078 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:56.794899 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-36a88f2c-9058-49c5-8026-a7e04c6a5078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:56.844266 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 951/1886] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:56.856186 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a88f2c-9058-49c5-8026-a7e04c6a5078 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:56.916732 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a88f2c-9058-49c5-8026-a7e04c6a5078 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:56.959174 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f334d-0d22-4b95-8d18-7754b1a0db9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:56.963475 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f334d-0d22-4b95-8d18-7754b1a0db9e admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:56.963644 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f334d-0d22-4b95-8d18-7754b1a0db9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:56.968554 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f334d-0d22-4b95-8d18-7754b1a0db9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:56.978002 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f334d-0d22-4b95-8d18-7754b1a0db9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:56.982919 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f334d-0d22-4b95-8d18-7754b1a0db9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:57.004670 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f334d-0d22-4b95-8d18-7754b1a0db9e admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:57.118670 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 952/1887] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:57.123600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f334d-0d22-4b95-8d18-7754b1a0db9e admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:57.181455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f334d-0d22-4b95-8d18-7754b1a0db9e admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:57.186168 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a92950-d6fc-4d2a-8638-5c4677d5ed0b None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:57.201969 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4dcbb-e3e9-4353-82a8-b30c1770ade1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:57.205500 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4dcbb-e3e9-4353-82a8-b30c1770ade1 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:57.208601 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4dcbb-e3e9-4353-82a8-b30c1770ade1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:57.208935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfb7eb-afd6-491c-b462-82b62e2242aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:57.210292 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4dcbb-e3e9-4353-82a8-b30c1770ade1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:57.210997 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfb7eb-afd6-491c-b462-82b62e2242aa service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:57.212024 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfb7eb-afd6-491c-b462-82b62e2242aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:57.212590 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfb7eb-afd6-491c-b462-82b62e2242aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:57.216158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4dcbb-e3e9-4353-82a8-b30c1770ade1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:57.227213 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4dcbb-e3e9-4353-82a8-b30c1770ade1 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:57.259439 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfb7eb-afd6-491c-b462-82b62e2242aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:57.270645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfb7eb-afd6-491c-b462-82b62e2242aa service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:57.317419 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 936/1888] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:32:57.349338 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 953/1889] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:32:57 2022] POST /identity/v3/projects => generated 379 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:57.354902 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfb7eb-afd6-491c-b462-82b62e2242aa service neutron] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:57.394430 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4dcbb-e3e9-4353-82a8-b30c1770ade1 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:57.396518 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-c6d4dcbb-e3e9-4353-82a8-b30c1770ade1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:57.415568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfb7eb-afd6-491c-b462-82b62e2242aa service neutron] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:57.425843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:57.634113 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4dcbb-e3e9-4353-82a8-b30c1770ade1 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:57.638687 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:57.653521 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f6278-b97b-487d-b053-17eaec4bb613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:57.654303 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f6278-b97b-487d-b053-17eaec4bb613 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:57.655054 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f6278-b97b-487d-b053-17eaec4bb613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:57.655455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f6278-b97b-487d-b053-17eaec4bb613 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:57.656268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa9953-3eb0-4c4a-84c8-ac250d53dc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:57.656877 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f6278-b97b-487d-b053-17eaec4bb613 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:57.657628 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa9953-3eb0-4c4a-84c8-ac250d53dc4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:57.658133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa9953-3eb0-4c4a-84c8-ac250d53dc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:57.658641 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa9953-3eb0-4c4a-84c8-ac250d53dc4c admin admin] PATH_INFO: `/v3/projects/38b483145aba499f95a8db76afada577` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:57.659128 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f6278-b97b-487d-b053-17eaec4bb613 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:57.666516 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa9953-3eb0-4c4a-84c8-ac250d53dc4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=38b483145aba499f95a8db76afada577)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:57.670297 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa9953-3eb0-4c4a-84c8-ac250d53dc4c admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:57.692474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 937/1890] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:32:57 2022] POST /identity/v3/users => generated 290 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:57.697246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f6278-b97b-487d-b053-17eaec4bb613 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:57.711159 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f6278-b97b-487d-b053-17eaec4bb613 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:57.717488 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f09f7-8526-4b2c-b1f8-444f3910ec0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:57.718369 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f09f7-8526-4b2c-b1f8-444f3910ec0b admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:57.718666 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f09f7-8526-4b2c-b1f8-444f3910ec0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:57.718947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f09f7-8526-4b2c-b1f8-444f3910ec0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:57.719795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f09f7-8526-4b2c-b1f8-444f3910ec0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:57.722175 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f09f7-8526-4b2c-b1f8-444f3910ec0b admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:57.742261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 938/1891] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:57.744099 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f09f7-8526-4b2c-b1f8-444f3910ec0b admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:57.765072 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f09f7-8526-4b2c-b1f8-444f3910ec0b admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:57.780885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0cb57-003f-4ef0-a65d-42267109bbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:57.781584 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0cb57-003f-4ef0-a65d-42267109bbb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:57.781875 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0cb57-003f-4ef0-a65d-42267109bbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:57.782161 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0cb57-003f-4ef0-a65d-42267109bbb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:57.783144 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0cb57-003f-4ef0-a65d-42267109bbb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:57.787093 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0cb57-003f-4ef0-a65d-42267109bbb3 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:57.815347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 939/1892] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:57.820536 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0cb57-003f-4ef0-a65d-42267109bbb3 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:57.866971 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0cb57-003f-4ef0-a65d-42267109bbb3 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:57.882118 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-04aa9953-3eb0-4c4a-84c8-ac250d53dc4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38b483145aba499f95a8db76afada577', 'request_id': 'req-04aa9953-3eb0-4c4a-84c8-ac250d53dc4c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:57.925766 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-04aa9953-3eb0-4c4a-84c8-ac250d53dc4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38b483145aba499f95a8db76afada577', 'request_id': 'req-04aa9953-3eb0-4c4a-84c8-ac250d53dc4c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:57.958559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-04aa9953-3eb0-4c4a-84c8-ac250d53dc4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38b483145aba499f95a8db76afada577', 'request_id': 'req-04aa9953-3eb0-4c4a-84c8-ac250d53dc4c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:57.982785 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-04aa9953-3eb0-4c4a-84c8-ac250d53dc4c admin admin] The token cache is being invalidate because project 38b483145aba499f95a8db76afada577 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:32:57.985010 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-04aa9953-3eb0-4c4a-84c8-ac250d53dc4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:57.989295 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-04aa9953-3eb0-4c4a-84c8-ac250d53dc4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:57.992662 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 954/1893] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:32:57 2022] DELETE /identity/v3/projects/38b483145aba499f95a8db76afada577 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:32:57.999195 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188114ee-a5d2-4965-ac0a-21d3d29e9b60 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:57.999654 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188114ee-a5d2-4965-ac0a-21d3d29e9b60 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:58.000627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188114ee-a5d2-4965-ac0a-21d3d29e9b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:58.044312 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-188114ee-a5d2-4965-ac0a-21d3d29e9b60 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:58.048696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-188114ee-a5d2-4965-ac0a-21d3d29e9b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:58.048833 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8500e-d2fc-4fa8-91d6-5b9cba45a49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:58.050791 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8500e-d2fc-4fa8-91d6-5b9cba45a49b admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:58.051408 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8500e-d2fc-4fa8-91d6-5b9cba45a49b admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:58.052290 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8500e-d2fc-4fa8-91d6-5b9cba45a49b admin admin] PATH_INFO: `/v3/projects/913dd429559f4a9da54e59419d631348/users/5ed64ae5df274ded8d8f8701246d9a4b/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:58.073493 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 955/1894] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:58.085556 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed1a01-823c-4a8e-8dbd-8bd195350cc2 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:58.085979 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed1a01-823c-4a8e-8dbd-8bd195350cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:58.087268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed1a01-823c-4a8e-8dbd-8bd195350cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:58.115839 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8500e-d2fc-4fa8-91d6-5b9cba45a49b admin admin] RBAC: Authorizing `identity:create_grant(project_id=913dd429559f4a9da54e59419d631348, user_id=5ed64ae5df274ded8d8f8701246d9a4b, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:58.122890 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8500e-d2fc-4fa8-91d6-5b9cba45a49b admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:58.131213 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-e7ed1a01-823c-4a8e-8dbd-8bd195350cc2 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:58.133277 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-e7ed1a01-823c-4a8e-8dbd-8bd195350cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:58.157588 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 956/1895] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:58.158388 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed1a01-823c-4a8e-8dbd-8bd195350cc2 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:58.164754 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 940/1896] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:57 2022] PUT /identity/v3/projects/913dd429559f4a9da54e59419d631348/users/5ed64ae5df274ded8d8f8701246d9a4b/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:32:58.171970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed1a01-823c-4a8e-8dbd-8bd195350cc2 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:58.176908 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1339c7-90de-4b7d-8b0c-7fab3d9d8e2e None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:58.177311 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1339c7-90de-4b7d-8b0c-7fab3d9d8e2e None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:58.177732 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1339c7-90de-4b7d-8b0c-7fab3d9d8e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:58.237698 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-da1339c7-90de-4b7d-8b0c-7fab3d9d8e2e None None] MFA Rules not processed for user `5ed64ae5df274ded8d8f8701246d9a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:58.239837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-da1339c7-90de-4b7d-8b0c-7fab3d9d8e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:58.353467 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d315c4-6a26-4fab-ac56-b1c42b3a2185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:58.354180 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d315c4-6a26-4fab-ac56-b1c42b3a2185 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:58.354614 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d315c4-6a26-4fab-ac56-b1c42b3a2185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:58.355077 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d315c4-6a26-4fab-ac56-b1c42b3a2185 admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:58.355889 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d315c4-6a26-4fab-ac56-b1c42b3a2185 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:32:58.356207 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d315c4-6a26-4fab-ac56-b1c42b3a2185 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:58.358550 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d315c4-6a26-4fab-ac56-b1c42b3a2185 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:58.387544 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 941/1897] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:32:58.392050 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1339c7-90de-4b7d-8b0c-7fab3d9d8e2e None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:58.399147 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-da1339c7-90de-4b7d-8b0c-7fab3d9d8e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:58.416899 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 957/1898] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:32:58.420053 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d315c4-6a26-4fab-ac56-b1c42b3a2185 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:58.439789 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1339c7-90de-4b7d-8b0c-7fab3d9d8e2e None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:58.441544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d315c4-6a26-4fab-ac56-b1c42b3a2185 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:58.448618 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e20f56-f59b-41b6-81b1-1efca2e77f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:58.449305 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e20f56-f59b-41b6-81b1-1efca2e77f3b admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:58.449588 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e20f56-f59b-41b6-81b1-1efca2e77f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:58.450042 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e20f56-f59b-41b6-81b1-1efca2e77f3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:58.450759 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e20f56-f59b-41b6-81b1-1efca2e77f3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:58.452609 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81303d-68c7-47b0-b500-765e7ae8c4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:58.452759 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e20f56-f59b-41b6-81b1-1efca2e77f3b admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:58.453613 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81303d-68c7-47b0-b500-765e7ae8c4c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:58.454187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81303d-68c7-47b0-b500-765e7ae8c4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:58.454730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81303d-68c7-47b0-b500-765e7ae8c4c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:58.456014 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81303d-68c7-47b0-b500-765e7ae8c4c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:58.459317 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81303d-68c7-47b0-b500-765e7ae8c4c1 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:58.505274 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 942/1899] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:32:58 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:58.509055 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:58.510357 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e20f56-f59b-41b6-81b1-1efca2e77f3b admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:58.531342 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 958/1900] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:32:58 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:58.534027 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81303d-68c7-47b0-b500-765e7ae8c4c1 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:58.577006 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:58.804836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e20f56-f59b-41b6-81b1-1efca2e77f3b admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:58.851283 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81303d-68c7-47b0-b500-765e7ae8c4c1 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:58.871649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff0158-deaf-4b7b-9d95-b00c17eea97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:58.872368 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff0158-deaf-4b7b-9d95-b00c17eea97a admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:58.872721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff0158-deaf-4b7b-9d95-b00c17eea97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:58.873016 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff0158-deaf-4b7b-9d95-b00c17eea97a admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:58.873743 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff0158-deaf-4b7b-9d95-b00c17eea97a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:58.878693 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff0158-deaf-4b7b-9d95-b00c17eea97a admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:58.946196 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 959/1901] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:32:58 2022] POST /identity/v3/users => generated 283 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:58.948319 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff0158-deaf-4b7b-9d95-b00c17eea97a admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:58.948896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53699ec4-c3ce-4965-80d6-afeec3697c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:58.949672 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53699ec4-c3ce-4965-80d6-afeec3697c36 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:58.949987 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53699ec4-c3ce-4965-80d6-afeec3697c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:58.950440 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53699ec4-c3ce-4965-80d6-afeec3697c36 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:58.950994 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53699ec4-c3ce-4965-80d6-afeec3697c36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:58.953518 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-19ff0158-deaf-4b7b-9d95-b00c17eea97a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:58.953797 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53699ec4-c3ce-4965-80d6-afeec3697c36 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:58.990844 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff0158-deaf-4b7b-9d95-b00c17eea97a admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:59.005060 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 943/1902] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:32:58 2022] POST /identity/v3/users => generated 296 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:32:59.005060 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53699ec4-c3ce-4965-80d6-afeec3697c36 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:59.014799 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7fb68-89bc-427d-9d93-f2e8718a3a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:59.016861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7fb68-89bc-427d-9d93-f2e8718a3a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:59.017123 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7fb68-89bc-427d-9d93-f2e8718a3a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:59.017588 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7fb68-89bc-427d-9d93-f2e8718a3a49 admin admin] PATH_INFO: `/v3/projects/a169ea9c31ad461d8f353535778c5129` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:59.018079 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53699ec4-c3ce-4965-80d6-afeec3697c36 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:59.020776 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c7fb68-89bc-427d-9d93-f2e8718a3a49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a169ea9c31ad461d8f353535778c5129)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:59.024544 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5441157-a610-4505-9d85-d3120198ae17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:59.025453 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5441157-a610-4505-9d85-d3120198ae17 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:59.025757 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5441157-a610-4505-9d85-d3120198ae17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:59.025859 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c7fb68-89bc-427d-9d93-f2e8718a3a49 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:59.026082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5441157-a610-4505-9d85-d3120198ae17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:59.027116 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5441157-a610-4505-9d85-d3120198ae17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:59.028949 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5441157-a610-4505-9d85-d3120198ae17 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:59.043701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 944/1903] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:59.044814 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5441157-a610-4505-9d85-d3120198ae17 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:59.062812 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5441157-a610-4505-9d85-d3120198ae17 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:59.089072 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b56610-3486-40dd-9704-ec4ec7b43505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:59.090336 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b56610-3486-40dd-9704-ec4ec7b43505 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:59.090847 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b56610-3486-40dd-9704-ec4ec7b43505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:59.091395 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b56610-3486-40dd-9704-ec4ec7b43505 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:59.095770 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b56610-3486-40dd-9704-ec4ec7b43505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:59.098596 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b56610-3486-40dd-9704-ec4ec7b43505 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:59.140435 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 945/1904] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:59.147571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b56610-3486-40dd-9704-ec4ec7b43505 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:59.179872 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-c5c7fb68-89bc-427d-9d93-f2e8718a3a49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a169ea9c31ad461d8f353535778c5129', 'request_id': 'req-c5c7fb68-89bc-427d-9d93-f2e8718a3a49'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:59.183278 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b56610-3486-40dd-9704-ec4ec7b43505 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:59.197443 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-c5c7fb68-89bc-427d-9d93-f2e8718a3a49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a169ea9c31ad461d8f353535778c5129', 'request_id': 'req-c5c7fb68-89bc-427d-9d93-f2e8718a3a49'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:59.216742 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-c5c7fb68-89bc-427d-9d93-f2e8718a3a49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a169ea9c31ad461d8f353535778c5129', 'request_id': 'req-c5c7fb68-89bc-427d-9d93-f2e8718a3a49'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:59.241613 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-c5c7fb68-89bc-427d-9d93-f2e8718a3a49 admin admin] The token cache is being invalidate because project a169ea9c31ad461d8f353535778c5129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:32:59.245715 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-c5c7fb68-89bc-427d-9d93-f2e8718a3a49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:59.250818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-c5c7fb68-89bc-427d-9d93-f2e8718a3a49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:59.258718 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 960/1905] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:32:58 2022] DELETE /identity/v3/projects/a169ea9c31ad461d8f353535778c5129 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:59.276093 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7fb68-89bc-427d-9d93-f2e8718a3a49 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:59.278286 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-c5c7fb68-89bc-427d-9d93-f2e8718a3a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:59.348493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df85d97-cf3c-4f6b-80be-850df3fee57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:59.350361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df85d97-cf3c-4f6b-80be-850df3fee57e admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:59.350794 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df85d97-cf3c-4f6b-80be-850df3fee57e admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:59.351825 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df85d97-cf3c-4f6b-80be-850df3fee57e admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:59.352746 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df85d97-cf3c-4f6b-80be-850df3fee57e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:59.355841 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df85d97-cf3c-4f6b-80be-850df3fee57e admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:59.381965 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 946/1906] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:32:59.382901 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df85d97-cf3c-4f6b-80be-850df3fee57e admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:59.385822 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-9df85d97-cf3c-4f6b-80be-850df3fee57e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:59.407486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7fb68-89bc-427d-9d93-f2e8718a3a49 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:59.416308 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df85d97-cf3c-4f6b-80be-850df3fee57e admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:59.419494 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43ff1b-4490-4caf-be80-d46148588bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:59.422434 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43ff1b-4490-4caf-be80-d46148588bc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:59.422852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43ff1b-4490-4caf-be80-d46148588bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:59.423443 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43ff1b-4490-4caf-be80-d46148588bc0 admin admin] PATH_INFO: `/v3/projects/8db9c6ff379f459bb9d7573b0516daf2/users/2c7651a64b2e4effb19c71fd1e36d792/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:59.435885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c062e-8d28-40e3-bb59-b124e883e8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:59.437423 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c062e-8d28-40e3-bb59-b124e883e8b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:59.437955 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c062e-8d28-40e3-bb59-b124e883e8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:59.438436 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c062e-8d28-40e3-bb59-b124e883e8b3 admin admin] PATH_INFO: `/v3/users/e1e7f4b1154b474da051a75a6084e473` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:59.441305 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c062e-8d28-40e3-bb59-b124e883e8b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1e7f4b1154b474da051a75a6084e473)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:59.451952 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c062e-8d28-40e3-bb59-b124e883e8b3 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:59.468171 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43ff1b-4490-4caf-be80-d46148588bc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8db9c6ff379f459bb9d7573b0516daf2, user_id=2c7651a64b2e4effb19c71fd1e36d792, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:59.478940 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43ff1b-4490-4caf-be80-d46148588bc0 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:59.488808 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:59.508696 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:59.518035 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 961/1907] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:59 2022] PUT /identity/v3/projects/8db9c6ff379f459bb9d7573b0516daf2/users/2c7651a64b2e4effb19c71fd1e36d792/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:59.521834 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43ff1b-4490-4caf-be80-d46148588bc0 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:59.524676 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-ab43ff1b-4490-4caf-be80-d46148588bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:59.558138 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-294c062e-8d28-40e3-bb59-b124e883e8b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1e7f4b1154b474da051a75a6084e473'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:59.575966 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-294c062e-8d28-40e3-bb59-b124e883e8b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1e7f4b1154b474da051a75a6084e473'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:59.592275 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-294c062e-8d28-40e3-bb59-b124e883e8b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1e7f4b1154b474da051a75a6084e473'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:59.593150 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-294c062e-8d28-40e3-bb59-b124e883e8b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1e7f4b1154b474da051a75a6084e473'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:59.594205 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-294c062e-8d28-40e3-bb59-b124e883e8b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1e7f4b1154b474da051a75a6084e473'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:32:59.640896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 947/1908] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:32:59 2022] DELETE /identity/v3/users/e1e7f4b1154b474da051a75a6084e473 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:32:59.651809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43ff1b-4490-4caf-be80-d46148588bc0 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:59.656432 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c062e-8d28-40e3-bb59-b124e883e8b3 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:59.663512 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-294c062e-8d28-40e3-bb59-b124e883e8b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:59.752416 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39093b02-7bfa-4613-89e8-64beff0c91aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:59.753873 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39093b02-7bfa-4613-89e8-64beff0c91aa service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:59.754362 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39093b02-7bfa-4613-89e8-64beff0c91aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:59.754830 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39093b02-7bfa-4613-89e8-64beff0c91aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:59.757713 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-39093b02-7bfa-4613-89e8-64beff0c91aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:59.874959 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c062e-8d28-40e3-bb59-b124e883e8b3 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:59.893489 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39093b02-7bfa-4613-89e8-64beff0c91aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:59.895391 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39093b02-7bfa-4613-89e8-64beff0c91aa service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:59.896440 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b49b13-f780-4cc5-aa69-87ce9d0348af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:59.900254 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b49b13-f780-4cc5-aa69-87ce9d0348af admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:59.900651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b49b13-f780-4cc5-aa69-87ce9d0348af admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:59.902070 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b49b13-f780-4cc5-aa69-87ce9d0348af admin admin] PATH_INFO: `/v3/projects/46d2b28627e84fc89a55d6954d6e8736/users/5564c943809047b894b11fbae0a07527/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:59.933669 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b49b13-f780-4cc5-aa69-87ce9d0348af admin admin] RBAC: Authorizing `identity:create_grant(project_id=46d2b28627e84fc89a55d6954d6e8736, user_id=5564c943809047b894b11fbae0a07527, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:59.939457 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b49b13-f780-4cc5-aa69-87ce9d0348af admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:59.943569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 962/1909] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:59.944395 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39093b02-7bfa-4613-89e8-64beff0c91aa service cinder] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:59.951592 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-39093b02-7bfa-4613-89e8-64beff0c91aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:59.982465 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39093b02-7bfa-4613-89e8-64beff0c91aa service cinder] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:59.990889 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 948/1910] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:32:59 2022] PUT /identity/v3/projects/46d2b28627e84fc89a55d6954d6e8736/users/5564c943809047b894b11fbae0a07527/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:00.001528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b59126-ed05-43a9-87c3-d1b74fccc410 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:00.001891 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b59126-ed05-43a9-87c3-d1b74fccc410 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:00.002245 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b59126-ed05-43a9-87c3-d1b74fccc410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:00.050454 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-43b59126-ed05-43a9-87c3-d1b74fccc410 None None] MFA Rules not processed for user `5564c943809047b894b11fbae0a07527`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:00.054286 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-43b59126-ed05-43a9-87c3-d1b74fccc410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:00.109504 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9d0aa-49ce-41d7-8608-ef5c8a2634cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:00.110291 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9d0aa-49ce-41d7-8608-ef5c8a2634cb admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:00.110646 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9d0aa-49ce-41d7-8608-ef5c8a2634cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:00.110999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9d0aa-49ce-41d7-8608-ef5c8a2634cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:00.111933 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9d0aa-49ce-41d7-8608-ef5c8a2634cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:00.113768 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9d0aa-49ce-41d7-8608-ef5c8a2634cb admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:00.120332 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:00.131777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 963/1911] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:00.131777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9d0aa-49ce-41d7-8608-ef5c8a2634cb admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:00.132935 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-fea9d0aa-49ce-41d7-8608-ef5c8a2634cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:00.148643 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9d0aa-49ce-41d7-8608-ef5c8a2634cb admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:00.155204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845dfd2-74cd-4bb8-8b49-2accb763e693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:00.156654 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845dfd2-74cd-4bb8-8b49-2accb763e693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:00.157050 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845dfd2-74cd-4bb8-8b49-2accb763e693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:00.157434 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845dfd2-74cd-4bb8-8b49-2accb763e693 admin admin] PATH_INFO: `/v3/users/f26ea5a9a3a9420eaf6cc0f06226d478` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:00.159586 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845dfd2-74cd-4bb8-8b49-2accb763e693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f26ea5a9a3a9420eaf6cc0f06226d478)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:00.161639 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845dfd2-74cd-4bb8-8b49-2accb763e693 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:00.170588 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 949/1912] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:32:59 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:33:00.171459 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b59126-ed05-43a9-87c3-d1b74fccc410 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:00.173323 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-43b59126-ed05-43a9-87c3-d1b74fccc410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:00.189493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b59126-ed05-43a9-87c3-d1b74fccc410 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:00.196156 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae3572-0b8a-4ce6-9a2e-e2d1dfc5c540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:00.197162 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae3572-0b8a-4ce6-9a2e-e2d1dfc5c540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:00.197514 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae3572-0b8a-4ce6-9a2e-e2d1dfc5c540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:00.197770 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae3572-0b8a-4ce6-9a2e-e2d1dfc5c540 admin admin] PATH_INFO: `/v3/projects/e8f64b2d281a437db5a8b5038378e376` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:00.199136 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae3572-0b8a-4ce6-9a2e-e2d1dfc5c540 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8f64b2d281a437db5a8b5038378e376)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:00.201088 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae3572-0b8a-4ce6-9a2e-e2d1dfc5c540 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:00.204054 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:00.228504 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-a845dfd2-74cd-4bb8-8b49-2accb763e693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f26ea5a9a3a9420eaf6cc0f06226d478'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:00.247167 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-a845dfd2-74cd-4bb8-8b49-2accb763e693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f26ea5a9a3a9420eaf6cc0f06226d478'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:00.258770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-a845dfd2-74cd-4bb8-8b49-2accb763e693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f26ea5a9a3a9420eaf6cc0f06226d478'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:00.259650 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-a845dfd2-74cd-4bb8-8b49-2accb763e693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f26ea5a9a3a9420eaf6cc0f06226d478'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:00.260454 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-a845dfd2-74cd-4bb8-8b49-2accb763e693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f26ea5a9a3a9420eaf6cc0f06226d478'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:00.269935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-cdae3572-0b8a-4ce6-9a2e-e2d1dfc5c540 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8f64b2d281a437db5a8b5038378e376', 'request_id': 'req-cdae3572-0b8a-4ce6-9a2e-e2d1dfc5c540'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:00.278297 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-cdae3572-0b8a-4ce6-9a2e-e2d1dfc5c540 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8f64b2d281a437db5a8b5038378e376', 'request_id': 'req-cdae3572-0b8a-4ce6-9a2e-e2d1dfc5c540'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:00.281992 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 964/1913] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:00 2022] DELETE /identity/v3/users/f26ea5a9a3a9420eaf6cc0f06226d478 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:00.281992 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845dfd2-74cd-4bb8-8b49-2accb763e693 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:00.281992 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-a845dfd2-74cd-4bb8-8b49-2accb763e693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:00.288728 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-cdae3572-0b8a-4ce6-9a2e-e2d1dfc5c540 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8f64b2d281a437db5a8b5038378e376', 'request_id': 'req-cdae3572-0b8a-4ce6-9a2e-e2d1dfc5c540'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:00.303128 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-cdae3572-0b8a-4ce6-9a2e-e2d1dfc5c540 admin admin] The token cache is being invalidate because project e8f64b2d281a437db5a8b5038378e376 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:00.303805 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-cdae3572-0b8a-4ce6-9a2e-e2d1dfc5c540 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:00.305273 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-cdae3572-0b8a-4ce6-9a2e-e2d1dfc5c540 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:00.307347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 950/1914] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:00 2022] DELETE /identity/v3/projects/e8f64b2d281a437db5a8b5038378e376 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:00.308371 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae3572-0b8a-4ce6-9a2e-e2d1dfc5c540 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:00.309780 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-cdae3572-0b8a-4ce6-9a2e-e2d1dfc5c540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:00.357239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845dfd2-74cd-4bb8-8b49-2accb763e693 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:00.362866 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4378b-4dc0-4df8-b00e-3380025b51be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:00.363985 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4378b-4dc0-4df8-b00e-3380025b51be admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:00.364339 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4378b-4dc0-4df8-b00e-3380025b51be admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:00.365483 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4378b-4dc0-4df8-b00e-3380025b51be admin admin] PATH_INFO: `/v3/projects/8db9c6ff379f459bb9d7573b0516daf2/users/2c7651a64b2e4effb19c71fd1e36d792/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:00.366745 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4378b-4dc0-4df8-b00e-3380025b51be admin admin] RBAC: Authorizing `identity:create_grant(project_id=8db9c6ff379f459bb9d7573b0516daf2, user_id=2c7651a64b2e4effb19c71fd1e36d792, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:00.369476 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4378b-4dc0-4df8-b00e-3380025b51be admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:00.391256 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 965/1915] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:00 2022] PUT /identity/v3/projects/8db9c6ff379f459bb9d7573b0516daf2/users/2c7651a64b2e4effb19c71fd1e36d792/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:00.393111 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae3572-0b8a-4ce6-9a2e-e2d1dfc5c540 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:00.401236 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b2cac-aaad-429b-bb8d-00d0bdd94b37 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:00.401686 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b2cac-aaad-429b-bb8d-00d0bdd94b37 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:00.402038 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b2cac-aaad-429b-bb8d-00d0bdd94b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:00.434297 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-046b2cac-aaad-429b-bb8d-00d0bdd94b37 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:00.436053 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-046b2cac-aaad-429b-bb8d-00d0bdd94b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:00.483477 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39323ca8-7fcf-4729-b8b4-38dbdc162dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:00.484673 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39323ca8-7fcf-4729-b8b4-38dbdc162dad admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:00.484969 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39323ca8-7fcf-4729-b8b4-38dbdc162dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:00.485253 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39323ca8-7fcf-4729-b8b4-38dbdc162dad admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:00.485992 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39323ca8-7fcf-4729-b8b4-38dbdc162dad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:00.489258 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39323ca8-7fcf-4729-b8b4-38dbdc162dad admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:00.511287 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 966/1916] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:00.512823 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8461f06-5d3f-4de7-9b14-2947a3e339d0 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:00.513565 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8461f06-5d3f-4de7-9b14-2947a3e339d0 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:00.514159 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8461f06-5d3f-4de7-9b14-2947a3e339d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:00.529511 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:00.530861 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 951/1917] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:33:00 2022] POST /identity/v3/projects => generated 363 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:00.536117 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384aaddf-8a4c-4a5d-ab25-c5b1911cc4e6 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:00.536615 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384aaddf-8a4c-4a5d-ab25-c5b1911cc4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:00.537022 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384aaddf-8a4c-4a5d-ab25-c5b1911cc4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:00.538075 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-a8461f06-5d3f-4de7-9b14-2947a3e339d0 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:00.540426 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-a8461f06-5d3f-4de7-9b14-2947a3e339d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:00.568075 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-384aaddf-8a4c-4a5d-ab25-c5b1911cc4e6 None None] MFA Rules not processed for user `2c7651a64b2e4effb19c71fd1e36d792`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:00.569308 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-384aaddf-8a4c-4a5d-ab25-c5b1911cc4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:00.582980 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:00.652497 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 967/1918] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:00.653393 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8461f06-5d3f-4de7-9b14-2947a3e339d0 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:00.664034 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-a8461f06-5d3f-4de7-9b14-2947a3e339d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:00.684386 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 952/1919] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:00.685487 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384aaddf-8a4c-4a5d-ab25-c5b1911cc4e6 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:00.701667 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384aaddf-8a4c-4a5d-ab25-c5b1911cc4e6 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:00.708484 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf3322-b101-4463-9eac-25416e40eea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:00.709188 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf3322-b101-4463-9eac-25416e40eea1 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:00.709508 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf3322-b101-4463-9eac-25416e40eea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:00.709911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf3322-b101-4463-9eac-25416e40eea1 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:00.710486 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf3322-b101-4463-9eac-25416e40eea1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:00.712972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf3322-b101-4463-9eac-25416e40eea1 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:00.738353 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8461f06-5d3f-4de7-9b14-2947a3e339d0 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:00.742247 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e95437-c1b0-45d6-b7fc-f2a84fbe195e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:00.743379 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e95437-c1b0-45d6-b7fc-f2a84fbe195e service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:00.743922 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e95437-c1b0-45d6-b7fc-f2a84fbe195e service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:00.744417 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e95437-c1b0-45d6-b7fc-f2a84fbe195e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:00.756200 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e95437-c1b0-45d6-b7fc-f2a84fbe195e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:00.757717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e95437-c1b0-45d6-b7fc-f2a84fbe195e service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:00.763479 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 953/1920] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:33:00 2022] POST /identity/v3/users => generated 288 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:00.763479 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7067c-f88b-49c1-b97b-d6adfd36ae4d None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:00.763479 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7067c-f88b-49c1-b97b-d6adfd36ae4d None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:00.764074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7067c-f88b-49c1-b97b-d6adfd36ae4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:00.774042 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 968/1921] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:00.777324 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e95437-c1b0-45d6-b7fc-f2a84fbe195e service neutron] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:00.780107 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-53e95437-c1b0-45d6-b7fc-f2a84fbe195e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:00.792165 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-92e7067c-f88b-49c1-b97b-d6adfd36ae4d None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:00.794098 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-92e7067c-f88b-49c1-b97b-d6adfd36ae4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:00.804723 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 954/1922] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:00.805735 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7067c-f88b-49c1-b97b-d6adfd36ae4d None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:00.807317 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-92e7067c-f88b-49c1-b97b-d6adfd36ae4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:00.927659 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7067c-f88b-49c1-b97b-d6adfd36ae4d None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:00.928442 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e95437-c1b0-45d6-b7fc-f2a84fbe195e service neutron] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:00.934625 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101a819-b6fc-4b86-b970-e7fe6541e9fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:00.934996 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b6089e-1b3f-4a9a-bec7-dd35e55061c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:00.936313 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101a819-b6fc-4b86-b970-e7fe6541e9fa service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:00.936566 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6089e-1b3f-4a9a-bec7-dd35e55061c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:00.936779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101a819-b6fc-4b86-b970-e7fe6541e9fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:00.937041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6089e-1b3f-4a9a-bec7-dd35e55061c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:00.937354 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101a819-b6fc-4b86-b970-e7fe6541e9fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:00.937531 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6089e-1b3f-4a9a-bec7-dd35e55061c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:00.940938 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-15b6089e-1b3f-4a9a-bec7-dd35e55061c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:00.953050 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101a819-b6fc-4b86-b970-e7fe6541e9fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:00.954501 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101a819-b6fc-4b86-b970-e7fe6541e9fa service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:00.975484 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 955/1923] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:00.977106 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101a819-b6fc-4b86-b970-e7fe6541e9fa service cinder] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:00.992984 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101a819-b6fc-4b86-b970-e7fe6541e9fa service cinder] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:00.999788 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d335841-3b62-4f5e-821f-a661a2d893e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:01.000428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d335841-3b62-4f5e-821f-a661a2d893e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:01.001031 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d335841-3b62-4f5e-821f-a661a2d893e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:01.001331 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d335841-3b62-4f5e-821f-a661a2d893e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:01.002348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d335841-3b62-4f5e-821f-a661a2d893e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:01.004808 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d335841-3b62-4f5e-821f-a661a2d893e2 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:01.025400 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 956/1924] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:01.025400 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d335841-3b62-4f5e-821f-a661a2d893e2 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:01.041022 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b6089e-1b3f-4a9a-bec7-dd35e55061c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:01.041325 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d335841-3b62-4f5e-821f-a661a2d893e2 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:01.041482 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b6089e-1b3f-4a9a-bec7-dd35e55061c7 service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:01.050063 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:01.055023 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7f7d5-ae34-468a-969c-e7c6c3ee1392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:01.055900 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7f7d5-ae34-468a-969c-e7c6c3ee1392 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:01.056495 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7f7d5-ae34-468a-969c-e7c6c3ee1392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:01.057036 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7f7d5-ae34-468a-969c-e7c6c3ee1392 admin admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:01.057627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7f7d5-ae34-468a-969c-e7c6c3ee1392 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:01.057857 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7f7d5-ae34-468a-969c-e7c6c3ee1392 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:01.063832 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7f7d5-ae34-468a-969c-e7c6c3ee1392 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:01.074372 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 969/1925] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:00 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:01.075613 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b6089e-1b3f-4a9a-bec7-dd35e55061c7 service cinder] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:01.096051 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b6089e-1b3f-4a9a-bec7-dd35e55061c7 service cinder] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:01.099995 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 957/1926] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:01.105278 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7f7d5-ae34-468a-969c-e7c6c3ee1392 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:01.106606 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dafa36-3159-41dc-afe4-b7ac1e40c6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:01.107736 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dafa36-3159-41dc-afe4-b7ac1e40c6cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:01.108030 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dafa36-3159-41dc-afe4-b7ac1e40c6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:01.108312 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dafa36-3159-41dc-afe4-b7ac1e40c6cf admin admin] PATH_INFO: `/v3/projects/cc0336cd5d884f4aa76a189214548f35/users/504b9918f1a6496b8e75e5d32a8c9c3c/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:01.122227 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7f7d5-ae34-468a-969c-e7c6c3ee1392 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:01.128575 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dafa36-3159-41dc-afe4-b7ac1e40c6cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc0336cd5d884f4aa76a189214548f35, user_id=504b9918f1a6496b8e75e5d32a8c9c3c, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:01.132553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dafa36-3159-41dc-afe4-b7ac1e40c6cf admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:01.146366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd928e-1bb0-4880-abcf-5924b62e0265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:01.146366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd928e-1bb0-4880-abcf-5924b62e0265 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:01.146366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd928e-1bb0-4880-abcf-5924b62e0265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:01.146366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd928e-1bb0-4880-abcf-5924b62e0265 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:01.146757 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd928e-1bb0-4880-abcf-5924b62e0265 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:01.157341 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 970/1927] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:01 2022] PUT /identity/v3/projects/cc0336cd5d884f4aa76a189214548f35/users/504b9918f1a6496b8e75e5d32a8c9c3c/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:01.158006 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd928e-1bb0-4880-abcf-5924b62e0265 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:01.161406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dafa36-3159-41dc-afe4-b7ac1e40c6cf admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:01.204159 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 958/1928] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:33:01 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:01.212714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd928e-1bb0-4880-abcf-5924b62e0265 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:01.336312 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dafa36-3159-41dc-afe4-b7ac1e40c6cf admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:01.415910 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:01.446203 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23e7e8-1619-4037-a9cb-15964817c459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:01.446881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23e7e8-1619-4037-a9cb-15964817c459 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:01.447204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23e7e8-1619-4037-a9cb-15964817c459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:01.447522 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23e7e8-1619-4037-a9cb-15964817c459 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:01.448414 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23e7e8-1619-4037-a9cb-15964817c459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:01.450044 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23e7e8-1619-4037-a9cb-15964817c459 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:01.451982 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd928e-1bb0-4880-abcf-5924b62e0265 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:01.461084 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcb7fc-ff01-4040-8c6d-051b57162b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:01.462020 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcb7fc-ff01-4040-8c6d-051b57162b3c admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:01.462327 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcb7fc-ff01-4040-8c6d-051b57162b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:01.462603 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 971/1929] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:33:01.462723 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcb7fc-ff01-4040-8c6d-051b57162b3c admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:01.463838 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23e7e8-1619-4037-a9cb-15964817c459 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:01.464004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffcb7fc-ff01-4040-8c6d-051b57162b3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:01.465932 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffcb7fc-ff01-4040-8c6d-051b57162b3c admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:01.466353 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-9f23e7e8-1619-4037-a9cb-15964817c459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:01.484816 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23e7e8-1619-4037-a9cb-15964817c459 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:01.489876 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 959/1930] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:33:01 2022] POST /identity/v3/users => generated 290 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:01.490460 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcb7fc-ff01-4040-8c6d-051b57162b3c admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:01.493558 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab140e8e-0331-41e2-8998-3ea9b53a37b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:01.494449 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab140e8e-0331-41e2-8998-3ea9b53a37b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:01.494738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab140e8e-0331-41e2-8998-3ea9b53a37b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:01.495024 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab140e8e-0331-41e2-8998-3ea9b53a37b8 admin admin] PATH_INFO: `/v3/projects/a980be1932ff42cfaf87762c6eb95616` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:01.496984 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab140e8e-0331-41e2-8998-3ea9b53a37b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a980be1932ff42cfaf87762c6eb95616)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:01.498951 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab140e8e-0331-41e2-8998-3ea9b53a37b8 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:01.500200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcb7fc-ff01-4040-8c6d-051b57162b3c admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:01.506520 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be3f35-3187-458f-bc6e-66236a672ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:01.508313 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be3f35-3187-458f-bc6e-66236a672ab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:01.509055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be3f35-3187-458f-bc6e-66236a672ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:01.509348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be3f35-3187-458f-bc6e-66236a672ab1 admin admin] PATH_INFO: `/v3/projects/cc0336cd5d884f4aa76a189214548f35/users/504b9918f1a6496b8e75e5d32a8c9c3c/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:01.511433 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be3f35-3187-458f-bc6e-66236a672ab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc0336cd5d884f4aa76a189214548f35, user_id=504b9918f1a6496b8e75e5d32a8c9c3c, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:01.515167 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be3f35-3187-458f-bc6e-66236a672ab1 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:01.535524 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 960/1931] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:01 2022] PUT /identity/v3/projects/cc0336cd5d884f4aa76a189214548f35/users/504b9918f1a6496b8e75e5d32a8c9c3c/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:01.536652 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be3f35-3187-458f-bc6e-66236a672ab1 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:01.581639 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ab140e8e-0331-41e2-8998-3ea9b53a37b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a980be1932ff42cfaf87762c6eb95616', 'request_id': 'req-ab140e8e-0331-41e2-8998-3ea9b53a37b8'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:01.589817 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ab140e8e-0331-41e2-8998-3ea9b53a37b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a980be1932ff42cfaf87762c6eb95616', 'request_id': 'req-ab140e8e-0331-41e2-8998-3ea9b53a37b8'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:01.599854 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ab140e8e-0331-41e2-8998-3ea9b53a37b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a980be1932ff42cfaf87762c6eb95616', 'request_id': 'req-ab140e8e-0331-41e2-8998-3ea9b53a37b8'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:01.611531 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ab140e8e-0331-41e2-8998-3ea9b53a37b8 admin admin] The token cache is being invalidate because project a980be1932ff42cfaf87762c6eb95616 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:01.612737 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ab140e8e-0331-41e2-8998-3ea9b53a37b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:01.613571 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ab140e8e-0331-41e2-8998-3ea9b53a37b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:01.616669 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 972/1932] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:01 2022] DELETE /identity/v3/projects/a980be1932ff42cfaf87762c6eb95616 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:01.618356 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f68f6-6007-40bd-aaa7-50bd5e8eef9d None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:01.618643 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f68f6-6007-40bd-aaa7-50bd5e8eef9d None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:01.619077 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f68f6-6007-40bd-aaa7-50bd5e8eef9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:01.619514 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be3f35-3187-458f-bc6e-66236a672ab1 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:01.626775 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:01.651412 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-ee6f68f6-6007-40bd-aaa7-50bd5e8eef9d None None] MFA Rules not processed for user `504b9918f1a6496b8e75e5d32a8c9c3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:01.652647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-ee6f68f6-6007-40bd-aaa7-50bd5e8eef9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:01.690870 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c89eb-27b5-49db-83ca-6119396eb647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:01.691567 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c89eb-27b5-49db-83ca-6119396eb647 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:01.691852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c89eb-27b5-49db-83ca-6119396eb647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:01.692128 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c89eb-27b5-49db-83ca-6119396eb647 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:01.692857 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c89eb-27b5-49db-83ca-6119396eb647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:01.694443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c89eb-27b5-49db-83ca-6119396eb647 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:01.704245 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 961/1933] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:01.705032 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c89eb-27b5-49db-83ca-6119396eb647 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:01.707663 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-aa7c89eb-27b5-49db-83ca-6119396eb647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:01.720821 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c89eb-27b5-49db-83ca-6119396eb647 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:01.721999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 973/1934] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:01 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:01.726107 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f68f6-6007-40bd-aaa7-50bd5e8eef9d None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:01.726107 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-ee6f68f6-6007-40bd-aaa7-50bd5e8eef9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:01.727173 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff8d6c-c075-46c0-9655-9b04dd71e3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:01.728159 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff8d6c-c075-46c0-9655-9b04dd71e3c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:01.728373 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff8d6c-c075-46c0-9655-9b04dd71e3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:01.728653 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff8d6c-c075-46c0-9655-9b04dd71e3c5 admin admin] PATH_INFO: `/v3/users/478cd95541684a3da1c73ca6f8047895` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:01.729874 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff8d6c-c075-46c0-9655-9b04dd71e3c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=478cd95541684a3da1c73ca6f8047895)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:01.731949 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff8d6c-c075-46c0-9655-9b04dd71e3c5 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:01.785454 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-07ff8d6c-c075-46c0-9655-9b04dd71e3c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '478cd95541684a3da1c73ca6f8047895'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:01.793941 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:01.796244 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f68f6-6007-40bd-aaa7-50bd5e8eef9d None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:01.802180 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db68bc-eaf0-4c48-b39d-3a790c203dce tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c7651a64b2e4effb19c71fd1e36d792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8db9c6ff379f459bb9d7573b0516daf2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:01.802947 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db68bc-eaf0-4c48-b39d-3a790c203dce tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:01.803248 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-07ff8d6c-c075-46c0-9655-9b04dd71e3c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '478cd95541684a3da1c73ca6f8047895'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:01.803597 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db68bc-eaf0-4c48-b39d-3a790c203dce tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:01.803597 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db68bc-eaf0-4c48-b39d-3a790c203dce tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:01.804441 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db68bc-eaf0-4c48-b39d-3a790c203dce tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:01.804840 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db68bc-eaf0-4c48-b39d-3a790c203dce tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:01.806521 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db68bc-eaf0-4c48-b39d-3a790c203dce tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:01.815881 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-07ff8d6c-c075-46c0-9655-9b04dd71e3c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '478cd95541684a3da1c73ca6f8047895'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:01.817509 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-07ff8d6c-c075-46c0-9655-9b04dd71e3c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '478cd95541684a3da1c73ca6f8047895'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:01.818203 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-07ff8d6c-c075-46c0-9655-9b04dd71e3c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '478cd95541684a3da1c73ca6f8047895'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:01.819714 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 974/1935] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:01.820505 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db68bc-eaf0-4c48-b39d-3a790c203dce tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:01.822265 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-33db68bc-eaf0-4c48-b39d-3a790c203dce tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:01.843982 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db68bc-eaf0-4c48-b39d-3a790c203dce tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:01.845043 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 962/1936] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:01 2022] DELETE /identity/v3/users/478cd95541684a3da1c73ca6f8047895 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:01.845974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff8d6c-c075-46c0-9655-9b04dd71e3c5 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:01.848168 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-07ff8d6c-c075-46c0-9655-9b04dd71e3c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:01.973335 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1071a5-f020-415d-a806-7647ff8af448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:01.976556 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1071a5-f020-415d-a806-7647ff8af448 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:01.977115 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1071a5-f020-415d-a806-7647ff8af448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:01.977564 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1071a5-f020-415d-a806-7647ff8af448 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:01.978775 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1071a5-f020-415d-a806-7647ff8af448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:01.980361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff8d6c-c075-46c0-9655-9b04dd71e3c5 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:01.982773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1071a5-f020-415d-a806-7647ff8af448 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:01.984759 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b4f52-bf7a-48c3-bfc1-f42de4ece888 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:01.985541 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b4f52-bf7a-48c3-bfc1-f42de4ece888 service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:01.985928 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b4f52-bf7a-48c3-bfc1-f42de4ece888 service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:01.986309 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b4f52-bf7a-48c3-bfc1-f42de4ece888 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:01.988894 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-963b4f52-bf7a-48c3-bfc1-f42de4ece888 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:02.011666 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 975/1937] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:02.014542 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1071a5-f020-415d-a806-7647ff8af448 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:02.018806 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-2a1071a5-f020-415d-a806-7647ff8af448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:02.047014 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:02.066599 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b4f52-bf7a-48c3-bfc1-f42de4ece888 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:02.068648 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b4f52-bf7a-48c3-bfc1-f42de4ece888 service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:02.079812 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 963/1938] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:01 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:02.080597 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b4f52-bf7a-48c3-bfc1-f42de4ece888 service cinder] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:02.093139 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b4f52-bf7a-48c3-bfc1-f42de4ece888 service cinder] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:02.099763 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167655e-c5f7-4a0e-a2df-636d952cb949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:02.101161 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167655e-c5f7-4a0e-a2df-636d952cb949 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:02.101161 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167655e-c5f7-4a0e-a2df-636d952cb949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:02.101372 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167655e-c5f7-4a0e-a2df-636d952cb949 admin admin] PATH_INFO: `/v3/projects/2601553bb6644bdc976d6fc46ca72c08/users/aa8e1ee129ed43f9aacc11aabe17c851/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:02.120316 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1071a5-f020-415d-a806-7647ff8af448 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:02.126952 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167655e-c5f7-4a0e-a2df-636d952cb949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2601553bb6644bdc976d6fc46ca72c08, user_id=aa8e1ee129ed43f9aacc11aabe17c851, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:02.131098 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167655e-c5f7-4a0e-a2df-636d952cb949 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:02.133680 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276de20e-df4d-4da6-86f7-538ebad853c0 tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c7651a64b2e4effb19c71fd1e36d792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8db9c6ff379f459bb9d7573b0516daf2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:02.137394 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276de20e-df4d-4da6-86f7-538ebad853c0 tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:02.138396 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276de20e-df4d-4da6-86f7-538ebad853c0 tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:02.139960 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276de20e-df4d-4da6-86f7-538ebad853c0 tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:02.140759 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276de20e-df4d-4da6-86f7-538ebad853c0 tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:02.146337 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276de20e-df4d-4da6-86f7-538ebad853c0 tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:02.155554 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 964/1939] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:02 2022] PUT /identity/v3/projects/2601553bb6644bdc976d6fc46ca72c08/users/aa8e1ee129ed43f9aacc11aabe17c851/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:02.169745 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3cc23-de6f-47c9-9386-9a34002518b2 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:02.170499 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3cc23-de6f-47c9-9386-9a34002518b2 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:02.171533 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3cc23-de6f-47c9-9386-9a34002518b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:02.197070 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 976/1940] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:33:02 2022] POST /identity/v3/projects => generated 355 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:02.202249 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276de20e-df4d-4da6-86f7-538ebad853c0 tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:02.229622 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-dee3cc23-de6f-47c9-9386-9a34002518b2 None None] MFA Rules not processed for user `aa8e1ee129ed43f9aacc11aabe17c851`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:02.231563 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-dee3cc23-de6f-47c9-9386-9a34002518b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:02.313627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276de20e-df4d-4da6-86f7-538ebad853c0 tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:02.315914 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d1118-cab3-451b-991c-d1628534a5db tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c7651a64b2e4effb19c71fd1e36d792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8db9c6ff379f459bb9d7573b0516daf2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:02.316657 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d1118-cab3-451b-991c-d1628534a5db tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:02.316947 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d1118-cab3-451b-991c-d1628534a5db tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:02.317239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d1118-cab3-451b-991c-d1628534a5db tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:02.318199 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d1118-cab3-451b-991c-d1628534a5db tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:02.318523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d1118-cab3-451b-991c-d1628534a5db tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:02.320234 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d1118-cab3-451b-991c-d1628534a5db tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:02.333126 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:02.337633 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 977/1941] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:02.338780 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d1118-cab3-451b-991c-d1628534a5db tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:02.356215 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 965/1942] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:02.357087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3cc23-de6f-47c9-9386-9a34002518b2 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:02.358855 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-dee3cc23-de6f-47c9-9386-9a34002518b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:02.480086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d1118-cab3-451b-991c-d1628534a5db tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:02.483537 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3cc23-de6f-47c9-9386-9a34002518b2 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:02.486253 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43e115-3dac-44d9-9822-90d0c238af2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:02.487944 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43e115-3dac-44d9-9822-90d0c238af2d service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:02.488542 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43e115-3dac-44d9-9822-90d0c238af2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:02.489114 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43e115-3dac-44d9-9822-90d0c238af2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:02.492404 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-be43e115-3dac-44d9-9822-90d0c238af2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:02.495431 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea6442-5187-488e-a068-7692b83aa8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:02.497198 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea6442-5187-488e-a068-7692b83aa8b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:02.498631 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea6442-5187-488e-a068-7692b83aa8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:02.499204 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea6442-5187-488e-a068-7692b83aa8b0 admin admin] PATH_INFO: `/v3/projects/9f07f18679164c7daa7d3a8cbd539ac6` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:02.502064 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea6442-5187-488e-a068-7692b83aa8b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f07f18679164c7daa7d3a8cbd539ac6)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:02.507674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea6442-5187-488e-a068-7692b83aa8b0 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:02.603829 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:02.610535 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-93ea6442-5187-488e-a068-7692b83aa8b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f07f18679164c7daa7d3a8cbd539ac6', 'request_id': 'req-93ea6442-5187-488e-a068-7692b83aa8b0'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:02.620819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be43e115-3dac-44d9-9822-90d0c238af2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:02.622544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be43e115-3dac-44d9-9822-90d0c238af2d service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:02.625517 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-93ea6442-5187-488e-a068-7692b83aa8b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f07f18679164c7daa7d3a8cbd539ac6', 'request_id': 'req-93ea6442-5187-488e-a068-7692b83aa8b0'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:02.634829 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 978/1943] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:02 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:02.636759 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43e115-3dac-44d9-9822-90d0c238af2d service cinder] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:02.639149 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-93ea6442-5187-488e-a068-7692b83aa8b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f07f18679164c7daa7d3a8cbd539ac6', 'request_id': 'req-93ea6442-5187-488e-a068-7692b83aa8b0'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:02.648152 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43e115-3dac-44d9-9822-90d0c238af2d service cinder] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:02.661552 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-93ea6442-5187-488e-a068-7692b83aa8b0 admin admin] The token cache is being invalidate because project 9f07f18679164c7daa7d3a8cbd539ac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:02.662292 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-93ea6442-5187-488e-a068-7692b83aa8b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:02.663887 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-93ea6442-5187-488e-a068-7692b83aa8b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:02.666933 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 966/1944] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:02 2022] DELETE /identity/v3/projects/9f07f18679164c7daa7d3a8cbd539ac6 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:02.668825 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea6442-5187-488e-a068-7692b83aa8b0 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:02.672522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-93ea6442-5187-488e-a068-7692b83aa8b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:02.760343 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e3f2e-d0fa-4b08-ab26-7ef7490d62b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:02.762373 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e3f2e-d0fa-4b08-ab26-7ef7490d62b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:02.763324 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e3f2e-d0fa-4b08-ab26-7ef7490d62b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:02.763850 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e3f2e-d0fa-4b08-ab26-7ef7490d62b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:02.765943 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e3f2e-d0fa-4b08-ab26-7ef7490d62b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:02.769416 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e3f2e-d0fa-4b08-ab26-7ef7490d62b4 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:02.807908 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea6442-5187-488e-a068-7692b83aa8b0 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:02.819793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 979/1945] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:33:02 2022] POST /identity/v3/projects => generated 379 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:02.827539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e3f2e-d0fa-4b08-ab26-7ef7490d62b4 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:02.828158 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44bc5f-e471-4a6c-b07c-3572e05d78a5 tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c7651a64b2e4effb19c71fd1e36d792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8db9c6ff379f459bb9d7573b0516daf2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:02.829720 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44bc5f-e471-4a6c-b07c-3572e05d78a5 tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:02.829967 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-0f4e3f2e-d0fa-4b08-ab26-7ef7490d62b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:02.836595 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44bc5f-e471-4a6c-b07c-3572e05d78a5 tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:02.837326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44bc5f-e471-4a6c-b07c-3572e05d78a5 tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] PATH_INFO: `/v3/projects/2444b49c3a9947efa137f7fd7b7265a1` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:02.842112 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44bc5f-e471-4a6c-b07c-3572e05d78a5 tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2444b49c3a9947efa137f7fd7b7265a1)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:02.847498 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44bc5f-e471-4a6c-b07c-3572e05d78a5 tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:02.899880 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:02.937895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e3f2e-d0fa-4b08-ab26-7ef7490d62b4 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:02.944902 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-fb44bc5f-e471-4a6c-b07c-3572e05d78a5 tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2444b49c3a9947efa137f7fd7b7265a1', 'request_id': 'req-fb44bc5f-e471-4a6c-b07c-3572e05d78a5'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:02.955776 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-fb44bc5f-e471-4a6c-b07c-3572e05d78a5 tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2444b49c3a9947efa137f7fd7b7265a1', 'request_id': 'req-fb44bc5f-e471-4a6c-b07c-3572e05d78a5'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:02.968427 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-fb44bc5f-e471-4a6c-b07c-3572e05d78a5 tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2444b49c3a9947efa137f7fd7b7265a1', 'request_id': 'req-fb44bc5f-e471-4a6c-b07c-3572e05d78a5'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:02.983871 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-fb44bc5f-e471-4a6c-b07c-3572e05d78a5 tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] The token cache is being invalidate because project 2444b49c3a9947efa137f7fd7b7265a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:02.984446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-fb44bc5f-e471-4a6c-b07c-3572e05d78a5 tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:02.984815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-fb44bc5f-e471-4a6c-b07c-3572e05d78a5 tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:02.987154 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 967/1946] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:02 2022] DELETE /identity/v3/projects/2444b49c3a9947efa137f7fd7b7265a1 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:02.987862 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44bc5f-e471-4a6c-b07c-3572e05d78a5 tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:02.989358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-fb44bc5f-e471-4a6c-b07c-3572e05d78a5 tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:03.032741 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05904cc1-1f25-4952-ba30-e77569e7c093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:03.034066 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05904cc1-1f25-4952-ba30-e77569e7c093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:03.034918 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05904cc1-1f25-4952-ba30-e77569e7c093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:03.035457 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05904cc1-1f25-4952-ba30-e77569e7c093 admin admin] PATH_INFO: `/v3/users/e0e9f1c4d685483d9807a2c87d443474` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:03.037088 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05904cc1-1f25-4952-ba30-e77569e7c093 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0e9f1c4d685483d9807a2c87d443474)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:03.039553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05904cc1-1f25-4952-ba30-e77569e7c093 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:03.081927 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:03.110383 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-05904cc1-1f25-4952-ba30-e77569e7c093 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0e9f1c4d685483d9807a2c87d443474'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:03.117608 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44bc5f-e471-4a6c-b07c-3572e05d78a5 tempest-VolumeQuotaClassesTest-191812208 tempest-VolumeQuotaClassesTest-191812208-project-admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:03.123116 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd54bc9-4ba5-44da-8698-8ddf2502d122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:03.123858 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd54bc9-4ba5-44da-8698-8ddf2502d122 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:03.124148 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd54bc9-4ba5-44da-8698-8ddf2502d122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:03.124618 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd54bc9-4ba5-44da-8698-8ddf2502d122 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:03.125340 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd54bc9-4ba5-44da-8698-8ddf2502d122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:03.127946 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-05904cc1-1f25-4952-ba30-e77569e7c093 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0e9f1c4d685483d9807a2c87d443474'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:03.128138 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd54bc9-4ba5-44da-8698-8ddf2502d122 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:03.142491 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-05904cc1-1f25-4952-ba30-e77569e7c093 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0e9f1c4d685483d9807a2c87d443474'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:03.144115 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-05904cc1-1f25-4952-ba30-e77569e7c093 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0e9f1c4d685483d9807a2c87d443474'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:03.145761 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-05904cc1-1f25-4952-ba30-e77569e7c093 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0e9f1c4d685483d9807a2c87d443474'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:03.152066 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 968/1947] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:33:02 2022] POST /identity/v3/users => generated 296 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:03.157956 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd54bc9-4ba5-44da-8698-8ddf2502d122 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:03.160831 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-1dd54bc9-4ba5-44da-8698-8ddf2502d122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:03.169168 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 980/1948] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:02 2022] DELETE /identity/v3/users/e0e9f1c4d685483d9807a2c87d443474 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:03.180406 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd54bc9-4ba5-44da-8698-8ddf2502d122 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:03.257824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05904cc1-1f25-4952-ba30-e77569e7c093 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:03.260043 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-05904cc1-1f25-4952-ba30-e77569e7c093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:03.273719 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d10cfc-a6fc-4350-b90e-c9a32afb7d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:03.275214 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d10cfc-a6fc-4350-b90e-c9a32afb7d83 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:03.275586 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d10cfc-a6fc-4350-b90e-c9a32afb7d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:03.276096 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d10cfc-a6fc-4350-b90e-c9a32afb7d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:03.276888 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d10cfc-a6fc-4350-b90e-c9a32afb7d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:03.279067 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d10cfc-a6fc-4350-b90e-c9a32afb7d83 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:03.292313 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 969/1949] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:33:03.296312 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d10cfc-a6fc-4350-b90e-c9a32afb7d83 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:03.310183 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d10cfc-a6fc-4350-b90e-c9a32afb7d83 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:03.316418 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105be1e-364f-4b43-b735-3d7627621398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:03.317528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105be1e-364f-4b43-b735-3d7627621398 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:03.317935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105be1e-364f-4b43-b735-3d7627621398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:03.318286 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105be1e-364f-4b43-b735-3d7627621398 admin admin] PATH_INFO: `/v3/projects/6f56eb65c99e43cbb9670dcdcc501235/users/23166144fa9b4315b353eadbfa4e2ec4/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:03.335003 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105be1e-364f-4b43-b735-3d7627621398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f56eb65c99e43cbb9670dcdcc501235, user_id=23166144fa9b4315b353eadbfa4e2ec4, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:03.338269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105be1e-364f-4b43-b735-3d7627621398 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:03.349660 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05904cc1-1f25-4952-ba30-e77569e7c093 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:03.357327 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 970/1950] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:03 2022] PUT /identity/v3/projects/6f56eb65c99e43cbb9670dcdcc501235/users/23166144fa9b4315b353eadbfa4e2ec4/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:33:03.362867 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105be1e-364f-4b43-b735-3d7627621398 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:03.381637 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:03.435276 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253c095-2d95-4491-b376-29d548b44d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:03.436131 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253c095-2d95-4491-b376-29d548b44d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:03.436668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253c095-2d95-4491-b376-29d548b44d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:03.436965 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253c095-2d95-4491-b376-29d548b44d8e admin admin] PATH_INFO: `/v3/users/5ed64ae5df274ded8d8f8701246d9a4b` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:03.438445 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253c095-2d95-4491-b376-29d548b44d8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ed64ae5df274ded8d8f8701246d9a4b)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:03.442043 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253c095-2d95-4491-b376-29d548b44d8e admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:03.470182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105be1e-364f-4b43-b735-3d7627621398 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:03.490049 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347dae12-96f3-4eae-9b7b-1a81f7159a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:03.490750 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dae12-96f3-4eae-9b7b-1a81f7159a36 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:03.491211 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dae12-96f3-4eae-9b7b-1a81f7159a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:03.491417 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dae12-96f3-4eae-9b7b-1a81f7159a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:03.492338 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347dae12-96f3-4eae-9b7b-1a81f7159a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:03.494102 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347dae12-96f3-4eae-9b7b-1a81f7159a36 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:03.509829 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 971/1951] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:33:03.513867 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347dae12-96f3-4eae-9b7b-1a81f7159a36 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:03.526519 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-1253c095-2d95-4491-b376-29d548b44d8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ed64ae5df274ded8d8f8701246d9a4b'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:03.526942 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347dae12-96f3-4eae-9b7b-1a81f7159a36 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:03.534990 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade422e-f4d0-42be-8923-dba158e1a3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:03.535480 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade422e-f4d0-42be-8923-dba158e1a3f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:03.535766 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade422e-f4d0-42be-8923-dba158e1a3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:03.536035 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade422e-f4d0-42be-8923-dba158e1a3f6 admin admin] PATH_INFO: `/v3/projects/6f56eb65c99e43cbb9670dcdcc501235/users/23166144fa9b4315b353eadbfa4e2ec4/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:03.538443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade422e-f4d0-42be-8923-dba158e1a3f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f56eb65c99e43cbb9670dcdcc501235, user_id=23166144fa9b4315b353eadbfa4e2ec4, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:03.541352 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade422e-f4d0-42be-8923-dba158e1a3f6 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:03.552654 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:03.555109 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 972/1952] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:03 2022] PUT /identity/v3/projects/6f56eb65c99e43cbb9670dcdcc501235/users/23166144fa9b4315b353eadbfa4e2ec4/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:33:03.571073 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c283d-09db-4b9e-a67a-9869bbbddb01 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:03.571557 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c283d-09db-4b9e-a67a-9869bbbddb01 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:03.571936 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c283d-09db-4b9e-a67a-9869bbbddb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:03.576500 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-1253c095-2d95-4491-b376-29d548b44d8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ed64ae5df274ded8d8f8701246d9a4b'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:03.587451 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-1253c095-2d95-4491-b376-29d548b44d8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ed64ae5df274ded8d8f8701246d9a4b'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:03.588903 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-1253c095-2d95-4491-b376-29d548b44d8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ed64ae5df274ded8d8f8701246d9a4b'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:03.589892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-1253c095-2d95-4491-b376-29d548b44d8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ed64ae5df274ded8d8f8701246d9a4b'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:03.614617 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 981/1953] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:03 2022] DELETE /identity/v3/users/5ed64ae5df274ded8d8f8701246d9a4b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:03.616898 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c331587-fbed-454e-a972-90b9632ebf71 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:03.617096 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c331587-fbed-454e-a972-90b9632ebf71 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:03.617588 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c331587-fbed-454e-a972-90b9632ebf71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:03.621921 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-1c6c283d-09db-4b9e-a67a-9869bbbddb01 None None] MFA Rules not processed for user `23166144fa9b4315b353eadbfa4e2ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:03.626372 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-1c6c283d-09db-4b9e-a67a-9869bbbddb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:03.662451 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-1c331587-fbed-454e-a972-90b9632ebf71 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:03.663923 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-1c331587-fbed-454e-a972-90b9632ebf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:03.736816 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 973/1954] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:03 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:03.748772 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c283d-09db-4b9e-a67a-9869bbbddb01 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:03.752776 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-1c6c283d-09db-4b9e-a67a-9869bbbddb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:03.757153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 982/1955] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:03.823624 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c283d-09db-4b9e-a67a-9869bbbddb01 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:03.827773 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674e63a-d3f6-402a-84f3-3e7abf6da449 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:03.828572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674e63a-d3f6-402a-84f3-3e7abf6da449 service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:03.828963 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674e63a-d3f6-402a-84f3-3e7abf6da449 service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:03.829319 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674e63a-d3f6-402a-84f3-3e7abf6da449 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:03.863195 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674e63a-d3f6-402a-84f3-3e7abf6da449 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:03.864540 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674e63a-d3f6-402a-84f3-3e7abf6da449 service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:03.888295 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 974/1956] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:03 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:03.941239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c331587-fbed-454e-a972-90b9632ebf71 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:03.946726 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-1c331587-fbed-454e-a972-90b9632ebf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:03.994808 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c331587-fbed-454e-a972-90b9632ebf71 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:04.009831 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8111f6d-4a18-4347-a476-5c79df84db8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:04.010744 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8111f6d-4a18-4347-a476-5c79df84db8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:04.020030 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8111f6d-4a18-4347-a476-5c79df84db8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:04.020373 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8111f6d-4a18-4347-a476-5c79df84db8c admin admin] PATH_INFO: `/v3/projects/46e95f1607e948e49be498a787497306` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:04.029646 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8111f6d-4a18-4347-a476-5c79df84db8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=46e95f1607e948e49be498a787497306)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:04.035838 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8111f6d-4a18-4347-a476-5c79df84db8c admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:04.091713 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674e63a-d3f6-402a-84f3-3e7abf6da449 service cinder] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:04.093279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-9674e63a-d3f6-402a-84f3-3e7abf6da449 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:04.178106 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-f8111f6d-4a18-4347-a476-5c79df84db8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46e95f1607e948e49be498a787497306', 'request_id': 'req-f8111f6d-4a18-4347-a476-5c79df84db8c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:04.196714 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-f8111f6d-4a18-4347-a476-5c79df84db8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46e95f1607e948e49be498a787497306', 'request_id': 'req-f8111f6d-4a18-4347-a476-5c79df84db8c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:04.203585 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:04.223811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-f8111f6d-4a18-4347-a476-5c79df84db8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46e95f1607e948e49be498a787497306', 'request_id': 'req-f8111f6d-4a18-4347-a476-5c79df84db8c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:04.253029 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-f8111f6d-4a18-4347-a476-5c79df84db8c admin admin] The token cache is being invalidate because project 46e95f1607e948e49be498a787497306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:04.253347 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-f8111f6d-4a18-4347-a476-5c79df84db8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:04.257815 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-f8111f6d-4a18-4347-a476-5c79df84db8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:04.261757 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 983/1957] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:03 2022] DELETE /identity/v3/projects/46e95f1607e948e49be498a787497306 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:33:04.269341 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5de57-dabb-4f56-bc5b-28dc6828497a None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:04.269643 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5de57-dabb-4f56-bc5b-28dc6828497a None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:04.269929 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5de57-dabb-4f56-bc5b-28dc6828497a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:04.317344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-88a5de57-dabb-4f56-bc5b-28dc6828497a None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:04.318709 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674e63a-d3f6-402a-84f3-3e7abf6da449 service cinder] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:04.321071 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-88a5de57-dabb-4f56-bc5b-28dc6828497a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:04.445915 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c087d9-386c-49bb-aa2d-8f4dafe2fff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:04.449993 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c087d9-386c-49bb-aa2d-8f4dafe2fff2 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:04.450470 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c087d9-386c-49bb-aa2d-8f4dafe2fff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:04.450907 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c087d9-386c-49bb-aa2d-8f4dafe2fff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:04.456823 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-a2c087d9-386c-49bb-aa2d-8f4dafe2fff2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:04.460670 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:04.502203 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 984/1958] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:33:04.512680 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0b206-fb45-4a61-830a-63820f5773e9 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:04.513343 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0b206-fb45-4a61-830a-63820f5773e9 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:04.513947 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0b206-fb45-4a61-830a-63820f5773e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:04.568608 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-d1b0b206-fb45-4a61-830a-63820f5773e9 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:04.570280 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-d1b0b206-fb45-4a61-830a-63820f5773e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:04.590296 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 985/1959] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:04.597322 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0b206-fb45-4a61-830a-63820f5773e9 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:04.603801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c087d9-386c-49bb-aa2d-8f4dafe2fff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:04.605447 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c087d9-386c-49bb-aa2d-8f4dafe2fff2 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:04.625008 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0b206-fb45-4a61-830a-63820f5773e9 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:04.637654 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 975/1960] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:04.652392 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94ff9c-473f-4cec-b493-e76f2fc8707e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:04.656401 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94ff9c-473f-4cec-b493-e76f2fc8707e admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:04.659088 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94ff9c-473f-4cec-b493-e76f2fc8707e admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:04.660791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94ff9c-473f-4cec-b493-e76f2fc8707e admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:04.664554 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94ff9c-473f-4cec-b493-e76f2fc8707e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:04.664890 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94ff9c-473f-4cec-b493-e76f2fc8707e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:04.676144 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94ff9c-473f-4cec-b493-e76f2fc8707e admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:04.699551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 986/1961] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:04.703751 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c087d9-386c-49bb-aa2d-8f4dafe2fff2 service neutron] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:04.718052 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c087d9-386c-49bb-aa2d-8f4dafe2fff2 service neutron] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:04.724879 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81673ff-bbb8-42f9-843f-8b48bc8a5f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:04.724879 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81673ff-bbb8-42f9-843f-8b48bc8a5f49 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:04.724879 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81673ff-bbb8-42f9-843f-8b48bc8a5f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:04.724879 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81673ff-bbb8-42f9-843f-8b48bc8a5f49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:04.725493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81673ff-bbb8-42f9-843f-8b48bc8a5f49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:04.727764 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81673ff-bbb8-42f9-843f-8b48bc8a5f49 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:04.762441 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 976/1962] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:33:04 2022] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:33:04.766538 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94ff9c-473f-4cec-b493-e76f2fc8707e admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:04.784098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94ff9c-473f-4cec-b493-e76f2fc8707e admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:04.961664 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6b154-d305-4cc4-94e3-1d673edd9f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:04.962531 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6b154-d305-4cc4-94e3-1d673edd9f0c admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:04.963063 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6b154-d305-4cc4-94e3-1d673edd9f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:04.963478 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6b154-d305-4cc4-94e3-1d673edd9f0c admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:04.964404 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6b154-d305-4cc4-94e3-1d673edd9f0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:04.966649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6b154-d305-4cc4-94e3-1d673edd9f0c admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:05.022473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 987/1963] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:33:04 2022] POST /identity/v3/users => generated 285 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:05.023714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81673ff-bbb8-42f9-843f-8b48bc8a5f49 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:05.036019 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81673ff-bbb8-42f9-843f-8b48bc8a5f49 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:05.042851 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc351ffb-a315-495a-9a2e-871fb7f9b865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:05.044607 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc351ffb-a315-495a-9a2e-871fb7f9b865 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:05.045053 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc351ffb-a315-495a-9a2e-871fb7f9b865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:05.045682 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc351ffb-a315-495a-9a2e-871fb7f9b865 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:05.046332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc351ffb-a315-495a-9a2e-871fb7f9b865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:05.048467 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc351ffb-a315-495a-9a2e-871fb7f9b865 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:05.063436 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 977/1964] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:33:05.067114 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6b154-d305-4cc4-94e3-1d673edd9f0c admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:05.080276 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6b154-d305-4cc4-94e3-1d673edd9f0c admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:05.098142 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efe3d2-c909-40c9-951b-31cb0795f95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:05.101133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efe3d2-c909-40c9-951b-31cb0795f95c admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:05.101133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efe3d2-c909-40c9-951b-31cb0795f95c admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:05.101133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efe3d2-c909-40c9-951b-31cb0795f95c admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:05.101555 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37efe3d2-c909-40c9-951b-31cb0795f95c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:05.103474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37efe3d2-c909-40c9-951b-31cb0795f95c admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:05.119953 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 988/1965] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:05.123871 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc351ffb-a315-495a-9a2e-871fb7f9b865 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:05.137001 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc351ffb-a315-495a-9a2e-871fb7f9b865 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:05.142152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4c28f-255b-44b8-9360-a7fff2e3b663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:05.143739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4c28f-255b-44b8-9360-a7fff2e3b663 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:05.144102 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4c28f-255b-44b8-9360-a7fff2e3b663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:05.144453 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4c28f-255b-44b8-9360-a7fff2e3b663 admin admin] PATH_INFO: `/v3/projects/b7df7b81500b40feb409034006c92684/users/e83eba4331414874bef93e35932fe4f9/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:05.181002 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4c28f-255b-44b8-9360-a7fff2e3b663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7df7b81500b40feb409034006c92684, user_id=e83eba4331414874bef93e35932fe4f9, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:05.183727 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4c28f-255b-44b8-9360-a7fff2e3b663 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:05.203538 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efe3d2-c909-40c9-951b-31cb0795f95c admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:05.211213 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-37efe3d2-c909-40c9-951b-31cb0795f95c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:05.212541 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 978/1966] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:05 2022] PUT /identity/v3/projects/b7df7b81500b40feb409034006c92684/users/e83eba4331414874bef93e35932fe4f9/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:33:05.224572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86368ea1-2a8e-496a-b211-f9c172b02449 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:05.224572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86368ea1-2a8e-496a-b211-f9c172b02449 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:05.224884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86368ea1-2a8e-496a-b211-f9c172b02449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:05.241712 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efe3d2-c909-40c9-951b-31cb0795f95c admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:05.276966 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-86368ea1-2a8e-496a-b211-f9c172b02449 None None] MFA Rules not processed for user `e83eba4331414874bef93e35932fe4f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:05.280914 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-86368ea1-2a8e-496a-b211-f9c172b02449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:05.319954 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:05.389508 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 979/1967] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:05 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:05.395929 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e8b84-4b79-4c24-954c-6d031fee059d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:05.399477 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e8b84-4b79-4c24-954c-6d031fee059d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:05.400126 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e8b84-4b79-4c24-954c-6d031fee059d admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:05.400563 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e8b84-4b79-4c24-954c-6d031fee059d admin admin] PATH_INFO: `/v3/users/aa8e1ee129ed43f9aacc11aabe17c851` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:05.403935 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e8b84-4b79-4c24-954c-6d031fee059d admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa8e1ee129ed43f9aacc11aabe17c851)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:05.406477 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e8b84-4b79-4c24-954c-6d031fee059d admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:05.406930 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86368ea1-2a8e-496a-b211-f9c172b02449 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:05.408588 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-86368ea1-2a8e-496a-b211-f9c172b02449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:05.537688 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-616e8b84-4b79-4c24-954c-6d031fee059d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa8e1ee129ed43f9aacc11aabe17c851'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:05.541062 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86368ea1-2a8e-496a-b211-f9c172b02449 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:05.545913 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a956cad-10c0-41b2-82f9-01c72e9368c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:05.546974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a956cad-10c0-41b2-82f9-01c72e9368c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:05.547467 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a956cad-10c0-41b2-82f9-01c72e9368c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:05.547762 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a956cad-10c0-41b2-82f9-01c72e9368c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:05.556897 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:05.566164 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a956cad-10c0-41b2-82f9-01c72e9368c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:05.569955 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a956cad-10c0-41b2-82f9-01c72e9368c0 service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:05.578202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-616e8b84-4b79-4c24-954c-6d031fee059d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa8e1ee129ed43f9aacc11aabe17c851'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:05.599005 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-616e8b84-4b79-4c24-954c-6d031fee059d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa8e1ee129ed43f9aacc11aabe17c851'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:05.600309 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-616e8b84-4b79-4c24-954c-6d031fee059d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa8e1ee129ed43f9aacc11aabe17c851'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:05.600788 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 980/1968] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:05 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:05.602544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-616e8b84-4b79-4c24-954c-6d031fee059d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa8e1ee129ed43f9aacc11aabe17c851'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:05.640564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a956cad-10c0-41b2-82f9-01c72e9368c0 service cinder] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:05.678923 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 989/1969] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:05 2022] DELETE /identity/v3/users/aa8e1ee129ed43f9aacc11aabe17c851 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:05.690586 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b47fa-0ac5-4144-a2bb-30042ce04fe1 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:05.692691 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b47fa-0ac5-4144-a2bb-30042ce04fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:05.693210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b47fa-0ac5-4144-a2bb-30042ce04fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:05.696403 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a956cad-10c0-41b2-82f9-01c72e9368c0 service cinder] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:05.725038 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-cf5b47fa-0ac5-4144-a2bb-30042ce04fe1 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:05.727636 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-cf5b47fa-0ac5-4144-a2bb-30042ce04fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:05.771878 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca8892-a45f-4042-86b4-4f2e54bfb057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:05.773199 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca8892-a45f-4042-86b4-4f2e54bfb057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:05.773575 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca8892-a45f-4042-86b4-4f2e54bfb057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:05.773909 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca8892-a45f-4042-86b4-4f2e54bfb057 admin admin] PATH_INFO: `/v3/users/e83eba4331414874bef93e35932fe4f9` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:05.775392 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca8892-a45f-4042-86b4-4f2e54bfb057 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e83eba4331414874bef93e35932fe4f9)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:05.777413 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca8892-a45f-4042-86b4-4f2e54bfb057 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:05.836828 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 990/1970] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:05.849603 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b47fa-0ac5-4144-a2bb-30042ce04fe1 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:05.850977 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-cf5b47fa-0ac5-4144-a2bb-30042ce04fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:05.860784 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-6aca8892-a45f-4042-86b4-4f2e54bfb057 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e83eba4331414874bef93e35932fe4f9'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:05.881704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-6aca8892-a45f-4042-86b4-4f2e54bfb057 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e83eba4331414874bef93e35932fe4f9'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:05.883895 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:05.894721 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-6aca8892-a45f-4042-86b4-4f2e54bfb057 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e83eba4331414874bef93e35932fe4f9'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:05.895520 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-6aca8892-a45f-4042-86b4-4f2e54bfb057 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e83eba4331414874bef93e35932fe4f9'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:05.896407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-6aca8892-a45f-4042-86b4-4f2e54bfb057 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e83eba4331414874bef93e35932fe4f9'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:05.915723 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 981/1971] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:05 2022] DELETE /identity/v3/users/e83eba4331414874bef93e35932fe4f9 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:33:05.917379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca8892-a45f-4042-86b4-4f2e54bfb057 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:05.919463 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-6aca8892-a45f-4042-86b4-4f2e54bfb057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:05.929515 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b47fa-0ac5-4144-a2bb-30042ce04fe1 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:05.997243 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20b67b-5af5-4833-9e44-4d6137b24241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:05.998293 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20b67b-5af5-4833-9e44-4d6137b24241 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:05.998760 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20b67b-5af5-4833-9e44-4d6137b24241 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:05.999232 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20b67b-5af5-4833-9e44-4d6137b24241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:06.002081 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-0f20b67b-5af5-4833-9e44-4d6137b24241 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:06.044078 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca8892-a45f-4042-86b4-4f2e54bfb057 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:06.056983 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2882156-87ea-4149-a2dc-d6e3230e7619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:06.060664 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2882156-87ea-4149-a2dc-d6e3230e7619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:06.060959 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2882156-87ea-4149-a2dc-d6e3230e7619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:06.061259 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2882156-87ea-4149-a2dc-d6e3230e7619 admin admin] PATH_INFO: `/v3/projects/913dd429559f4a9da54e59419d631348` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:06.063157 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2882156-87ea-4149-a2dc-d6e3230e7619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=913dd429559f4a9da54e59419d631348)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:06.065719 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2882156-87ea-4149-a2dc-d6e3230e7619 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:06.101245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:06.126889 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-a2882156-87ea-4149-a2dc-d6e3230e7619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '913dd429559f4a9da54e59419d631348', 'request_id': 'req-a2882156-87ea-4149-a2dc-d6e3230e7619'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:06.128728 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20b67b-5af5-4833-9e44-4d6137b24241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:06.130348 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20b67b-5af5-4833-9e44-4d6137b24241 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:06.135989 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-a2882156-87ea-4149-a2dc-d6e3230e7619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '913dd429559f4a9da54e59419d631348', 'request_id': 'req-a2882156-87ea-4149-a2dc-d6e3230e7619'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:06.140881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 991/1972] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:06.142219 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab456239-6f94-4ce1-8bc9-b8f1f4d0478a None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:06.142603 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab456239-6f94-4ce1-8bc9-b8f1f4d0478a None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:06.142830 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab456239-6f94-4ce1-8bc9-b8f1f4d0478a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:06.152452 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-a2882156-87ea-4149-a2dc-d6e3230e7619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '913dd429559f4a9da54e59419d631348', 'request_id': 'req-a2882156-87ea-4149-a2dc-d6e3230e7619'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:06.162006 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-ab456239-6f94-4ce1-8bc9-b8f1f4d0478a None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:06.163383 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-ab456239-6f94-4ce1-8bc9-b8f1f4d0478a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:06.168522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-a2882156-87ea-4149-a2dc-d6e3230e7619 admin admin] The token cache is being invalidate because project 913dd429559f4a9da54e59419d631348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:06.168824 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-a2882156-87ea-4149-a2dc-d6e3230e7619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:06.170185 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-a2882156-87ea-4149-a2dc-d6e3230e7619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:06.172941 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 982/1973] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:05 2022] DELETE /identity/v3/projects/913dd429559f4a9da54e59419d631348 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:06.173723 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2882156-87ea-4149-a2dc-d6e3230e7619 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:06.175804 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-a2882156-87ea-4149-a2dc-d6e3230e7619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:06.248774 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 992/1974] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:06.249841 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab456239-6f94-4ce1-8bc9-b8f1f4d0478a None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:06.254288 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-ab456239-6f94-4ce1-8bc9-b8f1f4d0478a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:06.269925 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab456239-6f94-4ce1-8bc9-b8f1f4d0478a None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:06.278479 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4cc45c-a407-4602-ad63-6eb183096dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:06.279671 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cc45c-a407-4602-ad63-6eb183096dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:06.279979 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cc45c-a407-4602-ad63-6eb183096dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:06.280290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cc45c-a407-4602-ad63-6eb183096dae admin admin] PATH_INFO: `/v3/users/2c7651a64b2e4effb19c71fd1e36d792` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:06.282165 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4cc45c-a407-4602-ad63-6eb183096dae admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c7651a64b2e4effb19c71fd1e36d792)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:06.285517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4cc45c-a407-4602-ad63-6eb183096dae admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:06.289420 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2882156-87ea-4149-a2dc-d6e3230e7619 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:06.296006 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e08726-812e-478c-b935-a37f34e444b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:06.297228 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e08726-812e-478c-b935-a37f34e444b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:06.297515 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e08726-812e-478c-b935-a37f34e444b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:06.297795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e08726-812e-478c-b935-a37f34e444b5 admin admin] PATH_INFO: `/v3/users/cf1b4843f2c8409eb6db58d614acdc7c` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:06.300037 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e08726-812e-478c-b935-a37f34e444b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf1b4843f2c8409eb6db58d614acdc7c)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:06.302977 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e08726-812e-478c-b935-a37f34e444b5 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:06.320678 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:06.412815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-26e08726-812e-478c-b935-a37f34e444b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf1b4843f2c8409eb6db58d614acdc7c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:06.422821 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ef4cc45c-a407-4602-ad63-6eb183096dae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c7651a64b2e4effb19c71fd1e36d792'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:06.445000 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-26e08726-812e-478c-b935-a37f34e444b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf1b4843f2c8409eb6db58d614acdc7c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:06.451580 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ef4cc45c-a407-4602-ad63-6eb183096dae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c7651a64b2e4effb19c71fd1e36d792'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:06.460006 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-26e08726-812e-478c-b935-a37f34e444b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf1b4843f2c8409eb6db58d614acdc7c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:06.462122 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-26e08726-812e-478c-b935-a37f34e444b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf1b4843f2c8409eb6db58d614acdc7c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:06.463688 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-26e08726-812e-478c-b935-a37f34e444b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf1b4843f2c8409eb6db58d614acdc7c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:06.468590 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ef4cc45c-a407-4602-ad63-6eb183096dae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c7651a64b2e4effb19c71fd1e36d792'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:06.470841 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ef4cc45c-a407-4602-ad63-6eb183096dae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c7651a64b2e4effb19c71fd1e36d792'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:06.473970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ef4cc45c-a407-4602-ad63-6eb183096dae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c7651a64b2e4effb19c71fd1e36d792'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:06.495316 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 983/1975] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:06 2022] DELETE /identity/v3/users/cf1b4843f2c8409eb6db58d614acdc7c => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:06.496576 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e08726-812e-478c-b935-a37f34e444b5 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:06.501173 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-26e08726-812e-478c-b935-a37f34e444b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:06.503579 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 993/1976] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:06 2022] DELETE /identity/v3/users/2c7651a64b2e4effb19c71fd1e36d792 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:06.505195 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c987a2a-225f-46d7-b0c3-691f0e914939 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:06.506047 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c987a2a-225f-46d7-b0c3-691f0e914939 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:06.507028 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c987a2a-225f-46d7-b0c3-691f0e914939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:06.563603 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-7c987a2a-225f-46d7-b0c3-691f0e914939 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:06.568422 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-7c987a2a-225f-46d7-b0c3-691f0e914939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:06.639400 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e08726-812e-478c-b935-a37f34e444b5 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:06.680649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:06.709070 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 994/1977] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:06.721756 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c987a2a-225f-46d7-b0c3-691f0e914939 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:06.723759 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-7c987a2a-225f-46d7-b0c3-691f0e914939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:06.732094 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa58dee-a740-4432-9950-f28dd7b3992c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:06.732520 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa58dee-a740-4432-9950-f28dd7b3992c service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:06.732818 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa58dee-a740-4432-9950-f28dd7b3992c service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:06.733705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa58dee-a740-4432-9950-f28dd7b3992c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:06.737040 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-2aa58dee-a740-4432-9950-f28dd7b3992c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:06.763058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa58dee-a740-4432-9950-f28dd7b3992c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:06.763058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa58dee-a740-4432-9950-f28dd7b3992c service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:06.778138 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 984/1978] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:06.866455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c987a2a-225f-46d7-b0c3-691f0e914939 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:06.873629 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e5845-2944-45be-b95b-067a26d842da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:06.874314 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e5845-2944-45be-b95b-067a26d842da service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:06.874650 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e5845-2944-45be-b95b-067a26d842da service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:06.874933 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e5845-2944-45be-b95b-067a26d842da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:06.890164 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e5845-2944-45be-b95b-067a26d842da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:06.891276 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa58dee-a740-4432-9950-f28dd7b3992c service neutron] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:06.892191 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e5845-2944-45be-b95b-067a26d842da service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:06.893298 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-2aa58dee-a740-4432-9950-f28dd7b3992c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:06.913685 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa58dee-a740-4432-9950-f28dd7b3992c service neutron] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:06.921462 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 995/1979] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:06.930587 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7addb-9a95-40dc-968f-e72bb3f5601d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:06.931554 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7addb-9a95-40dc-968f-e72bb3f5601d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:06.931793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7addb-9a95-40dc-968f-e72bb3f5601d admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:06.932082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7addb-9a95-40dc-968f-e72bb3f5601d admin admin] PATH_INFO: `/v3/projects/2601553bb6644bdc976d6fc46ca72c08` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:06.933524 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7addb-9a95-40dc-968f-e72bb3f5601d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2601553bb6644bdc976d6fc46ca72c08)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:06.935675 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7addb-9a95-40dc-968f-e72bb3f5601d admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:07.015869 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:07.024115 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-94d7addb-9a95-40dc-968f-e72bb3f5601d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2601553bb6644bdc976d6fc46ca72c08', 'request_id': 'req-94d7addb-9a95-40dc-968f-e72bb3f5601d'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:07.028002 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68260c0-5330-4a8e-98c0-e8bf0aa3d1c9 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:07.028991 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68260c0-5330-4a8e-98c0-e8bf0aa3d1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:07.029518 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68260c0-5330-4a8e-98c0-e8bf0aa3d1c9 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:07.031464 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 996/1980] 10.222.0.44 () {54 vars in 921 bytes} [Tue Jul 19 15:33:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 15:33:07.037654 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-94d7addb-9a95-40dc-968f-e72bb3f5601d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2601553bb6644bdc976d6fc46ca72c08', 'request_id': 'req-94d7addb-9a95-40dc-968f-e72bb3f5601d'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:07.055944 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-94d7addb-9a95-40dc-968f-e72bb3f5601d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2601553bb6644bdc976d6fc46ca72c08', 'request_id': 'req-94d7addb-9a95-40dc-968f-e72bb3f5601d'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:07.074544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4bba8-9209-498c-ad25-5f49452d07ea None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:07.074544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4bba8-9209-498c-ad25-5f49452d07ea None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:07.074860 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4bba8-9209-498c-ad25-5f49452d07ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:07.130204 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-94d7addb-9a95-40dc-968f-e72bb3f5601d admin admin] The token cache is being invalidate because project 2601553bb6644bdc976d6fc46ca72c08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:07.130700 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-94d7addb-9a95-40dc-968f-e72bb3f5601d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:07.132263 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-70f4bba8-9209-498c-ad25-5f49452d07ea None None] MFA Rules not processed for user `fef0511f56144ca9945b2dddfa2601a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:07.133384 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-70f4bba8-9209-498c-ad25-5f49452d07ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:07.134992 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-94d7addb-9a95-40dc-968f-e72bb3f5601d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:07.144984 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 985/1981] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:06 2022] DELETE /identity/v3/projects/2601553bb6644bdc976d6fc46ca72c08 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:07.146027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7addb-9a95-40dc-968f-e72bb3f5601d admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:07.150673 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-94d7addb-9a95-40dc-968f-e72bb3f5601d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:07.303683 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7addb-9a95-40dc-968f-e72bb3f5601d admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:07.309064 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37187a-e61e-4517-8f99-10d51436cfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:07.310272 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37187a-e61e-4517-8f99-10d51436cfd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:07.310653 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37187a-e61e-4517-8f99-10d51436cfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:07.311199 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37187a-e61e-4517-8f99-10d51436cfd4 admin admin] PATH_INFO: `/v3/users/23166144fa9b4315b353eadbfa4e2ec4` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:07.312692 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37187a-e61e-4517-8f99-10d51436cfd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23166144fa9b4315b353eadbfa4e2ec4)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:07.316031 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37187a-e61e-4517-8f99-10d51436cfd4 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:07.347163 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 997/1982] 10.222.0.44 () {58 vars in 1018 bytes} [Tue Jul 19 15:33:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:33:07.368061 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4bba8-9209-498c-ad25-5f49452d07ea None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:07.371280 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-70f4bba8-9209-498c-ad25-5f49452d07ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:07.404779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-cb37187a-e61e-4517-8f99-10d51436cfd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23166144fa9b4315b353eadbfa4e2ec4'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:07.410316 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4bba8-9209-498c-ad25-5f49452d07ea None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:07.417603 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4dd0a-cd25-4a75-a576-70e540bd8c05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:07.418742 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4dd0a-cd25-4a75-a576-70e540bd8c05 service nova] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:07.419730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4dd0a-cd25-4a75-a576-70e540bd8c05 service nova] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:07.420717 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-cb37187a-e61e-4517-8f99-10d51436cfd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23166144fa9b4315b353eadbfa4e2ec4'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:07.420852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4dd0a-cd25-4a75-a576-70e540bd8c05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:07.430330 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-cb37187a-e61e-4517-8f99-10d51436cfd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23166144fa9b4315b353eadbfa4e2ec4'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:07.431170 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-cb37187a-e61e-4517-8f99-10d51436cfd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23166144fa9b4315b353eadbfa4e2ec4'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:07.431939 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-cb37187a-e61e-4517-8f99-10d51436cfd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23166144fa9b4315b353eadbfa4e2ec4'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:07.436252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4dd0a-cd25-4a75-a576-70e540bd8c05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:07.438876 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4dd0a-cd25-4a75-a576-70e540bd8c05 service nova] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:07.455473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 998/1983] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:07.460496 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 986/1984] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:07 2022] DELETE /identity/v3/users/23166144fa9b4315b353eadbfa4e2ec4 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:07.575819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4dd0a-cd25-4a75-a576-70e540bd8c05 service nova] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:07.578097 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-dfc4dd0a-cd25-4a75-a576-70e540bd8c05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:07.598733 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4dd0a-cd25-4a75-a576-70e540bd8c05 service nova] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:07.664570 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37187a-e61e-4517-8f99-10d51436cfd4 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:07.666433 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-cb37187a-e61e-4517-8f99-10d51436cfd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:07.737651 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466dc1d-4842-4178-b0e8-73840bcd2dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:07.739565 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466dc1d-4842-4178-b0e8-73840bcd2dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:07.740682 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466dc1d-4842-4178-b0e8-73840bcd2dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:07.741174 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466dc1d-4842-4178-b0e8-73840bcd2dd2 admin admin] PATH_INFO: `/v3/projects/8725398731914f85bc7e8007af14b039` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:07.747765 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9466dc1d-4842-4178-b0e8-73840bcd2dd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8725398731914f85bc7e8007af14b039)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:07.751447 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9466dc1d-4842-4178-b0e8-73840bcd2dd2 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:07.764962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:07.781408 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37187a-e61e-4517-8f99-10d51436cfd4 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:07.794588 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c605572-63fa-4e3f-95e4-78def429eb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:07.794769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c605572-63fa-4e3f-95e4-78def429eb84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:07.795034 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c605572-63fa-4e3f-95e4-78def429eb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:07.795348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c605572-63fa-4e3f-95e4-78def429eb84 admin admin] PATH_INFO: `/v3/projects/8db9c6ff379f459bb9d7573b0516daf2` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:07.799515 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c605572-63fa-4e3f-95e4-78def429eb84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8db9c6ff379f459bb9d7573b0516daf2)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:07.807094 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c605572-63fa-4e3f-95e4-78def429eb84 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:07.826845 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:07.898997 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-9c605572-63fa-4e3f-95e4-78def429eb84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8db9c6ff379f459bb9d7573b0516daf2', 'request_id': 'req-9c605572-63fa-4e3f-95e4-78def429eb84'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:07.907847 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-9c605572-63fa-4e3f-95e4-78def429eb84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8db9c6ff379f459bb9d7573b0516daf2', 'request_id': 'req-9c605572-63fa-4e3f-95e4-78def429eb84'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:07.918546 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-9c605572-63fa-4e3f-95e4-78def429eb84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8db9c6ff379f459bb9d7573b0516daf2', 'request_id': 'req-9c605572-63fa-4e3f-95e4-78def429eb84'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:07.935524 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-9c605572-63fa-4e3f-95e4-78def429eb84 admin admin] The token cache is being invalidate because project 8db9c6ff379f459bb9d7573b0516daf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:07.935845 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-9c605572-63fa-4e3f-95e4-78def429eb84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:07.936639 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-9c605572-63fa-4e3f-95e4-78def429eb84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:07.942467 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 987/1985] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:07 2022] DELETE /identity/v3/projects/8db9c6ff379f459bb9d7573b0516daf2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:33:07.943562 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c605572-63fa-4e3f-95e4-78def429eb84 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:07.945039 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-9c605572-63fa-4e3f-95e4-78def429eb84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:07.949855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-9466dc1d-4842-4178-b0e8-73840bcd2dd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8725398731914f85bc7e8007af14b039', 'request_id': 'req-9466dc1d-4842-4178-b0e8-73840bcd2dd2'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:07.964215 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-9466dc1d-4842-4178-b0e8-73840bcd2dd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8725398731914f85bc7e8007af14b039', 'request_id': 'req-9466dc1d-4842-4178-b0e8-73840bcd2dd2'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:07.975324 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-9466dc1d-4842-4178-b0e8-73840bcd2dd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8725398731914f85bc7e8007af14b039', 'request_id': 'req-9466dc1d-4842-4178-b0e8-73840bcd2dd2'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:07.993789 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-9466dc1d-4842-4178-b0e8-73840bcd2dd2 admin admin] The token cache is being invalidate because project 8725398731914f85bc7e8007af14b039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:07.996824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-9466dc1d-4842-4178-b0e8-73840bcd2dd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:07.997249 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-9466dc1d-4842-4178-b0e8-73840bcd2dd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:08.002703 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 999/1986] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:07 2022] DELETE /identity/v3/projects/8725398731914f85bc7e8007af14b039 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:08.005565 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e11b3-303a-4027-b525-20964c10968e None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:08.005857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e11b3-303a-4027-b525-20964c10968e None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:08.006183 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e11b3-303a-4027-b525-20964c10968e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:08.044851 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-993e11b3-303a-4027-b525-20964c10968e None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:08.046706 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-993e11b3-303a-4027-b525-20964c10968e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:08.072744 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c605572-63fa-4e3f-95e4-78def429eb84 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:08.078627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1000/1987] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:08.079638 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e11b3-303a-4027-b525-20964c10968e None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:08.080669 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e302e5-5c68-4e30-8778-59781fe59477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:08.082034 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e302e5-5c68-4e30-8778-59781fe59477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:08.082345 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e302e5-5c68-4e30-8778-59781fe59477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:08.083596 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e302e5-5c68-4e30-8778-59781fe59477 admin admin] PATH_INFO: `/v3/projects/b7df7b81500b40feb409034006c92684` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:08.085964 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e302e5-5c68-4e30-8778-59781fe59477 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7df7b81500b40feb409034006c92684)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:08.087366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-993e11b3-303a-4027-b525-20964c10968e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:08.093140 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e302e5-5c68-4e30-8778-59781fe59477 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:08.139586 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e11b3-303a-4027-b525-20964c10968e None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:08.155150 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893cb03-2494-4090-b849-0244b4ca3b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:08.156166 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893cb03-2494-4090-b849-0244b4ca3b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:08.156522 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893cb03-2494-4090-b849-0244b4ca3b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:08.156860 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893cb03-2494-4090-b849-0244b4ca3b07 admin admin] PATH_INFO: `/v3/users/ac2a5ddaa444421bb03b5bc094133617` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:08.160231 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893cb03-2494-4090-b849-0244b4ca3b07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac2a5ddaa444421bb03b5bc094133617)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:08.175633 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893cb03-2494-4090-b849-0244b4ca3b07 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:08.180810 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-55e302e5-5c68-4e30-8778-59781fe59477 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7df7b81500b40feb409034006c92684', 'request_id': 'req-55e302e5-5c68-4e30-8778-59781fe59477'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:08.192850 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-55e302e5-5c68-4e30-8778-59781fe59477 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7df7b81500b40feb409034006c92684', 'request_id': 'req-55e302e5-5c68-4e30-8778-59781fe59477'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:08.207804 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-55e302e5-5c68-4e30-8778-59781fe59477 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7df7b81500b40feb409034006c92684', 'request_id': 'req-55e302e5-5c68-4e30-8778-59781fe59477'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:08.227969 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-55e302e5-5c68-4e30-8778-59781fe59477 admin admin] The token cache is being invalidate because project b7df7b81500b40feb409034006c92684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:08.228326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-55e302e5-5c68-4e30-8778-59781fe59477 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:08.229116 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-55e302e5-5c68-4e30-8778-59781fe59477 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:08.231617 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 988/1988] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:07 2022] DELETE /identity/v3/projects/b7df7b81500b40feb409034006c92684 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:08.232734 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e2481-422e-455a-9adb-e99dfd0b28f8 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:08.232994 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e2481-422e-455a-9adb-e99dfd0b28f8 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:08.233286 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e2481-422e-455a-9adb-e99dfd0b28f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:08.250262 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-a893cb03-2494-4090-b849-0244b4ca3b07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac2a5ddaa444421bb03b5bc094133617'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:08.265916 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-d21e2481-422e-455a-9adb-e99dfd0b28f8 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:08.267561 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-d21e2481-422e-455a-9adb-e99dfd0b28f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:08.271373 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-a893cb03-2494-4090-b849-0244b4ca3b07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac2a5ddaa444421bb03b5bc094133617'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:08.282299 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-a893cb03-2494-4090-b849-0244b4ca3b07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac2a5ddaa444421bb03b5bc094133617'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:08.283598 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-a893cb03-2494-4090-b849-0244b4ca3b07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac2a5ddaa444421bb03b5bc094133617'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:08.284260 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-a893cb03-2494-4090-b849-0244b4ca3b07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac2a5ddaa444421bb03b5bc094133617'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:08.286099 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:08.325037 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1001/1989] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:08 2022] DELETE /identity/v3/users/ac2a5ddaa444421bb03b5bc094133617 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:08.327136 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671673c4-39cb-438d-a091-1f932a33dc56 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:08.327757 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671673c4-39cb-438d-a091-1f932a33dc56 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:08.328231 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671673c4-39cb-438d-a091-1f932a33dc56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:08.366525 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-671673c4-39cb-438d-a091-1f932a33dc56 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:08.366525 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-671673c4-39cb-438d-a091-1f932a33dc56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:08.381628 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 989/1990] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:08.382581 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e2481-422e-455a-9adb-e99dfd0b28f8 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:08.388157 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-d21e2481-422e-455a-9adb-e99dfd0b28f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:08.417030 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e2481-422e-455a-9adb-e99dfd0b28f8 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:08.518484 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002a08e-16cf-4899-af41-a46e2bc09f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:08.520072 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002a08e-16cf-4899-af41-a46e2bc09f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:08.520373 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002a08e-16cf-4899-af41-a46e2bc09f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:08.520847 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002a08e-16cf-4899-af41-a46e2bc09f13 admin admin] PATH_INFO: `/v3/projects/6f56eb65c99e43cbb9670dcdcc501235` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:08.522381 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002a08e-16cf-4899-af41-a46e2bc09f13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f56eb65c99e43cbb9670dcdcc501235)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:08.525414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002a08e-16cf-4899-af41-a46e2bc09f13 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:08.535483 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1002/1991] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:08.539054 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671673c4-39cb-438d-a091-1f932a33dc56 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:08.566940 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671673c4-39cb-438d-a091-1f932a33dc56 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:08.581611 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe725e2-57a3-4696-b705-b29727c5b3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:08.582325 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe725e2-57a3-4696-b705-b29727c5b3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:08.582621 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe725e2-57a3-4696-b705-b29727c5b3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:08.582894 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe725e2-57a3-4696-b705-b29727c5b3a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:08.584247 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe725e2-57a3-4696-b705-b29727c5b3a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:08.584247 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe725e2-57a3-4696-b705-b29727c5b3a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:08.585695 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe725e2-57a3-4696-b705-b29727c5b3a2 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:08.589021 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:08.636887 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1003/1992] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:08.639863 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15a505-b52f-4efc-b431-a3e8aa0fa754 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:08.644332 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15a505-b52f-4efc-b431-a3e8aa0fa754 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:08.647990 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15a505-b52f-4efc-b431-a3e8aa0fa754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:08.664243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-b002a08e-16cf-4899-af41-a46e2bc09f13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f56eb65c99e43cbb9670dcdcc501235', 'request_id': 'req-b002a08e-16cf-4899-af41-a46e2bc09f13'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:08.674511 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-b002a08e-16cf-4899-af41-a46e2bc09f13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f56eb65c99e43cbb9670dcdcc501235', 'request_id': 'req-b002a08e-16cf-4899-af41-a46e2bc09f13'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:08.687572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-b002a08e-16cf-4899-af41-a46e2bc09f13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f56eb65c99e43cbb9670dcdcc501235', 'request_id': 'req-b002a08e-16cf-4899-af41-a46e2bc09f13'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:08.707178 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-b002a08e-16cf-4899-af41-a46e2bc09f13 admin admin] The token cache is being invalidate because project 6f56eb65c99e43cbb9670dcdcc501235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:08.707873 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-b002a08e-16cf-4899-af41-a46e2bc09f13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:08.709112 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-b002a08e-16cf-4899-af41-a46e2bc09f13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:08.712533 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-2c15a505-b52f-4efc-b431-a3e8aa0fa754 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:08.714267 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-2c15a505-b52f-4efc-b431-a3e8aa0fa754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:08.727785 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 990/1993] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:08 2022] DELETE /identity/v3/projects/6f56eb65c99e43cbb9670dcdcc501235 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:08.729132 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002a08e-16cf-4899-af41-a46e2bc09f13 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:08.733964 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-b002a08e-16cf-4899-af41-a46e2bc09f13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:08.840962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:08.880883 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1004/1994] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:08.882780 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1faf037-55f3-49d4-90fe-659a0e191a16 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:08.883182 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1faf037-55f3-49d4-90fe-659a0e191a16 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:08.883587 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1faf037-55f3-49d4-90fe-659a0e191a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:08.899813 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002a08e-16cf-4899-af41-a46e2bc09f13 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:08.915947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be5da5-2ecd-4446-8407-3c07dcf99a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:08.916647 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be5da5-2ecd-4446-8407-3c07dcf99a8b admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:08.916932 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be5da5-2ecd-4446-8407-3c07dcf99a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:08.917220 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be5da5-2ecd-4446-8407-3c07dcf99a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:08.917933 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be5da5-2ecd-4446-8407-3c07dcf99a8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:08.920031 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-a1faf037-55f3-49d4-90fe-659a0e191a16 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:08.921292 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-a1faf037-55f3-49d4-90fe-659a0e191a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:08.924085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be5da5-2ecd-4446-8407-3c07dcf99a8b admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:08.963980 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1005/1995] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:08.966054 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1faf037-55f3-49d4-90fe-659a0e191a16 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:08.989052 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 991/1996] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:33:08 2022] POST /identity/v3/projects => generated 383 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:08.989052 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6320351-3e3f-4033-b6b7-12903e81dfa2 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:08.989454 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1faf037-55f3-49d4-90fe-659a0e191a16 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:08.989654 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6320351-3e3f-4033-b6b7-12903e81dfa2 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:08.989654 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6320351-3e3f-4033-b6b7-12903e81dfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:09.067060 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-c6320351-3e3f-4033-b6b7-12903e81dfa2 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:09.072917 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-c6320351-3e3f-4033-b6b7-12903e81dfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:09.103685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cd920-e3f4-44e2-b07b-3890a7168531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:09.106643 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cd920-e3f4-44e2-b07b-3890a7168531 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:09.107591 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cd920-e3f4-44e2-b07b-3890a7168531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:09.108543 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cd920-e3f4-44e2-b07b-3890a7168531 admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:09.114056 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8cd920-e3f4-44e2-b07b-3890a7168531 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:09.115776 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8cd920-e3f4-44e2-b07b-3890a7168531 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:09.118050 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8cd920-e3f4-44e2-b07b-3890a7168531 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:09.141749 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1006/1997] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:09.141749 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cd920-e3f4-44e2-b07b-3890a7168531 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:09.153586 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cd920-e3f4-44e2-b07b-3890a7168531 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:09.159863 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c192e-6ca9-438c-9f80-f2960d9dbca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:09.161202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c192e-6ca9-438c-9f80-f2960d9dbca9 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:09.161499 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c192e-6ca9-438c-9f80-f2960d9dbca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:09.161811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c192e-6ca9-438c-9f80-f2960d9dbca9 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:09.162875 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c192e-6ca9-438c-9f80-f2960d9dbca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:09.166975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c192e-6ca9-438c-9f80-f2960d9dbca9 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:09.217901 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1007/1998] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:33:09 2022] POST /identity/v3/users => generated 292 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:09.217901 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c192e-6ca9-438c-9f80-f2960d9dbca9 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:09.219549 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 992/1999] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:09.220421 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6320351-3e3f-4033-b6b7-12903e81dfa2 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:09.238075 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c192e-6ca9-438c-9f80-f2960d9dbca9 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:09.241988 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6320351-3e3f-4033-b6b7-12903e81dfa2 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:09.253458 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4103f-5d50-424e-918a-f37ace8b7ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:09.254544 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4103f-5d50-424e-918a-f37ace8b7ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:09.254941 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4103f-5d50-424e-918a-f37ace8b7ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:09.255419 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4103f-5d50-424e-918a-f37ace8b7ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:09.256606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4103f-5d50-424e-918a-f37ace8b7ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:09.259269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4103f-5d50-424e-918a-f37ace8b7ce0 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:09.260413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18dfba-8c7e-4cb9-9d24-a74b37fba732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:09.260413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18dfba-8c7e-4cb9-9d24-a74b37fba732 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:09.260669 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18dfba-8c7e-4cb9-9d24-a74b37fba732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:09.260942 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18dfba-8c7e-4cb9-9d24-a74b37fba732 admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:09.261671 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18dfba-8c7e-4cb9-9d24-a74b37fba732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:09.266876 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18dfba-8c7e-4cb9-9d24-a74b37fba732 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:09.281614 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 993/2000] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:09.281614 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4103f-5d50-424e-918a-f37ace8b7ce0 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:09.296429 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4103f-5d50-424e-918a-f37ace8b7ce0 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:09.304411 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12c727-8d7d-4ee0-9b77-4daa42786d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:09.305391 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12c727-8d7d-4ee0-9b77-4daa42786d24 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:09.305676 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12c727-8d7d-4ee0-9b77-4daa42786d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:09.306054 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12c727-8d7d-4ee0-9b77-4daa42786d24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:09.307504 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12c727-8d7d-4ee0-9b77-4daa42786d24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:09.307826 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12c727-8d7d-4ee0-9b77-4daa42786d24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:09.309989 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12c727-8d7d-4ee0-9b77-4daa42786d24 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:09.335469 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1008/2001] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:33:09 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:09.335469 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18dfba-8c7e-4cb9-9d24-a74b37fba732 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:09.335736 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 994/2002] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:09.337520 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12c727-8d7d-4ee0-9b77-4daa42786d24 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:09.351389 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12c727-8d7d-4ee0-9b77-4daa42786d24 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:09.434135 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:09.443336 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df745185-bbf2-4be8-934a-e02e0a022fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:09.444086 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df745185-bbf2-4be8-934a-e02e0a022fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:09.444373 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df745185-bbf2-4be8-934a-e02e0a022fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:09.444663 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df745185-bbf2-4be8-934a-e02e0a022fd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:09.445411 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df745185-bbf2-4be8-934a-e02e0a022fd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:09.448846 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df745185-bbf2-4be8-934a-e02e0a022fd0 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:09.456992 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18dfba-8c7e-4cb9-9d24-a74b37fba732 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:09.464542 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193380d-601d-4945-a8fc-61fcd7674dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:09.465273 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193380d-601d-4945-a8fc-61fcd7674dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:09.465564 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193380d-601d-4945-a8fc-61fcd7674dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:09.466481 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193380d-601d-4945-a8fc-61fcd7674dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:09.466782 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193380d-601d-4945-a8fc-61fcd7674dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:09.468779 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193380d-601d-4945-a8fc-61fcd7674dc2 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:09.481440 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1009/2003] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:09.482437 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193380d-601d-4945-a8fc-61fcd7674dc2 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:09.483305 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 995/2004] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:33:09 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:33:09.487552 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df745185-bbf2-4be8-934a-e02e0a022fd0 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:09.504429 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df745185-bbf2-4be8-934a-e02e0a022fd0 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:09.505707 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193380d-601d-4945-a8fc-61fcd7674dc2 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:09.511506 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a82271-49de-4db7-9e5d-8ecc41bcd68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:09.512322 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a82271-49de-4db7-9e5d-8ecc41bcd68c admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:09.512677 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a82271-49de-4db7-9e5d-8ecc41bcd68c admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:09.513033 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a82271-49de-4db7-9e5d-8ecc41bcd68c admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:09.514371 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a82271-49de-4db7-9e5d-8ecc41bcd68c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:09.518240 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a82271-49de-4db7-9e5d-8ecc41bcd68c admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:09.530042 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819032e-35f7-4fae-9198-9d8c07f27c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:09.530912 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819032e-35f7-4fae-9198-9d8c07f27c06 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:09.531808 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819032e-35f7-4fae-9198-9d8c07f27c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:09.532205 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819032e-35f7-4fae-9198-9d8c07f27c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:09.533088 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819032e-35f7-4fae-9198-9d8c07f27c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:09.536016 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819032e-35f7-4fae-9198-9d8c07f27c06 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:09.562874 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1010/2005] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:33:09 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:09.563843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a82271-49de-4db7-9e5d-8ecc41bcd68c admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:09.572040 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 996/2006] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:09.573002 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819032e-35f7-4fae-9198-9d8c07f27c06 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:09.583722 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819032e-35f7-4fae-9198-9d8c07f27c06 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:09.619627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:09.677137 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c8936-5c8e-4355-82c1-4e66764f1654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:09.678665 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c8936-5c8e-4355-82c1-4e66764f1654 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:09.679190 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c8936-5c8e-4355-82c1-4e66764f1654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:09.679717 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c8936-5c8e-4355-82c1-4e66764f1654 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:09.681267 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c8936-5c8e-4355-82c1-4e66764f1654 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:09.683942 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c8936-5c8e-4355-82c1-4e66764f1654 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:09.684243 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a82271-49de-4db7-9e5d-8ecc41bcd68c admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:09.690199 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218e821-6107-4b1c-9804-c26524804d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:09.691192 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218e821-6107-4b1c-9804-c26524804d04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:09.691545 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218e821-6107-4b1c-9804-c26524804d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:09.691828 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218e821-6107-4b1c-9804-c26524804d04 admin admin] PATH_INFO: `/v3/projects/4e106da90ed24851ade85e2ecfbe0eed/users/1da6a40cc1314c28916ef1597e984422/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:09.709479 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218e821-6107-4b1c-9804-c26524804d04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e106da90ed24851ade85e2ecfbe0eed, user_id=1da6a40cc1314c28916ef1597e984422, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:09.712211 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218e821-6107-4b1c-9804-c26524804d04 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:09.714685 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 997/2007] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:33:09 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:09.717127 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c8936-5c8e-4355-82c1-4e66764f1654 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:09.729467 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c8936-5c8e-4355-82c1-4e66764f1654 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:09.734337 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1011/2008] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:09 2022] PUT /identity/v3/projects/4e106da90ed24851ade85e2ecfbe0eed/users/1da6a40cc1314c28916ef1597e984422/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:09.743468 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218e821-6107-4b1c-9804-c26524804d04 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:09.847329 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00a9d0-7704-4eda-869e-29d608eaafae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:09.848728 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00a9d0-7704-4eda-869e-29d608eaafae admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:09.849081 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00a9d0-7704-4eda-869e-29d608eaafae admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:09.849428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00a9d0-7704-4eda-869e-29d608eaafae admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:09.850281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd00a9d0-7704-4eda-869e-29d608eaafae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:09.852333 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd00a9d0-7704-4eda-869e-29d608eaafae admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:09.857808 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218e821-6107-4b1c-9804-c26524804d04 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:09.871695 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 998/2009] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:09.871695 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b069d-e421-4649-99eb-bcae2fe361ae None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:09.871695 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b069d-e421-4649-99eb-bcae2fe361ae None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:09.871695 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b069d-e421-4649-99eb-bcae2fe361ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:09.878933 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2ef32-63bb-4f17-9ec2-232b0fbefa25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:09.880031 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2ef32-63bb-4f17-9ec2-232b0fbefa25 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:09.880553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2ef32-63bb-4f17-9ec2-232b0fbefa25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:09.881225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2ef32-63bb-4f17-9ec2-232b0fbefa25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:09.882649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c2ef32-63bb-4f17-9ec2-232b0fbefa25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:09.885985 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c2ef32-63bb-4f17-9ec2-232b0fbefa25 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:09.901087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-1c1b069d-e421-4649-99eb-bcae2fe361ae None None] MFA Rules not processed for user `1da6a40cc1314c28916ef1597e984422`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:09.902370 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-1c1b069d-e421-4649-99eb-bcae2fe361ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:09.907943 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1012/2010] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:09.909564 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2ef32-63bb-4f17-9ec2-232b0fbefa25 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:09.912056 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-10c2ef32-63bb-4f17-9ec2-232b0fbefa25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:09.929121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2ef32-63bb-4f17-9ec2-232b0fbefa25 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:09.936941 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea0165-8db6-42b9-944d-87ef4816ee30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:09.938295 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea0165-8db6-42b9-944d-87ef4816ee30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:09.938821 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea0165-8db6-42b9-944d-87ef4816ee30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:09.939344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea0165-8db6-42b9-944d-87ef4816ee30 admin admin] PATH_INFO: `/v3/projects/ed7fc1bc5bcc43f38a82d7a4c7d4b412` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:09.941030 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea0165-8db6-42b9-944d-87ef4816ee30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed7fc1bc5bcc43f38a82d7a4c7d4b412)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:09.943305 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea0165-8db6-42b9-944d-87ef4816ee30 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:09.995440 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:10.005034 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 999/2011] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:10.006027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b069d-e421-4649-99eb-bcae2fe361ae None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:10.019465 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b069d-e421-4649-99eb-bcae2fe361ae None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:10.021264 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-39ea0165-8db6-42b9-944d-87ef4816ee30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed7fc1bc5bcc43f38a82d7a4c7d4b412', 'request_id': 'req-39ea0165-8db6-42b9-944d-87ef4816ee30'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:10.033930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-39ea0165-8db6-42b9-944d-87ef4816ee30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed7fc1bc5bcc43f38a82d7a4c7d4b412', 'request_id': 'req-39ea0165-8db6-42b9-944d-87ef4816ee30'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:10.045825 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-39ea0165-8db6-42b9-944d-87ef4816ee30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed7fc1bc5bcc43f38a82d7a4c7d4b412', 'request_id': 'req-39ea0165-8db6-42b9-944d-87ef4816ee30'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:10.062240 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-39ea0165-8db6-42b9-944d-87ef4816ee30 admin admin] The token cache is being invalidate because project ed7fc1bc5bcc43f38a82d7a4c7d4b412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:10.062539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-39ea0165-8db6-42b9-944d-87ef4816ee30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:10.063295 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-39ea0165-8db6-42b9-944d-87ef4816ee30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:10.067336 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1013/2012] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:09 2022] DELETE /identity/v3/projects/ed7fc1bc5bcc43f38a82d7a4c7d4b412 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:10.071980 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea0165-8db6-42b9-944d-87ef4816ee30 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:10.072337 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:10.073537 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-39ea0165-8db6-42b9-944d-87ef4816ee30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:10.098398 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420c913-2b3c-444f-bd56-da8a3630ae3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:10.099657 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420c913-2b3c-444f-bd56-da8a3630ae3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:10.099952 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420c913-2b3c-444f-bd56-da8a3630ae3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:10.100237 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420c913-2b3c-444f-bd56-da8a3630ae3f admin admin] PATH_INFO: `/v3/projects/6f6a9f12427345988170be391994b4af/users/55e87c7d57284316b7540352d6c56e39/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:10.117781 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420c913-2b3c-444f-bd56-da8a3630ae3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f6a9f12427345988170be391994b4af, user_id=55e87c7d57284316b7540352d6c56e39, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:10.120521 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420c913-2b3c-444f-bd56-da8a3630ae3f admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:10.136524 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1000/2013] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:10 2022] PUT /identity/v3/projects/6f6a9f12427345988170be391994b4af/users/55e87c7d57284316b7540352d6c56e39/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:10.138033 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420c913-2b3c-444f-bd56-da8a3630ae3f admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:10.139878 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-6420c913-2b3c-444f-bd56-da8a3630ae3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:10.195109 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea0165-8db6-42b9-944d-87ef4816ee30 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:10.232478 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420c913-2b3c-444f-bd56-da8a3630ae3f admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:10.239661 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adc843-a5ee-45b1-b83d-798f80bbf369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:10.240348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adc843-a5ee-45b1-b83d-798f80bbf369 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:10.240651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adc843-a5ee-45b1-b83d-798f80bbf369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:10.240912 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adc843-a5ee-45b1-b83d-798f80bbf369 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:10.242403 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adc843-a5ee-45b1-b83d-798f80bbf369 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:10.244410 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adc843-a5ee-45b1-b83d-798f80bbf369 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:10.287111 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1001/2014] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:33:10 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:10.288101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adc843-a5ee-45b1-b83d-798f80bbf369 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:10.290361 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-29adc843-a5ee-45b1-b83d-798f80bbf369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:10.294010 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e666af-dec7-49e3-af55-381a433c8754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:10.297629 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e666af-dec7-49e3-af55-381a433c8754 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:10.298153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e666af-dec7-49e3-af55-381a433c8754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:10.298656 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e666af-dec7-49e3-af55-381a433c8754 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:10.300258 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e666af-dec7-49e3-af55-381a433c8754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:10.303401 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e666af-dec7-49e3-af55-381a433c8754 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:10.334857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1014/2015] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:10.336410 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385461d9-05c0-4fdb-a68a-53484c0ac05c None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:10.336946 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385461d9-05c0-4fdb-a68a-53484c0ac05c None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:10.337193 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385461d9-05c0-4fdb-a68a-53484c0ac05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:10.371913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-385461d9-05c0-4fdb-a68a-53484c0ac05c None None] MFA Rules not processed for user `55e87c7d57284316b7540352d6c56e39`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:10.373197 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-385461d9-05c0-4fdb-a68a-53484c0ac05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:10.404334 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adc843-a5ee-45b1-b83d-798f80bbf369 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:10.412602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf2eed-931a-48a1-8169-b0077565627e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:10.413757 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf2eed-931a-48a1-8169-b0077565627e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:10.414147 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf2eed-931a-48a1-8169-b0077565627e admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:10.414613 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf2eed-931a-48a1-8169-b0077565627e admin admin] PATH_INFO: `/v3/users/614fab54bfb4434ab6faea9bb0416973` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:10.416953 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf2eed-931a-48a1-8169-b0077565627e admin admin] RBAC: Authorizing `identity:delete_user(user_id=614fab54bfb4434ab6faea9bb0416973)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:10.420260 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf2eed-931a-48a1-8169-b0077565627e admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:10.484467 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:10.512067 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1015/2016] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:10.512543 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-28cf2eed-931a-48a1-8169-b0077565627e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '614fab54bfb4434ab6faea9bb0416973'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:10.514061 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385461d9-05c0-4fdb-a68a-53484c0ac05c None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:10.516388 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:10.538826 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-28cf2eed-931a-48a1-8169-b0077565627e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '614fab54bfb4434ab6faea9bb0416973'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:10.548127 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385461d9-05c0-4fdb-a68a-53484c0ac05c None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:10.556333 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-28cf2eed-931a-48a1-8169-b0077565627e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '614fab54bfb4434ab6faea9bb0416973'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:10.557399 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-28cf2eed-931a-48a1-8169-b0077565627e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '614fab54bfb4434ab6faea9bb0416973'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:10.557764 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbc0b0-307c-4fcc-aaa4-544ef31ee194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:10.558694 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-28cf2eed-931a-48a1-8169-b0077565627e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '614fab54bfb4434ab6faea9bb0416973'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:10.559161 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbc0b0-307c-4fcc-aaa4-544ef31ee194 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:10.559534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbc0b0-307c-4fcc-aaa4-544ef31ee194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:10.560145 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbc0b0-307c-4fcc-aaa4-544ef31ee194 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:10.561250 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fbc0b0-307c-4fcc-aaa4-544ef31ee194 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:10.565292 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fbc0b0-307c-4fcc-aaa4-544ef31ee194 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:10.588995 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1002/2017] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:10 2022] DELETE /identity/v3/users/614fab54bfb4434ab6faea9bb0416973 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:10.590436 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf2eed-931a-48a1-8169-b0077565627e admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:10.610854 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1016/2018] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:33:10 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:10.612792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbc0b0-307c-4fcc-aaa4-544ef31ee194 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:10.615042 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-49fbc0b0-307c-4fcc-aaa4-544ef31ee194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:10.621766 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-28cf2eed-931a-48a1-8169-b0077565627e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:10.760719 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbc0b0-307c-4fcc-aaa4-544ef31ee194 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:10.798012 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf2eed-931a-48a1-8169-b0077565627e admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:10.805339 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27f0d3-c477-43ab-8d57-d7aba2a5b70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:10.805939 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27f0d3-c477-43ab-8d57-d7aba2a5b70d admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:10.806234 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27f0d3-c477-43ab-8d57-d7aba2a5b70d admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:10.806513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27f0d3-c477-43ab-8d57-d7aba2a5b70d admin admin] PATH_INFO: `/v3/projects/69d4b411928e4f71884efa37cdc7f401/users/8cf6e45efae9442097e54d4ee2162357/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:10.840174 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2136097-add3-4a85-ad59-cf001c8fca08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:10.841075 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2136097-add3-4a85-ad59-cf001c8fca08 service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:10.841427 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2136097-add3-4a85-ad59-cf001c8fca08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:10.842612 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2136097-add3-4a85-ad59-cf001c8fca08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:10.845021 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-f2136097-add3-4a85-ad59-cf001c8fca08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:10.847398 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27f0d3-c477-43ab-8d57-d7aba2a5b70d admin admin] RBAC: Authorizing `identity:create_grant(project_id=69d4b411928e4f71884efa37cdc7f401, user_id=8cf6e45efae9442097e54d4ee2162357, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:10.850133 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27f0d3-c477-43ab-8d57-d7aba2a5b70d admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:10.877445 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1003/2019] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:10 2022] PUT /identity/v3/projects/69d4b411928e4f71884efa37cdc7f401/users/8cf6e45efae9442097e54d4ee2162357/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:10.881749 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27f0d3-c477-43ab-8d57-d7aba2a5b70d admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:10.890213 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-ff27f0d3-c477-43ab-8d57-d7aba2a5b70d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:10.955655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2136097-add3-4a85-ad59-cf001c8fca08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:10.957818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2136097-add3-4a85-ad59-cf001c8fca08 service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:10.990718 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27f0d3-c477-43ab-8d57-d7aba2a5b70d admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:11.009493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c7722-8f7b-42c1-a42f-2c1dce7f1346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:11.010655 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c7722-8f7b-42c1-a42f-2c1dce7f1346 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:11.010655 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c7722-8f7b-42c1-a42f-2c1dce7f1346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:11.010820 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c7722-8f7b-42c1-a42f-2c1dce7f1346 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:11.013395 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1017/2020] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:11.014892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851a55d-6d7d-4fba-a17f-5bc3234f8243 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:11.015190 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851a55d-6d7d-4fba-a17f-5bc3234f8243 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:11.016776 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851a55d-6d7d-4fba-a17f-5bc3234f8243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:11.026246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c7722-8f7b-42c1-a42f-2c1dce7f1346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:11.028352 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c7722-8f7b-42c1-a42f-2c1dce7f1346 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:11.042997 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1004/2021] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:11.047753 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c7722-8f7b-42c1-a42f-2c1dce7f1346 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:11.065352 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c7722-8f7b-42c1-a42f-2c1dce7f1346 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:11.075632 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b333b51-4ce1-4759-b47f-8eb53f9cac97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:11.077119 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b333b51-4ce1-4759-b47f-8eb53f9cac97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:11.077119 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b333b51-4ce1-4759-b47f-8eb53f9cac97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:11.079181 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b333b51-4ce1-4759-b47f-8eb53f9cac97 admin admin] PATH_INFO: `/v3/projects/4deadd0eebe94e68b99a03a9f03a40b4/users/931fd759a05d460db1598d8c0c3cf403/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:11.084690 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-4851a55d-6d7d-4fba-a17f-5bc3234f8243 None None] MFA Rules not processed for user `8cf6e45efae9442097e54d4ee2162357`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:11.085981 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-4851a55d-6d7d-4fba-a17f-5bc3234f8243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:11.106438 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b333b51-4ce1-4759-b47f-8eb53f9cac97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4deadd0eebe94e68b99a03a9f03a40b4, user_id=931fd759a05d460db1598d8c0c3cf403, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:11.109964 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b333b51-4ce1-4759-b47f-8eb53f9cac97 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:11.136365 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1005/2022] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:11 2022] PUT /identity/v3/projects/4deadd0eebe94e68b99a03a9f03a40b4/users/931fd759a05d460db1598d8c0c3cf403/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:11.140393 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b333b51-4ce1-4759-b47f-8eb53f9cac97 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:11.149013 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:11.182350 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:11.209130 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1018/2023] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:11.226420 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851a55d-6d7d-4fba-a17f-5bc3234f8243 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:11.230005 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-4851a55d-6d7d-4fba-a17f-5bc3234f8243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:11.262153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b333b51-4ce1-4759-b47f-8eb53f9cac97 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:11.272353 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9cc76-6e18-4513-a5fe-7156146bd9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:11.273702 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9cc76-6e18-4513-a5fe-7156146bd9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:11.276458 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9cc76-6e18-4513-a5fe-7156146bd9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:11.276458 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9cc76-6e18-4513-a5fe-7156146bd9c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:11.276458 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9cc76-6e18-4513-a5fe-7156146bd9c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:11.277335 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9cc76-6e18-4513-a5fe-7156146bd9c3 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:11.299877 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1006/2024] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:33:11.301400 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9cc76-6e18-4513-a5fe-7156146bd9c3 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:11.335782 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9cc76-6e18-4513-a5fe-7156146bd9c3 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:11.342779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc56c6-cf97-4fe4-ba5c-0d0b6f0496cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:11.343917 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc56c6-cf97-4fe4-ba5c-0d0b6f0496cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:11.344280 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc56c6-cf97-4fe4-ba5c-0d0b6f0496cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:11.347611 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc56c6-cf97-4fe4-ba5c-0d0b6f0496cd admin admin] PATH_INFO: `/v3/projects/4deadd0eebe94e68b99a03a9f03a40b4/users/931fd759a05d460db1598d8c0c3cf403/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:11.350615 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc56c6-cf97-4fe4-ba5c-0d0b6f0496cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4deadd0eebe94e68b99a03a9f03a40b4, user_id=931fd759a05d460db1598d8c0c3cf403, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:11.353806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc56c6-cf97-4fe4-ba5c-0d0b6f0496cd admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:11.370070 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1007/2025] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:11 2022] PUT /identity/v3/projects/4deadd0eebe94e68b99a03a9f03a40b4/users/931fd759a05d460db1598d8c0c3cf403/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:11.374138 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851a55d-6d7d-4fba-a17f-5bc3234f8243 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:11.380429 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc56c6-cf97-4fe4-ba5c-0d0b6f0496cd admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:11.383390 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-aecc56c6-cf97-4fe4-ba5c-0d0b6f0496cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:11.451807 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6e00e-45c9-4f1e-bf17-eab0dc529d72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:11.452340 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6e00e-45c9-4f1e-bf17-eab0dc529d72 service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:11.452630 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6e00e-45c9-4f1e-bf17-eab0dc529d72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:11.452912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6e00e-45c9-4f1e-bf17-eab0dc529d72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:11.495561 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc56c6-cf97-4fe4-ba5c-0d0b6f0496cd admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:11.501875 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b60731-57a7-4998-aea6-a7ed6d73ec14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:11.503385 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b60731-57a7-4998-aea6-a7ed6d73ec14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:11.503709 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b60731-57a7-4998-aea6-a7ed6d73ec14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:11.503992 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b60731-57a7-4998-aea6-a7ed6d73ec14 admin admin] PATH_INFO: `/v3/projects/a3ec4e48dd2746d0a2771a290be76907` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:11.506135 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b60731-57a7-4998-aea6-a7ed6d73ec14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3ec4e48dd2746d0a2771a290be76907)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:11.508624 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b60731-57a7-4998-aea6-a7ed6d73ec14 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:11.559739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6e00e-45c9-4f1e-bf17-eab0dc529d72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:11.561808 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6e00e-45c9-4f1e-bf17-eab0dc529d72 service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:11.571669 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-95b60731-57a7-4998-aea6-a7ed6d73ec14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3ec4e48dd2746d0a2771a290be76907', 'request_id': 'req-95b60731-57a7-4998-aea6-a7ed6d73ec14'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:11.572307 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1019/2026] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:33:11.573808 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150d731-f090-4519-bd55-7d67fe7b76b5 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:11.574109 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150d731-f090-4519-bd55-7d67fe7b76b5 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:11.574392 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150d731-f090-4519-bd55-7d67fe7b76b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:11.578601 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-95b60731-57a7-4998-aea6-a7ed6d73ec14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3ec4e48dd2746d0a2771a290be76907', 'request_id': 'req-95b60731-57a7-4998-aea6-a7ed6d73ec14'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:11.590813 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-95b60731-57a7-4998-aea6-a7ed6d73ec14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3ec4e48dd2746d0a2771a290be76907', 'request_id': 'req-95b60731-57a7-4998-aea6-a7ed6d73ec14'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:11.607454 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-2150d731-f090-4519-bd55-7d67fe7b76b5 None None] MFA Rules not processed for user `931fd759a05d460db1598d8c0c3cf403`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:11.609338 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-2150d731-f090-4519-bd55-7d67fe7b76b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:11.613824 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-95b60731-57a7-4998-aea6-a7ed6d73ec14 admin admin] The token cache is being invalidate because project a3ec4e48dd2746d0a2771a290be76907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:11.615034 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-95b60731-57a7-4998-aea6-a7ed6d73ec14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:11.615999 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-95b60731-57a7-4998-aea6-a7ed6d73ec14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:11.619298 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1008/2027] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:11 2022] DELETE /identity/v3/projects/a3ec4e48dd2746d0a2771a290be76907 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:11.625831 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a69bb4-23c1-4ff2-a67e-7e592b8993b0 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:11.626285 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a69bb4-23c1-4ff2-a67e-7e592b8993b0 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:11.627144 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a69bb4-23c1-4ff2-a67e-7e592b8993b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:11.652139 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-93a69bb4-23c1-4ff2-a67e-7e592b8993b0 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:11.653496 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-93a69bb4-23c1-4ff2-a67e-7e592b8993b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:11.661808 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:11.749247 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:11.768824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1020/2028] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:11.821900 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1009/2029] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:33:11.831369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d939f-7175-4273-9801-f2dee6ffe02c None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:11.831674 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d939f-7175-4273-9801-f2dee6ffe02c None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:11.831982 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d939f-7175-4273-9801-f2dee6ffe02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:11.843386 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a69bb4-23c1-4ff2-a67e-7e592b8993b0 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:11.845111 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-93a69bb4-23c1-4ff2-a67e-7e592b8993b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:11.875725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-8a7d939f-7175-4273-9801-f2dee6ffe02c None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:11.877776 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-8a7d939f-7175-4273-9801-f2dee6ffe02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:11.893597 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1021/2030] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:33:11.894771 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d939f-7175-4273-9801-f2dee6ffe02c None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:11.909495 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d939f-7175-4273-9801-f2dee6ffe02c None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:11.919797 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5906b4-2be1-4c66-90f6-ca2dc8c8beeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:11.922045 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5906b4-2be1-4c66-90f6-ca2dc8c8beeb admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:11.922591 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5906b4-2be1-4c66-90f6-ca2dc8c8beeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:11.923401 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5906b4-2be1-4c66-90f6-ca2dc8c8beeb admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:11.923512 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a69bb4-23c1-4ff2-a67e-7e592b8993b0 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:11.926235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5906b4-2be1-4c66-90f6-ca2dc8c8beeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:11.926761 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5906b4-2be1-4c66-90f6-ca2dc8c8beeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:11.929179 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5906b4-2be1-4c66-90f6-ca2dc8c8beeb admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:11.929313 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5ad61-003c-47a1-836d-e8dcced50d42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:11.930207 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5ad61-003c-47a1-836d-e8dcced50d42 service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:11.930576 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5ad61-003c-47a1-836d-e8dcced50d42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:11.930860 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5ad61-003c-47a1-836d-e8dcced50d42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:11.941496 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5ad61-003c-47a1-836d-e8dcced50d42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:11.949721 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5ad61-003c-47a1-836d-e8dcced50d42 service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:11.958182 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1022/2031] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:11.960202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5906b4-2be1-4c66-90f6-ca2dc8c8beeb admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:11.976195 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5906b4-2be1-4c66-90f6-ca2dc8c8beeb admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:11.979826 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1010/2032] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:11.983853 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b17809-d404-45fb-a412-600bd9850f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:11.984697 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b17809-d404-45fb-a412-600bd9850f07 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:11.985124 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b17809-d404-45fb-a412-600bd9850f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:11.985413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b17809-d404-45fb-a412-600bd9850f07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:11.986104 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b17809-d404-45fb-a412-600bd9850f07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:11.989025 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b17809-d404-45fb-a412-600bd9850f07 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:12.030279 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1023/2033] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:33:11 2022] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:12.030806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5ad61-003c-47a1-836d-e8dcced50d42 service cinder] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:12.046892 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5ad61-003c-47a1-836d-e8dcced50d42 service cinder] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:12.111802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b17809-d404-45fb-a412-600bd9850f07 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:12.113933 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-62b17809-d404-45fb-a412-600bd9850f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:12.157149 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54227536-baa6-48e7-9a05-743298497b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:12.157849 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54227536-baa6-48e7-9a05-743298497b52 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:12.158895 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54227536-baa6-48e7-9a05-743298497b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:12.159191 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54227536-baa6-48e7-9a05-743298497b52 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:12.159958 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54227536-baa6-48e7-9a05-743298497b52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:12.161942 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54227536-baa6-48e7-9a05-743298497b52 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:12.187614 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1011/2034] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:33:12 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:12.188534 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54227536-baa6-48e7-9a05-743298497b52 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:12.190628 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-54227536-baa6-48e7-9a05-743298497b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:12.195737 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b17809-d404-45fb-a412-600bd9850f07 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:12.199254 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899e4f3-5106-4de3-9aaa-b565da875f3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:12.200423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899e4f3-5106-4de3-9aaa-b565da875f3c service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:12.200423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899e4f3-5106-4de3-9aaa-b565da875f3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:12.200634 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899e4f3-5106-4de3-9aaa-b565da875f3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:12.202352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-7899e4f3-5106-4de3-9aaa-b565da875f3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:12.204737 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54227536-baa6-48e7-9a05-743298497b52 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:12.210245 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8b311-8937-4b17-a0b5-e9393646d745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:12.211125 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8b311-8937-4b17-a0b5-e9393646d745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:12.211441 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8b311-8937-4b17-a0b5-e9393646d745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:12.211719 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8b311-8937-4b17-a0b5-e9393646d745 admin admin] PATH_INFO: `/v3/users/5564c943809047b894b11fbae0a07527` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:12.212929 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd8b311-8937-4b17-a0b5-e9393646d745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5564c943809047b894b11fbae0a07527)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:12.214861 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd8b311-8937-4b17-a0b5-e9393646d745 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:12.270057 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-9fd8b311-8937-4b17-a0b5-e9393646d745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5564c943809047b894b11fbae0a07527'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:12.282064 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7899e4f3-5106-4de3-9aaa-b565da875f3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:12.283096 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:12.284224 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7899e4f3-5106-4de3-9aaa-b565da875f3c service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:12.285015 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-9fd8b311-8937-4b17-a0b5-e9393646d745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5564c943809047b894b11fbae0a07527'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:12.293928 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-9fd8b311-8937-4b17-a0b5-e9393646d745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5564c943809047b894b11fbae0a07527'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:12.294965 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-9fd8b311-8937-4b17-a0b5-e9393646d745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5564c943809047b894b11fbae0a07527'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:12.295566 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1024/2035] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:33:12.295702 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-9fd8b311-8937-4b17-a0b5-e9393646d745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5564c943809047b894b11fbae0a07527'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:12.296402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899e4f3-5106-4de3-9aaa-b565da875f3c service cinder] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:12.310363 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899e4f3-5106-4de3-9aaa-b565da875f3c service cinder] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:12.313320 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1012/2036] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:12 2022] DELETE /identity/v3/users/5564c943809047b894b11fbae0a07527 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:12.315769 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7532ab-4309-4614-9f60-f8b147137abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:12.316600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7532ab-4309-4614-9f60-f8b147137abe admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:12.316818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7532ab-4309-4614-9f60-f8b147137abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:12.317124 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7532ab-4309-4614-9f60-f8b147137abe admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:12.317868 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7532ab-4309-4614-9f60-f8b147137abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:12.318933 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba614f55-145f-4f47-9d03-5c2e68f175a3 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:12.319263 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba614f55-145f-4f47-9d03-5c2e68f175a3 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:12.319495 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7532ab-4309-4614-9f60-f8b147137abe admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:12.319598 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba614f55-145f-4f47-9d03-5c2e68f175a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:12.333551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1025/2037] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:12.337927 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7532ab-4309-4614-9f60-f8b147137abe admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:12.339910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-bb7532ab-4309-4614-9f60-f8b147137abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:12.352372 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-ba614f55-145f-4f47-9d03-5c2e68f175a3 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:12.353834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-ba614f55-145f-4f47-9d03-5c2e68f175a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:12.355533 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7532ab-4309-4614-9f60-f8b147137abe admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:12.423492 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:12.443660 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1013/2038] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:33:12.453505 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba614f55-145f-4f47-9d03-5c2e68f175a3 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:12.456478 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-ba614f55-145f-4f47-9d03-5c2e68f175a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:12.466313 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c09756-e77e-4921-bb49-c306c8eab4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:12.467097 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c09756-e77e-4921-bb49-c306c8eab4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:12.467471 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c09756-e77e-4921-bb49-c306c8eab4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:12.467754 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c09756-e77e-4921-bb49-c306c8eab4c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:12.468496 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c09756-e77e-4921-bb49-c306c8eab4c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:12.471581 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c09756-e77e-4921-bb49-c306c8eab4c1 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:12.507417 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1026/2039] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:12.508291 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c09756-e77e-4921-bb49-c306c8eab4c1 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:12.534053 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c09756-e77e-4921-bb49-c306c8eab4c1 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:12.542923 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780d787-80b5-4715-989a-b6cd0ff54303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:12.543942 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780d787-80b5-4715-989a-b6cd0ff54303 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:12.544227 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780d787-80b5-4715-989a-b6cd0ff54303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:12.544610 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780d787-80b5-4715-989a-b6cd0ff54303 admin admin] PATH_INFO: `/v3/projects/cf04a5f4ff514ac183745c49146d5b16/users/52c44d81a15143fba880c2ce5f41b635/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:12.561300 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba614f55-145f-4f47-9d03-5c2e68f175a3 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:12.569283 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db2120-23a0-4365-878e-27597426ede3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:12.570357 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db2120-23a0-4365-878e-27597426ede3 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:12.570948 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db2120-23a0-4365-878e-27597426ede3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:12.571360 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db2120-23a0-4365-878e-27597426ede3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:12.587035 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db2120-23a0-4365-878e-27597426ede3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:12.589821 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db2120-23a0-4365-878e-27597426ede3 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:12.597839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780d787-80b5-4715-989a-b6cd0ff54303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf04a5f4ff514ac183745c49146d5b16, user_id=52c44d81a15143fba880c2ce5f41b635, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:12.600772 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780d787-80b5-4715-989a-b6cd0ff54303 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:12.603621 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1014/2040] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:33:12.633049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1027/2041] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:12 2022] PUT /identity/v3/projects/cf04a5f4ff514ac183745c49146d5b16/users/52c44d81a15143fba880c2ce5f41b635/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:12.636286 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add8484-8bd7-45de-ba48-9d809c4a81c4 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:12.636957 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add8484-8bd7-45de-ba48-9d809c4a81c4 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:12.637272 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add8484-8bd7-45de-ba48-9d809c4a81c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:12.672260 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-5add8484-8bd7-45de-ba48-9d809c4a81c4 None None] MFA Rules not processed for user `52c44d81a15143fba880c2ce5f41b635`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:12.673753 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-5add8484-8bd7-45de-ba48-9d809c4a81c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:12.732569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780d787-80b5-4715-989a-b6cd0ff54303 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:12.735819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-d780d787-80b5-4715-989a-b6cd0ff54303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:12.804604 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1015/2042] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:12.819836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add8484-8bd7-45de-ba48-9d809c4a81c4 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:12.825299 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-5add8484-8bd7-45de-ba48-9d809c4a81c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:12.867104 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:12.910892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780d787-80b5-4715-989a-b6cd0ff54303 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:12.944702 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03aaa9-f302-42a8-b109-9ddd83d053f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:12.947747 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03aaa9-f302-42a8-b109-9ddd83d053f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:12.948413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03aaa9-f302-42a8-b109-9ddd83d053f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:12.949315 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03aaa9-f302-42a8-b109-9ddd83d053f1 admin admin] PATH_INFO: `/v3/users/1da6a40cc1314c28916ef1597e984422` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:12.952759 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f03aaa9-f302-42a8-b109-9ddd83d053f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1da6a40cc1314c28916ef1597e984422)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:12.958853 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f03aaa9-f302-42a8-b109-9ddd83d053f1 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:13.042828 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-9f03aaa9-f302-42a8-b109-9ddd83d053f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1da6a40cc1314c28916ef1597e984422'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:13.045218 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add8484-8bd7-45de-ba48-9d809c4a81c4 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:13.051249 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36fe89-5e3e-4011-b7ff-18560ac94e1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:13.052096 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36fe89-5e3e-4011-b7ff-18560ac94e1b service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:13.052620 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36fe89-5e3e-4011-b7ff-18560ac94e1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:13.053144 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36fe89-5e3e-4011-b7ff-18560ac94e1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:13.066164 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-9f03aaa9-f302-42a8-b109-9ddd83d053f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1da6a40cc1314c28916ef1597e984422'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:13.093957 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-9f03aaa9-f302-42a8-b109-9ddd83d053f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1da6a40cc1314c28916ef1597e984422'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:13.099113 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-9f03aaa9-f302-42a8-b109-9ddd83d053f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1da6a40cc1314c28916ef1597e984422'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:13.104665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-9f03aaa9-f302-42a8-b109-9ddd83d053f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1da6a40cc1314c28916ef1597e984422'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:13.113245 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36fe89-5e3e-4011-b7ff-18560ac94e1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:13.122297 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36fe89-5e3e-4011-b7ff-18560ac94e1b service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:13.145340 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1028/2043] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:12 2022] DELETE /identity/v3/users/1da6a40cc1314c28916ef1597e984422 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:13.148379 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac573a5-9150-4f19-8e90-ebd02798941d None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:13.149300 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac573a5-9150-4f19-8e90-ebd02798941d None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:13.149518 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac573a5-9150-4f19-8e90-ebd02798941d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:13.171397 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1016/2044] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:13.177842 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-2ac573a5-9150-4f19-8e90-ebd02798941d None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:13.179500 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-2ac573a5-9150-4f19-8e90-ebd02798941d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:13.209075 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36fe89-5e3e-4011-b7ff-18560ac94e1b service cinder] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:13.216368 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-1f36fe89-5e3e-4011-b7ff-18560ac94e1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:13.243404 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:13.287241 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36fe89-5e3e-4011-b7ff-18560ac94e1b service cinder] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:13.384847 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1029/2045] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:13.387482 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac573a5-9150-4f19-8e90-ebd02798941d None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:13.391418 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-2ac573a5-9150-4f19-8e90-ebd02798941d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:13.494185 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09860afd-c045-430a-b370-0639e6d78e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:13.498298 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09860afd-c045-430a-b370-0639e6d78e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:13.500977 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09860afd-c045-430a-b370-0639e6d78e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:13.501324 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09860afd-c045-430a-b370-0639e6d78e4d admin admin] PATH_INFO: `/v3/projects/46d2b28627e84fc89a55d6954d6e8736` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:13.503603 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09860afd-c045-430a-b370-0639e6d78e4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=46d2b28627e84fc89a55d6954d6e8736)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:13.508426 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09860afd-c045-430a-b370-0639e6d78e4d admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:13.515329 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac573a5-9150-4f19-8e90-ebd02798941d None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:13.531205 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ffd88-1b06-4455-80a1-80137a41e691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:13.532303 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ffd88-1b06-4455-80a1-80137a41e691 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:13.532794 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ffd88-1b06-4455-80a1-80137a41e691 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:13.533676 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ffd88-1b06-4455-80a1-80137a41e691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:13.558907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ffd88-1b06-4455-80a1-80137a41e691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:13.563814 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ffd88-1b06-4455-80a1-80137a41e691 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:13.595278 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1030/2046] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:13.674942 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-09860afd-c045-430a-b370-0639e6d78e4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46d2b28627e84fc89a55d6954d6e8736', 'request_id': 'req-09860afd-c045-430a-b370-0639e6d78e4d'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:13.690341 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-09860afd-c045-430a-b370-0639e6d78e4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46d2b28627e84fc89a55d6954d6e8736', 'request_id': 'req-09860afd-c045-430a-b370-0639e6d78e4d'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:13.721435 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-09860afd-c045-430a-b370-0639e6d78e4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46d2b28627e84fc89a55d6954d6e8736', 'request_id': 'req-09860afd-c045-430a-b370-0639e6d78e4d'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:13.748364 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-09860afd-c045-430a-b370-0639e6d78e4d admin admin] The token cache is being invalidate because project 46d2b28627e84fc89a55d6954d6e8736 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:13.749038 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-09860afd-c045-430a-b370-0639e6d78e4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:13.749934 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-09860afd-c045-430a-b370-0639e6d78e4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:13.754224 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1017/2047] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:13 2022] DELETE /identity/v3/projects/46d2b28627e84fc89a55d6954d6e8736 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:13.759332 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ffd88-1b06-4455-80a1-80137a41e691 service neutron] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:13.761857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-733ffd88-1b06-4455-80a1-80137a41e691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:13.784903 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ffd88-1b06-4455-80a1-80137a41e691 service neutron] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:13.917032 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef748d4b-9101-43a9-96d7-bb5db73c37a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:13.920968 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef748d4b-9101-43a9-96d7-bb5db73c37a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:13.921425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef748d4b-9101-43a9-96d7-bb5db73c37a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:13.921936 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef748d4b-9101-43a9-96d7-bb5db73c37a1 admin admin] PATH_INFO: `/v3/users/504b9918f1a6496b8e75e5d32a8c9c3c` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:13.927104 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef748d4b-9101-43a9-96d7-bb5db73c37a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=504b9918f1a6496b8e75e5d32a8c9c3c)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:13.931451 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef748d4b-9101-43a9-96d7-bb5db73c37a1 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:14.003875 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ef748d4b-9101-43a9-96d7-bb5db73c37a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '504b9918f1a6496b8e75e5d32a8c9c3c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:14.017044 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ef748d4b-9101-43a9-96d7-bb5db73c37a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '504b9918f1a6496b8e75e5d32a8c9c3c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:14.022827 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:14.026624 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ef748d4b-9101-43a9-96d7-bb5db73c37a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '504b9918f1a6496b8e75e5d32a8c9c3c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:14.027670 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ef748d4b-9101-43a9-96d7-bb5db73c37a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '504b9918f1a6496b8e75e5d32a8c9c3c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:14.029634 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ef748d4b-9101-43a9-96d7-bb5db73c37a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '504b9918f1a6496b8e75e5d32a8c9c3c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:14.049876 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1031/2048] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:13 2022] DELETE /identity/v3/users/504b9918f1a6496b8e75e5d32a8c9c3c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:14.454381 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09860afd-c045-430a-b370-0639e6d78e4d admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:14.456676 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-09860afd-c045-430a-b370-0639e6d78e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:14.475751 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09860afd-c045-430a-b370-0639e6d78e4d admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:14.550484 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:14.567763 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88beb3bc-8b26-4c79-8478-a9fdb395a3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:14.568927 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88beb3bc-8b26-4c79-8478-a9fdb395a3c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:14.569321 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88beb3bc-8b26-4c79-8478-a9fdb395a3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:14.569741 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88beb3bc-8b26-4c79-8478-a9fdb395a3c2 admin admin] PATH_INFO: `/v3/projects/4e106da90ed24851ade85e2ecfbe0eed` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:14.571379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88beb3bc-8b26-4c79-8478-a9fdb395a3c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e106da90ed24851ade85e2ecfbe0eed)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:14.573769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88beb3bc-8b26-4c79-8478-a9fdb395a3c2 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:14.626969 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-88beb3bc-8b26-4c79-8478-a9fdb395a3c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e106da90ed24851ade85e2ecfbe0eed', 'request_id': 'req-88beb3bc-8b26-4c79-8478-a9fdb395a3c2'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:14.634359 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-88beb3bc-8b26-4c79-8478-a9fdb395a3c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e106da90ed24851ade85e2ecfbe0eed', 'request_id': 'req-88beb3bc-8b26-4c79-8478-a9fdb395a3c2'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:14.642051 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-88beb3bc-8b26-4c79-8478-a9fdb395a3c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e106da90ed24851ade85e2ecfbe0eed', 'request_id': 'req-88beb3bc-8b26-4c79-8478-a9fdb395a3c2'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:14.655520 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-88beb3bc-8b26-4c79-8478-a9fdb395a3c2 admin admin] The token cache is being invalidate because project 4e106da90ed24851ade85e2ecfbe0eed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:14.655811 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-88beb3bc-8b26-4c79-8478-a9fdb395a3c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:14.656476 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-88beb3bc-8b26-4c79-8478-a9fdb395a3c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:14.658610 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1018/2049] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:14 2022] DELETE /identity/v3/projects/4e106da90ed24851ade85e2ecfbe0eed => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:14.662688 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef748d4b-9101-43a9-96d7-bb5db73c37a1 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:14.664186 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-ef748d4b-9101-43a9-96d7-bb5db73c37a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:14.679738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef748d4b-9101-43a9-96d7-bb5db73c37a1 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:14.759149 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937c6d9-75c7-4d63-94f7-f720b92147c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:14.760179 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937c6d9-75c7-4d63-94f7-f720b92147c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:14.760733 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937c6d9-75c7-4d63-94f7-f720b92147c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:14.760901 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937c6d9-75c7-4d63-94f7-f720b92147c7 admin admin] PATH_INFO: `/v3/users/931fd759a05d460db1598d8c0c3cf403` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:14.762853 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937c6d9-75c7-4d63-94f7-f720b92147c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=931fd759a05d460db1598d8c0c3cf403)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:14.768975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937c6d9-75c7-4d63-94f7-f720b92147c7 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:14.858125 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-4937c6d9-75c7-4d63-94f7-f720b92147c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '931fd759a05d460db1598d8c0c3cf403'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:14.879545 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-4937c6d9-75c7-4d63-94f7-f720b92147c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '931fd759a05d460db1598d8c0c3cf403'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:14.891547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-4937c6d9-75c7-4d63-94f7-f720b92147c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '931fd759a05d460db1598d8c0c3cf403'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:14.892631 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-4937c6d9-75c7-4d63-94f7-f720b92147c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '931fd759a05d460db1598d8c0c3cf403'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:14.893362 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-4937c6d9-75c7-4d63-94f7-f720b92147c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '931fd759a05d460db1598d8c0c3cf403'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:14.919992 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1032/2050] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:14 2022] DELETE /identity/v3/users/931fd759a05d460db1598d8c0c3cf403 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:15.480482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88beb3bc-8b26-4c79-8478-a9fdb395a3c2 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:15.483505 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-88beb3bc-8b26-4c79-8478-a9fdb395a3c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:15.510806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88beb3bc-8b26-4c79-8478-a9fdb395a3c2 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:15.658578 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937c6d9-75c7-4d63-94f7-f720b92147c7 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:15.660409 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-4937c6d9-75c7-4d63-94f7-f720b92147c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:15.690739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9886b-a168-4cd6-bb88-d9ad71d947b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:15.693097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9886b-a168-4cd6-bb88-d9ad71d947b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:15.695055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9886b-a168-4cd6-bb88-d9ad71d947b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:15.695376 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9886b-a168-4cd6-bb88-d9ad71d947b9 admin admin] PATH_INFO: `/v3/projects/4deadd0eebe94e68b99a03a9f03a40b4` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:15.699398 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9886b-a168-4cd6-bb88-d9ad71d947b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4deadd0eebe94e68b99a03a9f03a40b4)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:15.701897 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9886b-a168-4cd6-bb88-d9ad71d947b9 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:15.812142 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-c5f9886b-a168-4cd6-bb88-d9ad71d947b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4deadd0eebe94e68b99a03a9f03a40b4', 'request_id': 'req-c5f9886b-a168-4cd6-bb88-d9ad71d947b9'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:15.827664 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-c5f9886b-a168-4cd6-bb88-d9ad71d947b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4deadd0eebe94e68b99a03a9f03a40b4', 'request_id': 'req-c5f9886b-a168-4cd6-bb88-d9ad71d947b9'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:15.848775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-c5f9886b-a168-4cd6-bb88-d9ad71d947b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4deadd0eebe94e68b99a03a9f03a40b4', 'request_id': 'req-c5f9886b-a168-4cd6-bb88-d9ad71d947b9'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:15.885385 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937c6d9-75c7-4d63-94f7-f720b92147c7 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:15.893294 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-c5f9886b-a168-4cd6-bb88-d9ad71d947b9 admin admin] The token cache is being invalidate because project 4deadd0eebe94e68b99a03a9f03a40b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:15.893463 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-c5f9886b-a168-4cd6-bb88-d9ad71d947b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:15.894864 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-c5f9886b-a168-4cd6-bb88-d9ad71d947b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:15.903320 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1019/2051] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:15 2022] DELETE /identity/v3/projects/4deadd0eebe94e68b99a03a9f03a40b4 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:33:15.908730 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56a690-feb2-49e7-bcdc-506544ece23e None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:15.912764 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56a690-feb2-49e7-bcdc-506544ece23e None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:15.914175 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56a690-feb2-49e7-bcdc-506544ece23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:15.920579 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:15.956982 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:15.969263 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-3a56a690-feb2-49e7-bcdc-506544ece23e None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:15.971673 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-3a56a690-feb2-49e7-bcdc-506544ece23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:16.014887 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae800a98-0e94-48ba-86e5-38b3ead65a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:16.015978 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae800a98-0e94-48ba-86e5-38b3ead65a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:16.016104 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae800a98-0e94-48ba-86e5-38b3ead65a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:16.016440 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae800a98-0e94-48ba-86e5-38b3ead65a4f admin admin] PATH_INFO: `/v3/projects/cc0336cd5d884f4aa76a189214548f35` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:16.019055 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae800a98-0e94-48ba-86e5-38b3ead65a4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc0336cd5d884f4aa76a189214548f35)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:16.021172 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae800a98-0e94-48ba-86e5-38b3ead65a4f admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:16.091476 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ae800a98-0e94-48ba-86e5-38b3ead65a4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc0336cd5d884f4aa76a189214548f35', 'request_id': 'req-ae800a98-0e94-48ba-86e5-38b3ead65a4f'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:16.097605 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1020/2052] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:16.107457 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ae800a98-0e94-48ba-86e5-38b3ead65a4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc0336cd5d884f4aa76a189214548f35', 'request_id': 'req-ae800a98-0e94-48ba-86e5-38b3ead65a4f'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:16.110962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b8cd5-b326-484f-9905-a04966055299 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:16.111960 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b8cd5-b326-484f-9905-a04966055299 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:16.112536 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b8cd5-b326-484f-9905-a04966055299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:16.117266 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ae800a98-0e94-48ba-86e5-38b3ead65a4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc0336cd5d884f4aa76a189214548f35', 'request_id': 'req-ae800a98-0e94-48ba-86e5-38b3ead65a4f'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:16.139489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-647b8cd5-b326-484f-9905-a04966055299 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:16.140634 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ae800a98-0e94-48ba-86e5-38b3ead65a4f admin admin] The token cache is being invalidate because project cc0336cd5d884f4aa76a189214548f35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:16.140986 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ae800a98-0e94-48ba-86e5-38b3ead65a4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:16.142218 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ae800a98-0e94-48ba-86e5-38b3ead65a4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:16.148302 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1033/2053] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:15 2022] DELETE /identity/v3/projects/cc0336cd5d884f4aa76a189214548f35 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:16.150313 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6551cc3-0207-4956-888d-72eb62127bb5 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:16.150666 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6551cc3-0207-4956-888d-72eb62127bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:16.150967 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6551cc3-0207-4956-888d-72eb62127bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:16.161515 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-647b8cd5-b326-484f-9905-a04966055299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:16.179783 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-b6551cc3-0207-4956-888d-72eb62127bb5 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:16.181243 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-b6551cc3-0207-4956-888d-72eb62127bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:16.266585 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1021/2054] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:16.268259 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b8cd5-b326-484f-9905-a04966055299 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:16.294290 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b8cd5-b326-484f-9905-a04966055299 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:16.308670 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf6534-9e42-47c7-8f64-a4a9ed078982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:16.309557 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf6534-9e42-47c7-8f64-a4a9ed078982 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:16.309900 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf6534-9e42-47c7-8f64-a4a9ed078982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:16.310157 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf6534-9e42-47c7-8f64-a4a9ed078982 admin admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:16.311365 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf6534-9e42-47c7-8f64-a4a9ed078982 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:16.312671 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf6534-9e42-47c7-8f64-a4a9ed078982 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:16.317733 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf6534-9e42-47c7-8f64-a4a9ed078982 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:16.321354 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1034/2055] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:16.326229 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e409f-82e0-4b2d-9aab-417724e89359 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:16.326670 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e409f-82e0-4b2d-9aab-417724e89359 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:16.327945 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e409f-82e0-4b2d-9aab-417724e89359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:16.351817 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1022/2056] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:16.357401 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf6534-9e42-47c7-8f64-a4a9ed078982 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:16.375417 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf6534-9e42-47c7-8f64-a4a9ed078982 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:16.382470 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46d959-2e38-4bd8-9008-325d4d7338f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:16.382615 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-f87e409f-82e0-4b2d-9aab-417724e89359 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:16.383568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46d959-2e38-4bd8-9008-325d4d7338f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:16.384039 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46d959-2e38-4bd8-9008-325d4d7338f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:16.384719 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46d959-2e38-4bd8-9008-325d4d7338f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:16.384866 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-f87e409f-82e0-4b2d-9aab-417724e89359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:16.386414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46d959-2e38-4bd8-9008-325d4d7338f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:16.389527 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46d959-2e38-4bd8-9008-325d4d7338f9 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:16.401118 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1035/2057] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:16.411494 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e409f-82e0-4b2d-9aab-417724e89359 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:16.424190 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e409f-82e0-4b2d-9aab-417724e89359 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:16.434489 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df826f4-ad65-418e-aa9a-5946d42b3d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:16.435424 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df826f4-ad65-418e-aa9a-5946d42b3d0c admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:16.435847 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df826f4-ad65-418e-aa9a-5946d42b3d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:16.436230 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df826f4-ad65-418e-aa9a-5946d42b3d0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:16.437110 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1023/2058] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:33:16 2022] POST /identity/v3/projects => generated 371 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:16.437260 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df826f4-ad65-418e-aa9a-5946d42b3d0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:16.437647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df826f4-ad65-418e-aa9a-5946d42b3d0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:16.439585 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df826f4-ad65-418e-aa9a-5946d42b3d0c admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:16.444524 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46d959-2e38-4bd8-9008-325d4d7338f9 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:16.459266 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1036/2059] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:16.464375 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df826f4-ad65-418e-aa9a-5946d42b3d0c admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:16.493958 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df826f4-ad65-418e-aa9a-5946d42b3d0c admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:16.546095 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:16.575140 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46d959-2e38-4bd8-9008-325d4d7338f9 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:16.583459 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb8f82-8edd-476e-a25a-735d0fa82bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:16.586991 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb8f82-8edd-476e-a25a-735d0fa82bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:16.587701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb8f82-8edd-476e-a25a-735d0fa82bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:16.588479 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb8f82-8edd-476e-a25a-735d0fa82bb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:16.589543 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb8f82-8edd-476e-a25a-735d0fa82bb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:16.591737 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb8f82-8edd-476e-a25a-735d0fa82bb7 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:16.632927 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1024/2060] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:33:16 2022] POST /identity/v3/users => generated 286 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:16.638152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb8f82-8edd-476e-a25a-735d0fa82bb7 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:16.639852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb6f78-ac24-4443-b5df-dab2124b91a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:16.640677 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb6f78-ac24-4443-b5df-dab2124b91a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:16.640992 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb6f78-ac24-4443-b5df-dab2124b91a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:16.642246 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb6f78-ac24-4443-b5df-dab2124b91a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:16.643176 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb6f78-ac24-4443-b5df-dab2124b91a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:16.646611 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:16.651817 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb6f78-ac24-4443-b5df-dab2124b91a5 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:16.663897 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb8f82-8edd-476e-a25a-735d0fa82bb7 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:16.671200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edb9b6-e01f-4ed7-9a37-d4a1c55b5d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:16.674240 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edb9b6-e01f-4ed7-9a37-d4a1c55b5d27 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:16.676036 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edb9b6-e01f-4ed7-9a37-d4a1c55b5d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:16.677076 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edb9b6-e01f-4ed7-9a37-d4a1c55b5d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:16.679028 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16edb9b6-e01f-4ed7-9a37-d4a1c55b5d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:16.684460 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16edb9b6-e01f-4ed7-9a37-d4a1c55b5d27 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:16.710863 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1025/2061] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:16.711408 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1037/2062] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:33:16 2022] POST /identity/v3/projects => generated 367 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:16.714326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edb9b6-e01f-4ed7-9a37-d4a1c55b5d27 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:16.716868 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb6f78-ac24-4443-b5df-dab2124b91a5 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:16.729871 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edb9b6-e01f-4ed7-9a37-d4a1c55b5d27 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:16.857948 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd1475-217f-403d-bd5a-7e41034f3fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:16.858920 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd1475-217f-403d-bd5a-7e41034f3fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:16.859205 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd1475-217f-403d-bd5a-7e41034f3fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:16.862867 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd1475-217f-403d-bd5a-7e41034f3fa9 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:16.864254 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd1475-217f-403d-bd5a-7e41034f3fa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:16.865314 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb6f78-ac24-4443-b5df-dab2124b91a5 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:16.868641 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd1475-217f-403d-bd5a-7e41034f3fa9 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:16.879046 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621eeb60-c2cd-47f5-9fbf-57415083fec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:16.882435 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621eeb60-c2cd-47f5-9fbf-57415083fec3 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:16.883953 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621eeb60-c2cd-47f5-9fbf-57415083fec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:16.884388 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621eeb60-c2cd-47f5-9fbf-57415083fec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:16.886725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621eeb60-c2cd-47f5-9fbf-57415083fec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:16.889142 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621eeb60-c2cd-47f5-9fbf-57415083fec3 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:16.903018 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1026/2063] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:33:16 2022] POST /identity/v3/users => generated 284 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:16.907508 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd1475-217f-403d-bd5a-7e41034f3fa9 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:16.924819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd1475-217f-403d-bd5a-7e41034f3fa9 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:16.929909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1038/2064] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:16.930967 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34946f-0e6e-41b6-8f4c-44ef8ba6a962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:16.931482 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621eeb60-c2cd-47f5-9fbf-57415083fec3 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:16.931729 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34946f-0e6e-41b6-8f4c-44ef8ba6a962 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:16.932066 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34946f-0e6e-41b6-8f4c-44ef8ba6a962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:16.932350 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34946f-0e6e-41b6-8f4c-44ef8ba6a962 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:16.933192 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e34946f-0e6e-41b6-8f4c-44ef8ba6a962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:16.936540 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e34946f-0e6e-41b6-8f4c-44ef8ba6a962 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:16.954651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1027/2065] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:16.958947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34946f-0e6e-41b6-8f4c-44ef8ba6a962 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:16.961340 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621eeb60-c2cd-47f5-9fbf-57415083fec3 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:16.977358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34946f-0e6e-41b6-8f4c-44ef8ba6a962 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:16.983338 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0be95-363e-4865-9ab8-60ec93a510ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:16.984134 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0be95-363e-4865-9ab8-60ec93a510ab admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:16.984427 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0be95-363e-4865-9ab8-60ec93a510ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:16.984713 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0be95-363e-4865-9ab8-60ec93a510ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:16.985624 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0be95-363e-4865-9ab8-60ec93a510ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:16.988292 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0be95-363e-4865-9ab8-60ec93a510ab admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:16.988429 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1da82-2a8f-42e0-8efb-dc2ca96dcf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:16.989581 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1da82-2a8f-42e0-8efb-dc2ca96dcf3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:16.993027 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1da82-2a8f-42e0-8efb-dc2ca96dcf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:16.993670 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1da82-2a8f-42e0-8efb-dc2ca96dcf3c admin admin] PATH_INFO: `/v3/projects/e47d60492ece472aadd3cc7f155031e1/users/58a1f75d40434f0bbb749a45c190acca/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:17.002101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1028/2066] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:17.007582 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0be95-363e-4865-9ab8-60ec93a510ab admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:17.029175 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0be95-363e-4865-9ab8-60ec93a510ab admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:17.029982 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1da82-2a8f-42e0-8efb-dc2ca96dcf3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e47d60492ece472aadd3cc7f155031e1, user_id=58a1f75d40434f0bbb749a45c190acca, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:17.037595 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86796c75-32c3-434a-8455-a85de8830605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:17.038856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86796c75-32c3-434a-8455-a85de8830605 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:17.039257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1da82-2a8f-42e0-8efb-dc2ca96dcf3c admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:17.039357 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86796c75-32c3-434a-8455-a85de8830605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:17.039471 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86796c75-32c3-434a-8455-a85de8830605 admin admin] PATH_INFO: `/v3/projects/dc2902363f9e4ecb82b78467d1da1c0b/users/443863fe856848c1bee029f3289bd721/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:17.063459 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86796c75-32c3-434a-8455-a85de8830605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc2902363f9e4ecb82b78467d1da1c0b, user_id=443863fe856848c1bee029f3289bd721, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:17.067057 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86796c75-32c3-434a-8455-a85de8830605 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:17.070941 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1039/2067] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:16 2022] PUT /identity/v3/projects/e47d60492ece472aadd3cc7f155031e1/users/58a1f75d40434f0bbb749a45c190acca/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:17.074192 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3bbd2-5998-4bac-a235-16a04a71139b None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:17.075434 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3bbd2-5998-4bac-a235-16a04a71139b None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:17.075972 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3bbd2-5998-4bac-a235-16a04a71139b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:17.096412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1029/2068] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:17 2022] PUT /identity/v3/projects/dc2902363f9e4ecb82b78467d1da1c0b/users/443863fe856848c1bee029f3289bd721/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:17.109335 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57211281-38a9-42c3-899f-63804dfe1ee0 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:17.109653 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57211281-38a9-42c3-899f-63804dfe1ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:17.109936 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57211281-38a9-42c3-899f-63804dfe1ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:17.125333 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-34b3bbd2-5998-4bac-a235-16a04a71139b None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:17.127654 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-34b3bbd2-5998-4bac-a235-16a04a71139b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:17.193080 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-57211281-38a9-42c3-899f-63804dfe1ee0 None None] MFA Rules not processed for user `443863fe856848c1bee029f3289bd721`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:17.201695 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-57211281-38a9-42c3-899f-63804dfe1ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:17.270489 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1040/2069] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:17.283409 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3bbd2-5998-4bac-a235-16a04a71139b None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:17.287044 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-34b3bbd2-5998-4bac-a235-16a04a71139b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:17.355652 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:17.436078 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3bbd2-5998-4bac-a235-16a04a71139b None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:17.444240 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7888412-5997-42d1-8709-ca3975c37c8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:17.444939 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7888412-5997-42d1-8709-ca3975c37c8a service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:17.445416 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7888412-5997-42d1-8709-ca3975c37c8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:17.445537 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7888412-5997-42d1-8709-ca3975c37c8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:17.457371 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1030/2070] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:17 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:33:17.462186 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57211281-38a9-42c3-899f-63804dfe1ee0 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:17.468322 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7888412-5997-42d1-8709-ca3975c37c8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:17.469825 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7888412-5997-42d1-8709-ca3975c37c8a service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:17.485406 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57211281-38a9-42c3-899f-63804dfe1ee0 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:17.495001 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1519f1-2878-42f8-a0b3-ba43dc50efa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:17.497202 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1519f1-2878-42f8-a0b3-ba43dc50efa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:17.497759 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1519f1-2878-42f8-a0b3-ba43dc50efa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:17.498188 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1519f1-2878-42f8-a0b3-ba43dc50efa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:17.502655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1041/2071] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:17.514790 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1519f1-2878-42f8-a0b3-ba43dc50efa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:17.524466 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1519f1-2878-42f8-a0b3-ba43dc50efa0 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:17.572565 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1031/2072] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:33:17 2022] POST /identity/v3/projects => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:33:17.576651 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7888412-5997-42d1-8709-ca3975c37c8a service neutron] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:17.601897 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7888412-5997-42d1-8709-ca3975c37c8a service neutron] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:17.758427 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347251c-2399-46cf-9934-6a8c972db7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:17.759369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347251c-2399-46cf-9934-6a8c972db7da admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:17.759683 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347251c-2399-46cf-9934-6a8c972db7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:17.760164 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347251c-2399-46cf-9934-6a8c972db7da admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:17.761086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347251c-2399-46cf-9934-6a8c972db7da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:17.763717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347251c-2399-46cf-9934-6a8c972db7da admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:17.810626 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1042/2073] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:33:17 2022] POST /identity/v3/users => generated 290 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:17.814808 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1519f1-2878-42f8-a0b3-ba43dc50efa0 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:17.828227 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:17.832753 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1519f1-2878-42f8-a0b3-ba43dc50efa0 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:17.849306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1704acc-4716-4f2f-83fd-d5932566dcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:17.850136 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1704acc-4716-4f2f-83fd-d5932566dcc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:17.850516 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1704acc-4716-4f2f-83fd-d5932566dcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:17.851857 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1704acc-4716-4f2f-83fd-d5932566dcc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:17.859997 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1704acc-4716-4f2f-83fd-d5932566dcc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:17.862758 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1704acc-4716-4f2f-83fd-d5932566dcc7 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:17.885823 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1032/2074] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:17.887642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347251c-2399-46cf-9934-6a8c972db7da admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:17.911008 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347251c-2399-46cf-9934-6a8c972db7da admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:17.917754 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75853a66-3023-499b-af2c-a88c30c179b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:17.918801 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75853a66-3023-499b-af2c-a88c30c179b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:17.919244 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75853a66-3023-499b-af2c-a88c30c179b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:17.919767 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75853a66-3023-499b-af2c-a88c30c179b0 admin admin] PATH_INFO: `/v3/projects/7e686e936a7142119bc50b474319e700/users/65c376609ca545a699dbca85b3bc01d8/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:17.939594 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75853a66-3023-499b-af2c-a88c30c179b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e686e936a7142119bc50b474319e700, user_id=65c376609ca545a699dbca85b3bc01d8, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:17.942364 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75853a66-3023-499b-af2c-a88c30c179b0 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:17.964816 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1043/2075] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:17 2022] PUT /identity/v3/projects/7e686e936a7142119bc50b474319e700/users/65c376609ca545a699dbca85b3bc01d8/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:17.969157 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1704acc-4716-4f2f-83fd-d5932566dcc7 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:17.990351 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1704acc-4716-4f2f-83fd-d5932566dcc7 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:18.107406 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611c190-3ab8-4ba0-997b-3d2bac9cdc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:18.108370 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611c190-3ab8-4ba0-997b-3d2bac9cdc71 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:18.108989 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611c190-3ab8-4ba0-997b-3d2bac9cdc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:18.109528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611c190-3ab8-4ba0-997b-3d2bac9cdc71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:18.110793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611c190-3ab8-4ba0-997b-3d2bac9cdc71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:18.116222 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611c190-3ab8-4ba0-997b-3d2bac9cdc71 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:18.139527 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1033/2076] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:18.145727 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75853a66-3023-499b-af2c-a88c30c179b0 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:18.161120 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75853a66-3023-499b-af2c-a88c30c179b0 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:18.167381 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbbde3-2561-4cd0-8f73-54715b883866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:18.168419 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbbde3-2561-4cd0-8f73-54715b883866 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:18.168878 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbbde3-2561-4cd0-8f73-54715b883866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:18.169285 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbbde3-2561-4cd0-8f73-54715b883866 admin admin] PATH_INFO: `/v3/projects/7e686e936a7142119bc50b474319e700/users/65c376609ca545a699dbca85b3bc01d8/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:18.171953 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cbbde3-2561-4cd0-8f73-54715b883866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e686e936a7142119bc50b474319e700, user_id=65c376609ca545a699dbca85b3bc01d8, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:18.175780 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cbbde3-2561-4cd0-8f73-54715b883866 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:18.200063 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1044/2077] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:18 2022] PUT /identity/v3/projects/7e686e936a7142119bc50b474319e700/users/65c376609ca545a699dbca85b3bc01d8/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:18.202240 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdda47-5983-4c98-9ae2-7451c1a7547d None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:18.205122 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdda47-5983-4c98-9ae2-7451c1a7547d None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:18.206339 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdda47-5983-4c98-9ae2-7451c1a7547d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:18.249058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-e2cdda47-5983-4c98-9ae2-7451c1a7547d None None] MFA Rules not processed for user `65c376609ca545a699dbca85b3bc01d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:18.250595 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-e2cdda47-5983-4c98-9ae2-7451c1a7547d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:18.393532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1034/2078] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:18 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:18.427748 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbbde3-2561-4cd0-8f73-54715b883866 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:18.429811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-99cbbde3-2561-4cd0-8f73-54715b883866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:18.574121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbbde3-2561-4cd0-8f73-54715b883866 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:18.578937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d605a3-f915-42ca-a5e8-f4be101a5d37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:18.579644 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d605a3-f915-42ca-a5e8-f4be101a5d37 service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:18.579960 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d605a3-f915-42ca-a5e8-f4be101a5d37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:18.580245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d605a3-f915-42ca-a5e8-f4be101a5d37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:18.594562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d605a3-f915-42ca-a5e8-f4be101a5d37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:18.596893 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d605a3-f915-42ca-a5e8-f4be101a5d37 service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:18.622114 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1045/2079] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:18 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:18.704019 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdda47-5983-4c98-9ae2-7451c1a7547d None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:18.710877 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552de220-6ce8-4cfb-94e5-829270b250ba None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:18.711175 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552de220-6ce8-4cfb-94e5-829270b250ba None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:18.712777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552de220-6ce8-4cfb-94e5-829270b250ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:18.728924 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdda47-5983-4c98-9ae2-7451c1a7547d None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:18.740194 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a51e20-c2c5-474e-b098-d770fb1c153a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:18.741389 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a51e20-c2c5-474e-b098-d770fb1c153a service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:18.742321 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a51e20-c2c5-474e-b098-d770fb1c153a service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:18.742746 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a51e20-c2c5-474e-b098-d770fb1c153a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:18.767807 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-552de220-6ce8-4cfb-94e5-829270b250ba None None] MFA Rules not processed for user `58a1f75d40434f0bbb749a45c190acca`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:18.772003 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-552de220-6ce8-4cfb-94e5-829270b250ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:18.804124 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:18.917648 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a51e20-c2c5-474e-b098-d770fb1c153a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:18.919322 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a51e20-c2c5-474e-b098-d770fb1c153a service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:18.952069 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1035/2080] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:18 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:18.997268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1046/2081] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:19.001214 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a51e20-c2c5-474e-b098-d770fb1c153a service cinder] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:19.021178 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:19.121973 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a51e20-c2c5-474e-b098-d770fb1c153a service cinder] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:19.134305 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9fd7f1-6db0-44db-b31d-2303a538618f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:19.135163 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fd7f1-6db0-44db-b31d-2303a538618f admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:19.137743 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fd7f1-6db0-44db-b31d-2303a538618f admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:19.138156 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fd7f1-6db0-44db-b31d-2303a538618f admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:19.139775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9fd7f1-6db0-44db-b31d-2303a538618f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:19.142288 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9fd7f1-6db0-44db-b31d-2303a538618f admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:19.214789 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1036/2082] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:33:19 2022] POST /identity/v3/projects => generated 367 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:33:19.219125 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552de220-6ce8-4cfb-94e5-829270b250ba None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:19.237914 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552de220-6ce8-4cfb-94e5-829270b250ba None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:19.350228 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d11e7-ce4e-4636-b44e-91af57928f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:19.351126 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d11e7-ce4e-4636-b44e-91af57928f78 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:19.351551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d11e7-ce4e-4636-b44e-91af57928f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:19.351970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d11e7-ce4e-4636-b44e-91af57928f78 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:19.352988 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d11e7-ce4e-4636-b44e-91af57928f78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:19.356777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d11e7-ce4e-4636-b44e-91af57928f78 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:19.394203 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1047/2083] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:33:19 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:19.399159 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9fd7f1-6db0-44db-b31d-2303a538618f admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:19.415461 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9fd7f1-6db0-44db-b31d-2303a538618f admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:19.430236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47b778-5b43-408b-aaba-7e62a5a303b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:19.431962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47b778-5b43-408b-aaba-7e62a5a303b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:19.436482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47b778-5b43-408b-aaba-7e62a5a303b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:19.436896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47b778-5b43-408b-aaba-7e62a5a303b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:19.438417 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47b778-5b43-408b-aaba-7e62a5a303b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:19.441188 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47b778-5b43-408b-aaba-7e62a5a303b2 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:19.497708 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1037/2084] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:19.501941 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d11e7-ce4e-4636-b44e-91af57928f78 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:19.527460 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d11e7-ce4e-4636-b44e-91af57928f78 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:19.552128 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056fddd-f6a8-48eb-9174-f7e24fcd5772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:19.553056 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056fddd-f6a8-48eb-9174-f7e24fcd5772 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:19.553424 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056fddd-f6a8-48eb-9174-f7e24fcd5772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:19.553719 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056fddd-f6a8-48eb-9174-f7e24fcd5772 admin admin] PATH_INFO: `/v3/projects/7ecd41a3eaf14d659aac48f5bc409d45/users/7c6c42229d024c5e9f88c26d7fd87e36/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:19.580566 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056fddd-f6a8-48eb-9174-f7e24fcd5772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ecd41a3eaf14d659aac48f5bc409d45, user_id=7c6c42229d024c5e9f88c26d7fd87e36, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:19.583878 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056fddd-f6a8-48eb-9174-f7e24fcd5772 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:19.605480 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1048/2085] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:19 2022] PUT /identity/v3/projects/7ecd41a3eaf14d659aac48f5bc409d45/users/7c6c42229d024c5e9f88c26d7fd87e36/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:33:19.606769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47b778-5b43-408b-aaba-7e62a5a303b2 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:19.620090 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47b778-5b43-408b-aaba-7e62a5a303b2 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:19.697601 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056fddd-f6a8-48eb-9174-f7e24fcd5772 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:19.700925 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-8056fddd-f6a8-48eb-9174-f7e24fcd5772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:19.751437 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e3bec-3b81-4d6d-8f35-8abf8572f1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:19.760370 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e3bec-3b81-4d6d-8f35-8abf8572f1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:19.760370 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e3bec-3b81-4d6d-8f35-8abf8572f1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:19.762868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e3bec-3b81-4d6d-8f35-8abf8572f1e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:19.765224 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e3bec-3b81-4d6d-8f35-8abf8572f1e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:19.776731 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e3bec-3b81-4d6d-8f35-8abf8572f1e1 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:19.800870 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1038/2086] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:19.805683 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e3bec-3b81-4d6d-8f35-8abf8572f1e1 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:19.821095 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e3bec-3b81-4d6d-8f35-8abf8572f1e1 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:19.835473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47af840-ac94-4906-945e-9080c3200c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:19.835473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47af840-ac94-4906-945e-9080c3200c67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:19.835473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47af840-ac94-4906-945e-9080c3200c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:19.835473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47af840-ac94-4906-945e-9080c3200c67 admin admin] PATH_INFO: `/v3/projects/7ecd41a3eaf14d659aac48f5bc409d45/users/7c6c42229d024c5e9f88c26d7fd87e36/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:19.835793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47af840-ac94-4906-945e-9080c3200c67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ecd41a3eaf14d659aac48f5bc409d45, user_id=7c6c42229d024c5e9f88c26d7fd87e36, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:19.835793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47af840-ac94-4906-945e-9080c3200c67 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:19.865309 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1039/2087] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:19 2022] PUT /identity/v3/projects/7ecd41a3eaf14d659aac48f5bc409d45/users/7c6c42229d024c5e9f88c26d7fd87e36/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:19.878083 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056fddd-f6a8-48eb-9174-f7e24fcd5772 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:19.912529 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:19.972667 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad3834-d38e-4aef-8cec-15143262f6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:19.973869 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad3834-d38e-4aef-8cec-15143262f6ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:19.974380 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad3834-d38e-4aef-8cec-15143262f6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:19.974771 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad3834-d38e-4aef-8cec-15143262f6ee admin admin] PATH_INFO: `/v3/users/8cf6e45efae9442097e54d4ee2162357` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:19.981624 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad3834-d38e-4aef-8cec-15143262f6ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cf6e45efae9442097e54d4ee2162357)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:19.984713 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad3834-d38e-4aef-8cec-15143262f6ee admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:20.071500 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-03ad3834-d38e-4aef-8cec-15143262f6ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cf6e45efae9442097e54d4ee2162357'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:20.100551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-03ad3834-d38e-4aef-8cec-15143262f6ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cf6e45efae9442097e54d4ee2162357'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:20.110295 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-03ad3834-d38e-4aef-8cec-15143262f6ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cf6e45efae9442097e54d4ee2162357'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:20.111403 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-03ad3834-d38e-4aef-8cec-15143262f6ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cf6e45efae9442097e54d4ee2162357'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:20.112262 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-03ad3834-d38e-4aef-8cec-15143262f6ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cf6e45efae9442097e54d4ee2162357'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:20.151551 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaf7a9-eec4-479b-9081-77b7aa83e0a7 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:20.152069 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1049/2088] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:19 2022] DELETE /identity/v3/users/8cf6e45efae9442097e54d4ee2162357 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:20.152152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaf7a9-eec4-479b-9081-77b7aa83e0a7 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:20.152152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaf7a9-eec4-479b-9081-77b7aa83e0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:20.191908 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-2aaaf7a9-eec4-479b-9081-77b7aa83e0a7 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:20.194546 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-2aaaf7a9-eec4-479b-9081-77b7aa83e0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:20.310704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1040/2089] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:33:20.328890 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad3834-d38e-4aef-8cec-15143262f6ee admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:20.331691 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-03ad3834-d38e-4aef-8cec-15143262f6ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:20.455024 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad3834-d38e-4aef-8cec-15143262f6ee admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:20.459966 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bce3c-c781-4364-bab9-8e434ffdb77c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:20.461427 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bce3c-c781-4364-bab9-8e434ffdb77c service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:20.462216 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bce3c-c781-4364-bab9-8e434ffdb77c service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:20.462714 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bce3c-c781-4364-bab9-8e434ffdb77c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:20.479982 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7bce3c-c781-4364-bab9-8e434ffdb77c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:20.484547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7bce3c-c781-4364-bab9-8e434ffdb77c service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:20.498933 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1050/2090] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:21.010189 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42671f0c-17f7-447d-be7e-ac25d031eb91 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:21.010960 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42671f0c-17f7-447d-be7e-ac25d031eb91 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:21.011465 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42671f0c-17f7-447d-be7e-ac25d031eb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:21.045699 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:21.074693 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-42671f0c-17f7-447d-be7e-ac25d031eb91 None None] MFA Rules not processed for user `7c6c42229d024c5e9f88c26d7fd87e36`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:21.076274 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-42671f0c-17f7-447d-be7e-ac25d031eb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:21.119918 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bce3c-c781-4364-bab9-8e434ffdb77c service neutron] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:21.120415 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-9b7bce3c-c781-4364-bab9-8e434ffdb77c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:21.143157 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bce3c-c781-4364-bab9-8e434ffdb77c service neutron] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:21.156490 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022b9a5-a2d9-45b6-a93c-01bf1e832607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:21.157390 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022b9a5-a2d9-45b6-a93c-01bf1e832607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:21.157677 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022b9a5-a2d9-45b6-a93c-01bf1e832607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:21.158516 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022b9a5-a2d9-45b6-a93c-01bf1e832607 admin admin] PATH_INFO: `/v3/projects/69d4b411928e4f71884efa37cdc7f401` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:21.162122 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022b9a5-a2d9-45b6-a93c-01bf1e832607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69d4b411928e4f71884efa37cdc7f401)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:21.168820 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022b9a5-a2d9-45b6-a93c-01bf1e832607 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:21.257182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1041/2091] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:21 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:21.277440 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c40573-8bd1-4d5a-af2a-759f9d508297 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:21.278867 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:21.281689 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c40573-8bd1-4d5a-af2a-759f9d508297 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:21.287916 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c40573-8bd1-4d5a-af2a-759f9d508297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:21.300228 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-c022b9a5-a2d9-45b6-a93c-01bf1e832607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69d4b411928e4f71884efa37cdc7f401', 'request_id': 'req-c022b9a5-a2d9-45b6-a93c-01bf1e832607'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:21.310444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-c022b9a5-a2d9-45b6-a93c-01bf1e832607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69d4b411928e4f71884efa37cdc7f401', 'request_id': 'req-c022b9a5-a2d9-45b6-a93c-01bf1e832607'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:21.328789 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-c022b9a5-a2d9-45b6-a93c-01bf1e832607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69d4b411928e4f71884efa37cdc7f401', 'request_id': 'req-c022b9a5-a2d9-45b6-a93c-01bf1e832607'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:21.335452 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-b1c40573-8bd1-4d5a-af2a-759f9d508297 None None] MFA Rules not processed for user `58a1f75d40434f0bbb749a45c190acca`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:21.338015 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-b1c40573-8bd1-4d5a-af2a-759f9d508297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:21.358582 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-c022b9a5-a2d9-45b6-a93c-01bf1e832607 admin admin] The token cache is being invalidate because project 69d4b411928e4f71884efa37cdc7f401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:21.358893 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-c022b9a5-a2d9-45b6-a93c-01bf1e832607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:21.362482 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-c022b9a5-a2d9-45b6-a93c-01bf1e832607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:21.367378 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1051/2092] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:21 2022] DELETE /identity/v3/projects/69d4b411928e4f71884efa37cdc7f401 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:21.371798 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb612d3-af7e-4749-bb06-e3b72d22dfb9 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:21.374849 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb612d3-af7e-4749-bb06-e3b72d22dfb9 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:21.375819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb612d3-af7e-4749-bb06-e3b72d22dfb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:21.406601 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-8eb612d3-af7e-4749-bb06-e3b72d22dfb9 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:21.409090 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-8eb612d3-af7e-4749-bb06-e3b72d22dfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:21.465244 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1042/2093] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:21.479950 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c40573-8bd1-4d5a-af2a-759f9d508297 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:21.481765 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-b1c40573-8bd1-4d5a-af2a-759f9d508297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:21.502361 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1052/2094] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:21.510738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fa873-033d-4b0d-afd3-bccb2588ea9f None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:21.511965 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fa873-033d-4b0d-afd3-bccb2588ea9f None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:21.512740 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fa873-033d-4b0d-afd3-bccb2588ea9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:21.561620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-9a9fa873-033d-4b0d-afd3-bccb2588ea9f None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:21.562903 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-9a9fa873-033d-4b0d-afd3-bccb2588ea9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:21.573281 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1053/2095] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:33:21.577205 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fa873-033d-4b0d-afd3-bccb2588ea9f None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:21.590677 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c40573-8bd1-4d5a-af2a-759f9d508297 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:21.598509 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228012a-1bef-4f39-8140-ead6bf204bcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:21.603156 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228012a-1bef-4f39-8140-ead6bf204bcb service nova] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:21.603156 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228012a-1bef-4f39-8140-ead6bf204bcb service nova] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:21.603156 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228012a-1bef-4f39-8140-ead6bf204bcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:21.605275 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fa873-033d-4b0d-afd3-bccb2588ea9f None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:21.607185 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-d228012a-1bef-4f39-8140-ead6bf204bcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:21.619205 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c90cf-d4cd-47a1-bd12-af918ba14b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:21.619914 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c90cf-d4cd-47a1-bd12-af918ba14b75 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:21.620195 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c90cf-d4cd-47a1-bd12-af918ba14b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:21.620470 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c90cf-d4cd-47a1-bd12-af918ba14b75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:21.621270 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c90cf-d4cd-47a1-bd12-af918ba14b75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:21.621520 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c90cf-d4cd-47a1-bd12-af918ba14b75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:21.623590 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c90cf-d4cd-47a1-bd12-af918ba14b75 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:21.630451 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228012a-1bef-4f39-8140-ead6bf204bcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:21.632065 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228012a-1bef-4f39-8140-ead6bf204bcb service nova] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:21.661481 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1054/2096] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:21.661674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1043/2097] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:33:21.675023 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c90cf-d4cd-47a1-bd12-af918ba14b75 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:21.695431 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c90cf-d4cd-47a1-bd12-af918ba14b75 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:21.713829 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48b26f-a494-4890-9eb6-ef575d38f3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:21.715161 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48b26f-a494-4890-9eb6-ef575d38f3d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:21.715565 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48b26f-a494-4890-9eb6-ef575d38f3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:21.715999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48b26f-a494-4890-9eb6-ef575d38f3d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:21.716857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc48b26f-a494-4890-9eb6-ef575d38f3d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:21.719031 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc48b26f-a494-4890-9eb6-ef575d38f3d1 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:21.780134 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228012a-1bef-4f39-8140-ead6bf204bcb service nova] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:21.790410 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1055/2098] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:33:21 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:21.800683 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228012a-1bef-4f39-8140-ead6bf204bcb service nova] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:21.887676 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:21.945685 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65556e-0242-4d96-a682-0e4419eb7508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:21.946401 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65556e-0242-4d96-a682-0e4419eb7508 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:21.946940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65556e-0242-4d96-a682-0e4419eb7508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:21.947248 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65556e-0242-4d96-a682-0e4419eb7508 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:21.947979 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65556e-0242-4d96-a682-0e4419eb7508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:21.950082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65556e-0242-4d96-a682-0e4419eb7508 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:21.975000 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1044/2099] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:33:21 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:21.976412 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48b26f-a494-4890-9eb6-ef575d38f3d1 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:21.990258 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48b26f-a494-4890-9eb6-ef575d38f3d1 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:21.996103 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a2013-eea3-4c35-baad-511fe1f67b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:21.996882 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a2013-eea3-4c35-baad-511fe1f67b3e admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:21.997243 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a2013-eea3-4c35-baad-511fe1f67b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:21.997605 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a2013-eea3-4c35-baad-511fe1f67b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:21.998580 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a2013-eea3-4c35-baad-511fe1f67b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:22.000317 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a2013-eea3-4c35-baad-511fe1f67b3e admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:22.020011 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1056/2100] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:22.024375 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65556e-0242-4d96-a682-0e4419eb7508 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:22.043372 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65556e-0242-4d96-a682-0e4419eb7508 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:22.048164 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c86c8-4fc2-45d7-a810-9aaaf4639fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:22.048947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c86c8-4fc2-45d7-a810-9aaaf4639fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:22.049343 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c86c8-4fc2-45d7-a810-9aaaf4639fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:22.049627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c86c8-4fc2-45d7-a810-9aaaf4639fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:22.050360 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c86c8-4fc2-45d7-a810-9aaaf4639fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:22.051998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c86c8-4fc2-45d7-a810-9aaaf4639fc2 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:22.062804 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1045/2101] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:33:22.067046 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a2013-eea3-4c35-baad-511fe1f67b3e admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:22.077525 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a2013-eea3-4c35-baad-511fe1f67b3e admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:22.082926 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f879c-2c13-4add-a49f-2a1ef170f787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:22.083873 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f879c-2c13-4add-a49f-2a1ef170f787 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:22.084153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f879c-2c13-4add-a49f-2a1ef170f787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:22.084428 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f879c-2c13-4add-a49f-2a1ef170f787 admin admin] PATH_INFO: `/v3/projects/0b37e5f4288e4fd9bda774c5d647527d/users/969b02a6397c4a1c89c891c3d22891e4/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:22.100663 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f879c-2c13-4add-a49f-2a1ef170f787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b37e5f4288e4fd9bda774c5d647527d, user_id=969b02a6397c4a1c89c891c3d22891e4, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:22.103324 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f879c-2c13-4add-a49f-2a1ef170f787 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:22.118988 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1057/2102] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:22 2022] PUT /identity/v3/projects/0b37e5f4288e4fd9bda774c5d647527d/users/969b02a6397c4a1c89c891c3d22891e4/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:33:22.131014 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f946c-708f-48f2-9ac6-6e3053ff0569 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:22.131306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f946c-708f-48f2-9ac6-6e3053ff0569 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:22.131589 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f946c-708f-48f2-9ac6-6e3053ff0569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:22.165258 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-af7f946c-708f-48f2-9ac6-6e3053ff0569 None None] MFA Rules not processed for user `969b02a6397c4a1c89c891c3d22891e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:22.166525 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-af7f946c-708f-48f2-9ac6-6e3053ff0569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:22.242977 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1046/2103] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:22.252255 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f879c-2c13-4add-a49f-2a1ef170f787 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:22.254639 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-236f879c-2c13-4add-a49f-2a1ef170f787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:22.320382 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f879c-2c13-4add-a49f-2a1ef170f787 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:22.324489 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b81378-fba3-482e-adf7-51e6026e316c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:22.325222 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b81378-fba3-482e-adf7-51e6026e316c service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:22.325714 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b81378-fba3-482e-adf7-51e6026e316c service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:22.326054 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b81378-fba3-482e-adf7-51e6026e316c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:22.335985 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:22.339371 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b81378-fba3-482e-adf7-51e6026e316c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:22.341360 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b81378-fba3-482e-adf7-51e6026e316c service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:22.355497 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1058/2104] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:23.665773 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f946c-708f-48f2-9ac6-6e3053ff0569 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:23.667232 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-af7f946c-708f-48f2-9ac6-6e3053ff0569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:23.752873 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f946c-708f-48f2-9ac6-6e3053ff0569 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:23.757520 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05611356-e416-4733-87b0-8be99f116826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:23.758409 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05611356-e416-4733-87b0-8be99f116826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:23.758696 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05611356-e416-4733-87b0-8be99f116826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:23.758976 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05611356-e416-4733-87b0-8be99f116826 admin admin] PATH_INFO: `/v3/users/443863fe856848c1bee029f3289bd721` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:23.760220 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05611356-e416-4733-87b0-8be99f116826 admin admin] RBAC: Authorizing `identity:delete_user(user_id=443863fe856848c1bee029f3289bd721)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:23.762188 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05611356-e416-4733-87b0-8be99f116826 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:23.804671 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:23.817381 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-05611356-e416-4733-87b0-8be99f116826 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '443863fe856848c1bee029f3289bd721'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:23.839349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-05611356-e416-4733-87b0-8be99f116826 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '443863fe856848c1bee029f3289bd721'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:23.848831 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-05611356-e416-4733-87b0-8be99f116826 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '443863fe856848c1bee029f3289bd721'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:23.849570 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-05611356-e416-4733-87b0-8be99f116826 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '443863fe856848c1bee029f3289bd721'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:23.850207 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-05611356-e416-4733-87b0-8be99f116826 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '443863fe856848c1bee029f3289bd721'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:23.868542 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1047/2105] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:23 2022] DELETE /identity/v3/users/443863fe856848c1bee029f3289bd721 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:23.874041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15b9fb-cbb9-4d69-aebc-2390d8827d19 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:23.874543 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15b9fb-cbb9-4d69-aebc-2390d8827d19 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:23.874820 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15b9fb-cbb9-4d69-aebc-2390d8827d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:23.904767 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-0d15b9fb-cbb9-4d69-aebc-2390d8827d19 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:23.906357 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-0d15b9fb-cbb9-4d69-aebc-2390d8827d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:23.980384 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1059/2106] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:23.992045 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05611356-e416-4733-87b0-8be99f116826 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:23.993708 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-05611356-e416-4733-87b0-8be99f116826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:24.066937 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05611356-e416-4733-87b0-8be99f116826 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:24.071378 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b0345-b67b-41cd-9e04-5b2ae86257e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:24.072143 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b0345-b67b-41cd-9e04-5b2ae86257e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:24.072459 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b0345-b67b-41cd-9e04-5b2ae86257e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:24.072712 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b0345-b67b-41cd-9e04-5b2ae86257e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:24.084589 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b0345-b67b-41cd-9e04-5b2ae86257e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:24.086676 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b0345-b67b-41cd-9e04-5b2ae86257e5 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:24.103598 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1048/2107] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:24.468023 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15b9fb-cbb9-4d69-aebc-2390d8827d19 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:24.469870 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-0d15b9fb-cbb9-4d69-aebc-2390d8827d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:24.482048 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15b9fb-cbb9-4d69-aebc-2390d8827d19 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:24.497945 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77977c27-88a4-4a52-b0af-93eb39b150e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:24.497945 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77977c27-88a4-4a52-b0af-93eb39b150e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:24.497945 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77977c27-88a4-4a52-b0af-93eb39b150e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:24.497945 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77977c27-88a4-4a52-b0af-93eb39b150e7 admin admin] PATH_INFO: `/v3/projects/dc2902363f9e4ecb82b78467d1da1c0b` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:24.498302 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77977c27-88a4-4a52-b0af-93eb39b150e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc2902363f9e4ecb82b78467d1da1c0b)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:24.498803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77977c27-88a4-4a52-b0af-93eb39b150e7 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:24.552213 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-77977c27-88a4-4a52-b0af-93eb39b150e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc2902363f9e4ecb82b78467d1da1c0b', 'request_id': 'req-77977c27-88a4-4a52-b0af-93eb39b150e7'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:24.559278 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-77977c27-88a4-4a52-b0af-93eb39b150e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc2902363f9e4ecb82b78467d1da1c0b', 'request_id': 'req-77977c27-88a4-4a52-b0af-93eb39b150e7'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:24.574342 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-77977c27-88a4-4a52-b0af-93eb39b150e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc2902363f9e4ecb82b78467d1da1c0b', 'request_id': 'req-77977c27-88a4-4a52-b0af-93eb39b150e7'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:24.592605 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-77977c27-88a4-4a52-b0af-93eb39b150e7 admin admin] The token cache is being invalidate because project dc2902363f9e4ecb82b78467d1da1c0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:24.593089 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-77977c27-88a4-4a52-b0af-93eb39b150e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:24.594085 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-77977c27-88a4-4a52-b0af-93eb39b150e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:24.596851 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1060/2108] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:24 2022] DELETE /identity/v3/projects/dc2902363f9e4ecb82b78467d1da1c0b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:24.602733 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b0345-b67b-41cd-9e04-5b2ae86257e5 service neutron] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:24.617668 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b0345-b67b-41cd-9e04-5b2ae86257e5 service neutron] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:24.687130 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67628a-f71a-4bfa-893c-6ccd5aa0c642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:24.688262 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67628a-f71a-4bfa-893c-6ccd5aa0c642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:24.688649 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67628a-f71a-4bfa-893c-6ccd5aa0c642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:24.689559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67628a-f71a-4bfa-893c-6ccd5aa0c642 admin admin] PATH_INFO: `/v3/users/65c376609ca545a699dbca85b3bc01d8` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:24.691328 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d67628a-f71a-4bfa-893c-6ccd5aa0c642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65c376609ca545a699dbca85b3bc01d8)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:24.693459 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d67628a-f71a-4bfa-893c-6ccd5aa0c642 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:24.771540 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-9d67628a-f71a-4bfa-893c-6ccd5aa0c642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65c376609ca545a699dbca85b3bc01d8'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:24.779591 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:24.786765 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-9d67628a-f71a-4bfa-893c-6ccd5aa0c642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65c376609ca545a699dbca85b3bc01d8'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:24.797867 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-9d67628a-f71a-4bfa-893c-6ccd5aa0c642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65c376609ca545a699dbca85b3bc01d8'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:24.799289 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-9d67628a-f71a-4bfa-893c-6ccd5aa0c642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65c376609ca545a699dbca85b3bc01d8'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:24.799909 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-9d67628a-f71a-4bfa-893c-6ccd5aa0c642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65c376609ca545a699dbca85b3bc01d8'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:24.813712 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1049/2109] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:24 2022] DELETE /identity/v3/users/65c376609ca545a699dbca85b3bc01d8 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:25.094408 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77977c27-88a4-4a52-b0af-93eb39b150e7 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:25.095998 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-77977c27-88a4-4a52-b0af-93eb39b150e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:25.109002 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77977c27-88a4-4a52-b0af-93eb39b150e7 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:25.169791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b64f66-0598-4bb1-b5c5-dd16ab2ad442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:25.170675 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b64f66-0598-4bb1-b5c5-dd16ab2ad442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:25.170957 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b64f66-0598-4bb1-b5c5-dd16ab2ad442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:25.171308 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b64f66-0598-4bb1-b5c5-dd16ab2ad442 admin admin] PATH_INFO: `/v3/projects/7e686e936a7142119bc50b474319e700` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:25.172521 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b64f66-0598-4bb1-b5c5-dd16ab2ad442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e686e936a7142119bc50b474319e700)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:25.175059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b64f66-0598-4bb1-b5c5-dd16ab2ad442 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:25.197162 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:25.225166 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-c2b64f66-0598-4bb1-b5c5-dd16ab2ad442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e686e936a7142119bc50b474319e700', 'request_id': 'req-c2b64f66-0598-4bb1-b5c5-dd16ab2ad442'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:25.234594 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-c2b64f66-0598-4bb1-b5c5-dd16ab2ad442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e686e936a7142119bc50b474319e700', 'request_id': 'req-c2b64f66-0598-4bb1-b5c5-dd16ab2ad442'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:25.240980 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-c2b64f66-0598-4bb1-b5c5-dd16ab2ad442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e686e936a7142119bc50b474319e700', 'request_id': 'req-c2b64f66-0598-4bb1-b5c5-dd16ab2ad442'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:25.252667 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-c2b64f66-0598-4bb1-b5c5-dd16ab2ad442 admin admin] The token cache is being invalidate because project 7e686e936a7142119bc50b474319e700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:25.253128 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-c2b64f66-0598-4bb1-b5c5-dd16ab2ad442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:25.254106 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-c2b64f66-0598-4bb1-b5c5-dd16ab2ad442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:25.256122 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1061/2110] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:25 2022] DELETE /identity/v3/projects/7e686e936a7142119bc50b474319e700 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:25.262997 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007575d7-18b6-4bee-b661-4806648929e2 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:25.263521 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007575d7-18b6-4bee-b661-4806648929e2 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:25.264098 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007575d7-18b6-4bee-b661-4806648929e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:25.287953 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-007575d7-18b6-4bee-b661-4806648929e2 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:25.289282 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-007575d7-18b6-4bee-b661-4806648929e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:25.370005 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1050/2111] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:33:25.378894 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3aa3ad-6723-475a-ad96-e029b850ec6a None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:25.379191 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3aa3ad-6723-475a-ad96-e029b850ec6a None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:25.379520 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3aa3ad-6723-475a-ad96-e029b850ec6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:25.408177 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-6d3aa3ad-6723-475a-ad96-e029b850ec6a None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:25.409773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-6d3aa3ad-6723-475a-ad96-e029b850ec6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:25.419326 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1062/2112] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:25.424791 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007575d7-18b6-4bee-b661-4806648929e2 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:25.437946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007575d7-18b6-4bee-b661-4806648929e2 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:25.445135 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7422419-455a-41e8-8dba-673fb7d3e938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:25.446305 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7422419-455a-41e8-8dba-673fb7d3e938 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:25.446814 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7422419-455a-41e8-8dba-673fb7d3e938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:25.447348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7422419-455a-41e8-8dba-673fb7d3e938 admin admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:25.448299 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7422419-455a-41e8-8dba-673fb7d3e938 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:25.449118 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7422419-455a-41e8-8dba-673fb7d3e938 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:25.451249 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7422419-455a-41e8-8dba-673fb7d3e938 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:25.466343 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1051/2113] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:25.471897 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3aa3ad-6723-475a-ad96-e029b850ec6a None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:25.500762 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3aa3ad-6723-475a-ad96-e029b850ec6a None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:25.511535 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393802c-5efc-4aa7-b26c-efb18248f128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:25.512331 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393802c-5efc-4aa7-b26c-efb18248f128 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:25.512704 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393802c-5efc-4aa7-b26c-efb18248f128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:25.513160 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393802c-5efc-4aa7-b26c-efb18248f128 admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:25.514082 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393802c-5efc-4aa7-b26c-efb18248f128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:25.516566 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393802c-5efc-4aa7-b26c-efb18248f128 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:25.571051 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1063/2114] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:33:25 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:25.572884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7422419-455a-41e8-8dba-673fb7d3e938 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:25.589007 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7422419-455a-41e8-8dba-673fb7d3e938 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:25.653758 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c14cdf-30e8-4c46-9764-aaaacee867f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:25.654452 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c14cdf-30e8-4c46-9764-aaaacee867f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:25.654772 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c14cdf-30e8-4c46-9764-aaaacee867f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:25.655048 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c14cdf-30e8-4c46-9764-aaaacee867f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:25.655815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c14cdf-30e8-4c46-9764-aaaacee867f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:25.658345 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c14cdf-30e8-4c46-9764-aaaacee867f8 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:25.668071 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393802c-5efc-4aa7-b26c-efb18248f128 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:25.670615 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-f393802c-5efc-4aa7-b26c-efb18248f128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:25.686300 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393802c-5efc-4aa7-b26c-efb18248f128 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:25.691827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1052/2115] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:33:25 2022] POST /identity/v3/users => generated 283 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:25.693787 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c14cdf-30e8-4c46-9764-aaaacee867f8 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:25.695649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd9750-02cc-417e-9b1d-9d6cedbebffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:25.696619 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd9750-02cc-417e-9b1d-9d6cedbebffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:25.696978 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd9750-02cc-417e-9b1d-9d6cedbebffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:25.697366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd9750-02cc-417e-9b1d-9d6cedbebffd admin admin] PATH_INFO: `/v3/users/969b02a6397c4a1c89c891c3d22891e4` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:25.698668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd9750-02cc-417e-9b1d-9d6cedbebffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=969b02a6397c4a1c89c891c3d22891e4)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:25.700788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd9750-02cc-417e-9b1d-9d6cedbebffd admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:25.705450 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c14cdf-30e8-4c46-9764-aaaacee867f8 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:25.712107 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d9666-218e-40d4-9601-7050ab0129d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:25.712790 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d9666-218e-40d4-9601-7050ab0129d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:25.713090 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d9666-218e-40d4-9601-7050ab0129d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:25.713344 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d9666-218e-40d4-9601-7050ab0129d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:25.714083 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d9666-218e-40d4-9601-7050ab0129d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:25.715719 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d9666-218e-40d4-9601-7050ab0129d8 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:25.727903 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1053/2116] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:25.731678 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d9666-218e-40d4-9601-7050ab0129d8 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:25.744690 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d9666-218e-40d4-9601-7050ab0129d8 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:25.750133 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c329144-ca58-4323-a4ea-2b274f74f01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:25.750904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c329144-ca58-4323-a4ea-2b274f74f01f admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:25.751305 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c329144-ca58-4323-a4ea-2b274f74f01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:25.751670 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c329144-ca58-4323-a4ea-2b274f74f01f admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:25.752528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c329144-ca58-4323-a4ea-2b274f74f01f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:25.754234 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c329144-ca58-4323-a4ea-2b274f74f01f admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:25.767951 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1054/2117] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:33:25.772212 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c329144-ca58-4323-a4ea-2b274f74f01f admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:25.778404 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-a7dd9750-02cc-417e-9b1d-9d6cedbebffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '969b02a6397c4a1c89c891c3d22891e4'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:25.789912 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c329144-ca58-4323-a4ea-2b274f74f01f admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:25.793203 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-a7dd9750-02cc-417e-9b1d-9d6cedbebffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '969b02a6397c4a1c89c891c3d22891e4'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:25.796617 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d4764-fb1e-44ea-a03d-66c516bb9a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:25.797659 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d4764-fb1e-44ea-a03d-66c516bb9a85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:25.798199 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d4764-fb1e-44ea-a03d-66c516bb9a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:25.798646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d4764-fb1e-44ea-a03d-66c516bb9a85 admin admin] PATH_INFO: `/v3/projects/963ced714dc94984be4fe0084d0372a4/users/3288f81d646d4a96a15d4c9a5aca254d/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:25.805957 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-a7dd9750-02cc-417e-9b1d-9d6cedbebffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '969b02a6397c4a1c89c891c3d22891e4'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:25.806729 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-a7dd9750-02cc-417e-9b1d-9d6cedbebffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '969b02a6397c4a1c89c891c3d22891e4'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:25.807409 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-a7dd9750-02cc-417e-9b1d-9d6cedbebffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '969b02a6397c4a1c89c891c3d22891e4'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:25.826137 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d4764-fb1e-44ea-a03d-66c516bb9a85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=963ced714dc94984be4fe0084d0372a4, user_id=3288f81d646d4a96a15d4c9a5aca254d, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:25.828881 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d4764-fb1e-44ea-a03d-66c516bb9a85 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:25.833744 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1064/2118] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:25 2022] DELETE /identity/v3/users/969b02a6397c4a1c89c891c3d22891e4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:33:25.838250 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a1a08-768d-4f8b-932d-9c62142d505e None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:25.838556 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a1a08-768d-4f8b-932d-9c62142d505e None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:25.838845 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a1a08-768d-4f8b-932d-9c62142d505e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:25.860661 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1055/2119] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:25 2022] PUT /identity/v3/projects/963ced714dc94984be4fe0084d0372a4/users/3288f81d646d4a96a15d4c9a5aca254d/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:25.873510 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac8421-ac18-448f-b4f8-00e0e3c94240 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:25.873852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac8421-ac18-448f-b4f8-00e0e3c94240 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:25.874080 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac8421-ac18-448f-b4f8-00e0e3c94240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:25.881782 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-091a1a08-768d-4f8b-932d-9c62142d505e None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:25.883260 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-091a1a08-768d-4f8b-932d-9c62142d505e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:25.883675 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:25.906173 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-42ac8421-ac18-448f-b4f8-00e0e3c94240 None None] MFA Rules not processed for user `3288f81d646d4a96a15d4c9a5aca254d`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:25.907422 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-42ac8421-ac18-448f-b4f8-00e0e3c94240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:25.943051 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:25.968553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1065/2120] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:33:25.975260 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a1a08-768d-4f8b-932d-9c62142d505e None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:25.976791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-091a1a08-768d-4f8b-932d-9c62142d505e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:25.984844 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1056/2121] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:25.989404 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac8421-ac18-448f-b4f8-00e0e3c94240 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:25.990769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-42ac8421-ac18-448f-b4f8-00e0e3c94240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:26.006497 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac8421-ac18-448f-b4f8-00e0e3c94240 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:26.011384 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9350312-dc83-443d-b5a4-eb1a274275b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:26.012052 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9350312-dc83-443d-b5a4-eb1a274275b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:26.012338 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9350312-dc83-443d-b5a4-eb1a274275b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:26.012754 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9350312-dc83-443d-b5a4-eb1a274275b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:26.013434 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9350312-dc83-443d-b5a4-eb1a274275b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:26.015757 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9350312-dc83-443d-b5a4-eb1a274275b8 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:26.047748 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a1a08-768d-4f8b-932d-9c62142d505e None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:26.050467 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1057/2122] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:33:25 2022] POST /identity/v3/projects => generated 367 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:26.051372 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2c466-6a35-40aa-8f01-b9567fadecc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:26.052025 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2c466-6a35-40aa-8f01-b9567fadecc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:26.052319 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2c466-6a35-40aa-8f01-b9567fadecc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:26.052600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2c466-6a35-40aa-8f01-b9567fadecc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:26.054412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9350312-dc83-443d-b5a4-eb1a274275b8 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:26.062899 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2c466-6a35-40aa-8f01-b9567fadecc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:26.064998 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2c466-6a35-40aa-8f01-b9567fadecc2 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:26.075150 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1066/2123] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:26.117277 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9350312-dc83-443d-b5a4-eb1a274275b8 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:26.122290 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c182670-340c-4819-9f47-93cf3476562e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:26.123148 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c182670-340c-4819-9f47-93cf3476562e admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:26.123468 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c182670-340c-4819-9f47-93cf3476562e admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:26.123750 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c182670-340c-4819-9f47-93cf3476562e admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:26.124451 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c182670-340c-4819-9f47-93cf3476562e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:26.126902 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c182670-340c-4819-9f47-93cf3476562e admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:26.150809 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1058/2124] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:33:26 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:33:26.152258 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2c466-6a35-40aa-8f01-b9567fadecc2 service neutron] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:26.162617 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2c466-6a35-40aa-8f01-b9567fadecc2 service neutron] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:26.167452 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37badaad-0110-4b52-af05-c0b4f7b066c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:26.168112 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37badaad-0110-4b52-af05-c0b4f7b066c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:26.168399 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37badaad-0110-4b52-af05-c0b4f7b066c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:26.168678 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37badaad-0110-4b52-af05-c0b4f7b066c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:26.169413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37badaad-0110-4b52-af05-c0b4f7b066c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:26.171016 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37badaad-0110-4b52-af05-c0b4f7b066c0 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:26.181861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1067/2125] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:26.186339 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c182670-340c-4819-9f47-93cf3476562e admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:26.197769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c182670-340c-4819-9f47-93cf3476562e admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:26.202736 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcf969-db81-4bc9-97df-e5b72386f54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:26.203727 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcf969-db81-4bc9-97df-e5b72386f54f admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:26.203997 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcf969-db81-4bc9-97df-e5b72386f54f admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:26.204304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcf969-db81-4bc9-97df-e5b72386f54f admin admin] PATH_INFO: `/v3/projects/cd466ad27e344bc69138e0c89e5822db/users/0a4398b4e92e4f7cbe4966d2ff6cc8e1/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:26.230213 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcf969-db81-4bc9-97df-e5b72386f54f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd466ad27e344bc69138e0c89e5822db, user_id=0a4398b4e92e4f7cbe4966d2ff6cc8e1, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:26.233901 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcf969-db81-4bc9-97df-e5b72386f54f admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:26.248181 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1059/2126] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:26 2022] PUT /identity/v3/projects/cd466ad27e344bc69138e0c89e5822db/users/0a4398b4e92e4f7cbe4966d2ff6cc8e1/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:26.253243 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37badaad-0110-4b52-af05-c0b4f7b066c0 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:26.266108 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37badaad-0110-4b52-af05-c0b4f7b066c0 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:26.330998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcf969-db81-4bc9-97df-e5b72386f54f admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:26.333422 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-21dcf969-db81-4bc9-97df-e5b72386f54f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:26.351496 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02db33-d58b-46f8-8b92-7c4b2d4b34b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:26.352209 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02db33-d58b-46f8-8b92-7c4b2d4b34b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:26.352845 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02db33-d58b-46f8-8b92-7c4b2d4b34b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:26.352998 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02db33-d58b-46f8-8b92-7c4b2d4b34b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:26.354112 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e02db33-d58b-46f8-8b92-7c4b2d4b34b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:26.356204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e02db33-d58b-46f8-8b92-7c4b2d4b34b6 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:26.371425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1068/2127] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:26.376098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02db33-d58b-46f8-8b92-7c4b2d4b34b6 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:26.403336 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02db33-d58b-46f8-8b92-7c4b2d4b34b6 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:26.410065 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1a245-8d58-409c-88b4-c69bd1b1fdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:26.411375 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1a245-8d58-409c-88b4-c69bd1b1fdae admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:26.411746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1a245-8d58-409c-88b4-c69bd1b1fdae admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:26.412218 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:26.412340 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1a245-8d58-409c-88b4-c69bd1b1fdae admin admin] PATH_INFO: `/v3/projects/cd466ad27e344bc69138e0c89e5822db/users/0a4398b4e92e4f7cbe4966d2ff6cc8e1/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:26.415487 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1a245-8d58-409c-88b4-c69bd1b1fdae admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd466ad27e344bc69138e0c89e5822db, user_id=0a4398b4e92e4f7cbe4966d2ff6cc8e1, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:26.420490 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1a245-8d58-409c-88b4-c69bd1b1fdae admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:26.439682 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1069/2128] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:26 2022] PUT /identity/v3/projects/cd466ad27e344bc69138e0c89e5822db/users/0a4398b4e92e4f7cbe4966d2ff6cc8e1/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:26.451429 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ef2a7-4abe-4aa5-bd6c-64a65fdc930d None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:26.451730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ef2a7-4abe-4aa5-bd6c-64a65fdc930d None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:26.452019 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ef2a7-4abe-4aa5-bd6c-64a65fdc930d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:26.455215 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcf969-db81-4bc9-97df-e5b72386f54f admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:26.490789 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-d71ef2a7-4abe-4aa5-bd6c-64a65fdc930d None None] MFA Rules not processed for user `0a4398b4e92e4f7cbe4966d2ff6cc8e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:26.495071 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-d71ef2a7-4abe-4aa5-bd6c-64a65fdc930d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:26.595081 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b62fe-6feb-46ce-bd18-2500d09d106b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:26.596167 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b62fe-6feb-46ce-bd18-2500d09d106b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:26.596680 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b62fe-6feb-46ce-bd18-2500d09d106b admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:26.597081 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b62fe-6feb-46ce-bd18-2500d09d106b admin admin] PATH_INFO: `/v3/users/52c44d81a15143fba880c2ce5f41b635` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:26.603391 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b62fe-6feb-46ce-bd18-2500d09d106b admin admin] RBAC: Authorizing `identity:delete_user(user_id=52c44d81a15143fba880c2ce5f41b635)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:26.609529 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b62fe-6feb-46ce-bd18-2500d09d106b admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:26.610204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:26.634842 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1070/2129] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:26 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:33:26.648028 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ef2a7-4abe-4aa5-bd6c-64a65fdc930d None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:26.650648 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-d71ef2a7-4abe-4aa5-bd6c-64a65fdc930d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:26.748120 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0a2b62fe-6feb-46ce-bd18-2500d09d106b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52c44d81a15143fba880c2ce5f41b635'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:26.784762 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0a2b62fe-6feb-46ce-bd18-2500d09d106b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52c44d81a15143fba880c2ce5f41b635'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:26.787967 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ef2a7-4abe-4aa5-bd6c-64a65fdc930d None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:26.804978 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017f251-4174-4f0f-aa52-0fe3dc5406bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:26.805651 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017f251-4174-4f0f-aa52-0fe3dc5406bd service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:26.805940 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017f251-4174-4f0f-aa52-0fe3dc5406bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:26.807102 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017f251-4174-4f0f-aa52-0fe3dc5406bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:26.808458 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0a2b62fe-6feb-46ce-bd18-2500d09d106b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52c44d81a15143fba880c2ce5f41b635'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:26.809440 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0a2b62fe-6feb-46ce-bd18-2500d09d106b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52c44d81a15143fba880c2ce5f41b635'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:26.811118 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0a2b62fe-6feb-46ce-bd18-2500d09d106b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52c44d81a15143fba880c2ce5f41b635'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:26.830236 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017f251-4174-4f0f-aa52-0fe3dc5406bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:26.832582 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017f251-4174-4f0f-aa52-0fe3dc5406bd service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:26.846391 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1060/2130] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:26 2022] DELETE /identity/v3/users/52c44d81a15143fba880c2ce5f41b635 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:33:26.847518 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b62fe-6feb-46ce-bd18-2500d09d106b admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:26.849372 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-0a2b62fe-6feb-46ce-bd18-2500d09d106b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:26.862357 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1071/2131] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:26 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:33:26.865494 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7d778-29f9-4108-a5b2-81e04c8cfc32 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:26.865788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7d778-29f9-4108-a5b2-81e04c8cfc32 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:26.866073 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7d778-29f9-4108-a5b2-81e04c8cfc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:26.894887 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-49d7d778-29f9-4108-a5b2-81e04c8cfc32 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:26.898946 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-49d7d778-29f9-4108-a5b2-81e04c8cfc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:27.009750 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b62fe-6feb-46ce-bd18-2500d09d106b admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:27.016727 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c42992-a730-4973-a73a-2760b53f6bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:27.018690 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c42992-a730-4973-a73a-2760b53f6bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:27.019199 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c42992-a730-4973-a73a-2760b53f6bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:27.019844 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c42992-a730-4973-a73a-2760b53f6bfb admin admin] PATH_INFO: `/v3/projects/0b37e5f4288e4fd9bda774c5d647527d` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:27.021624 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c42992-a730-4973-a73a-2760b53f6bfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b37e5f4288e4fd9bda774c5d647527d)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:27.027009 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c42992-a730-4973-a73a-2760b53f6bfb admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:27.036558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:27.039038 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1072/2132] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:27.044723 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7d778-29f9-4108-a5b2-81e04c8cfc32 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:27.046528 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-49d7d778-29f9-4108-a5b2-81e04c8cfc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:27.120305 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-62c42992-a730-4973-a73a-2760b53f6bfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b37e5f4288e4fd9bda774c5d647527d', 'request_id': 'req-62c42992-a730-4973-a73a-2760b53f6bfb'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:27.143041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7d778-29f9-4108-a5b2-81e04c8cfc32 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:27.144808 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-62c42992-a730-4973-a73a-2760b53f6bfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b37e5f4288e4fd9bda774c5d647527d', 'request_id': 'req-62c42992-a730-4973-a73a-2760b53f6bfb'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:27.164570 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-62c42992-a730-4973-a73a-2760b53f6bfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b37e5f4288e4fd9bda774c5d647527d', 'request_id': 'req-62c42992-a730-4973-a73a-2760b53f6bfb'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:27.189303 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-62c42992-a730-4973-a73a-2760b53f6bfb admin admin] The token cache is being invalidate because project 0b37e5f4288e4fd9bda774c5d647527d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:27.190041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-62c42992-a730-4973-a73a-2760b53f6bfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:27.192588 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-62c42992-a730-4973-a73a-2760b53f6bfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:27.195898 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1061/2133] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:26 2022] DELETE /identity/v3/projects/0b37e5f4288e4fd9bda774c5d647527d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:27.196808 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c42992-a730-4973-a73a-2760b53f6bfb admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:27.198194 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-62c42992-a730-4973-a73a-2760b53f6bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:27.278580 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d376623-f916-49be-8d59-7e09c5e008b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:27.279537 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d376623-f916-49be-8d59-7e09c5e008b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:27.279863 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d376623-f916-49be-8d59-7e09c5e008b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:27.280245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d376623-f916-49be-8d59-7e09c5e008b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:27.284034 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-1d376623-f916-49be-8d59-7e09c5e008b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:27.295090 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:27.335629 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c42992-a730-4973-a73a-2760b53f6bfb admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:27.351463 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58032152-baf2-48e0-aac3-126ac968823b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:27.351700 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58032152-baf2-48e0-aac3-126ac968823b service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:27.351975 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58032152-baf2-48e0-aac3-126ac968823b service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:27.352153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58032152-baf2-48e0-aac3-126ac968823b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:27.359846 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-58032152-baf2-48e0-aac3-126ac968823b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:27.394522 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d376623-f916-49be-8d59-7e09c5e008b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:27.397812 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d376623-f916-49be-8d59-7e09c5e008b1 service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:27.413376 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1073/2134] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:27 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:27.415994 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67489b4b-3927-410d-916b-930e92354fb3 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:27.416478 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67489b4b-3927-410d-916b-930e92354fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:27.417559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67489b4b-3927-410d-916b-930e92354fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:27.450566 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-67489b4b-3927-410d-916b-930e92354fb3 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:27.452402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-67489b4b-3927-410d-916b-930e92354fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:27.467140 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1074/2135] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:27.470174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58032152-baf2-48e0-aac3-126ac968823b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:27.472939 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58032152-baf2-48e0-aac3-126ac968823b service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:27.477975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db91fb5-694d-41b9-84de-955367fd2603 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:27.479003 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db91fb5-694d-41b9-84de-955367fd2603 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:27.479326 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db91fb5-694d-41b9-84de-955367fd2603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:27.502127 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1062/2136] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:27.511811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-0db91fb5-694d-41b9-84de-955367fd2603 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:27.513414 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-0db91fb5-694d-41b9-84de-955367fd2603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:27.539265 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1075/2137] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:27.543543 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58032152-baf2-48e0-aac3-126ac968823b service neutron] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:27.558196 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58032152-baf2-48e0-aac3-126ac968823b service neutron] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:27.566668 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16076e55-72cd-4c29-bea5-aa5c8e62923e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:27.567770 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16076e55-72cd-4c29-bea5-aa5c8e62923e admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:27.568132 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16076e55-72cd-4c29-bea5-aa5c8e62923e admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:27.568488 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16076e55-72cd-4c29-bea5-aa5c8e62923e admin admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:27.569319 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16076e55-72cd-4c29-bea5-aa5c8e62923e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:27.569711 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16076e55-72cd-4c29-bea5-aa5c8e62923e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:27.571664 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16076e55-72cd-4c29-bea5-aa5c8e62923e admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:27.602446 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db91fb5-694d-41b9-84de-955367fd2603 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:27.609966 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1063/2138] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:27.620509 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db91fb5-694d-41b9-84de-955367fd2603 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:27.631789 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19175706-a8c8-4ddd-ba25-1ca6c1092a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:27.632710 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19175706-a8c8-4ddd-ba25-1ca6c1092a46 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:27.633243 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19175706-a8c8-4ddd-ba25-1ca6c1092a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:27.633793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19175706-a8c8-4ddd-ba25-1ca6c1092a46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:27.634516 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19175706-a8c8-4ddd-ba25-1ca6c1092a46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:27.636719 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19175706-a8c8-4ddd-ba25-1ca6c1092a46 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:27.687128 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16076e55-72cd-4c29-bea5-aa5c8e62923e admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:27.714107 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1076/2139] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:33:27 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:27.714227 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16076e55-72cd-4c29-bea5-aa5c8e62923e admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:27.802817 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:27.839729 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba0cf5-70ac-4f73-a529-08ec8b83d71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:27.840382 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba0cf5-70ac-4f73-a529-08ec8b83d71f admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:27.841055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba0cf5-70ac-4f73-a529-08ec8b83d71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:27.841240 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba0cf5-70ac-4f73-a529-08ec8b83d71f admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:27.842816 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba0cf5-70ac-4f73-a529-08ec8b83d71f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:27.844507 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba0cf5-70ac-4f73-a529-08ec8b83d71f admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:27.890859 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19175706-a8c8-4ddd-ba25-1ca6c1092a46 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:27.891599 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1064/2140] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:33:27 2022] POST /identity/v3/users => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:27.906043 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19175706-a8c8-4ddd-ba25-1ca6c1092a46 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:27.915839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5381b54-3c0b-46e7-8b2f-738497cb4e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:27.916640 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5381b54-3c0b-46e7-8b2f-738497cb4e97 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:27.917109 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5381b54-3c0b-46e7-8b2f-738497cb4e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:27.917486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5381b54-3c0b-46e7-8b2f-738497cb4e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:27.918350 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5381b54-3c0b-46e7-8b2f-738497cb4e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:27.920835 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5381b54-3c0b-46e7-8b2f-738497cb4e97 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:27.942310 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba0cf5-70ac-4f73-a529-08ec8b83d71f admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:27.947516 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1077/2141] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:27.954947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba0cf5-70ac-4f73-a529-08ec8b83d71f admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:27.966750 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4bfb7-44e3-44ce-9866-932d67f05733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:27.968098 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4bfb7-44e3-44ce-9866-932d67f05733 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:27.968447 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4bfb7-44e3-44ce-9866-932d67f05733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:27.968821 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4bfb7-44e3-44ce-9866-932d67f05733 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:27.969996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4bfb7-44e3-44ce-9866-932d67f05733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:27.971904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4bfb7-44e3-44ce-9866-932d67f05733 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:27.991728 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5381b54-3c0b-46e7-8b2f-738497cb4e97 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:27.992168 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1065/2142] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:28.008266 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5381b54-3c0b-46e7-8b2f-738497cb4e97 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:28.019425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d4f56-371f-41c3-85bc-20085e0bd02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:28.021515 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d4f56-371f-41c3-85bc-20085e0bd02f admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:28.023295 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d4f56-371f-41c3-85bc-20085e0bd02f admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:28.023749 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d4f56-371f-41c3-85bc-20085e0bd02f admin admin] PATH_INFO: `/v3/projects/137bf595980144d683ce2cd57e6a4dc4/users/4d290f995a124f0da90c2ccde640bbc7/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:28.058712 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d4f56-371f-41c3-85bc-20085e0bd02f admin admin] RBAC: Authorizing `identity:create_grant(project_id=137bf595980144d683ce2cd57e6a4dc4, user_id=4d290f995a124f0da90c2ccde640bbc7, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:28.065005 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d4f56-371f-41c3-85bc-20085e0bd02f admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:28.118189 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1078/2143] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:27 2022] PUT /identity/v3/projects/137bf595980144d683ce2cd57e6a4dc4/users/4d290f995a124f0da90c2ccde640bbc7/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:33:28.129855 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850ea27-ca09-4b33-b5c9-bf74fb7028b6 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:28.130202 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850ea27-ca09-4b33-b5c9-bf74fb7028b6 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:28.131092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850ea27-ca09-4b33-b5c9-bf74fb7028b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:28.211392 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-4850ea27-ca09-4b33-b5c9-bf74fb7028b6 None None] MFA Rules not processed for user `4d290f995a124f0da90c2ccde640bbc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:28.212658 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-4850ea27-ca09-4b33-b5c9-bf74fb7028b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:28.276346 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d4f56-371f-41c3-85bc-20085e0bd02f admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:28.279382 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-776d4f56-371f-41c3-85bc-20085e0bd02f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:28.340331 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1066/2144] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:28.350627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850ea27-ca09-4b33-b5c9-bf74fb7028b6 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:28.418237 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d4f56-371f-41c3-85bc-20085e0bd02f admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:28.432551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9740f2-7880-478f-86d2-34c3861df172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:28.433578 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9740f2-7880-478f-86d2-34c3861df172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:28.433932 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9740f2-7880-478f-86d2-34c3861df172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:28.434225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9740f2-7880-478f-86d2-34c3861df172 admin admin] PATH_INFO: `/v3/users/55e87c7d57284316b7540352d6c56e39` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:28.438081 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9740f2-7880-478f-86d2-34c3861df172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55e87c7d57284316b7540352d6c56e39)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:28.442707 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9740f2-7880-478f-86d2-34c3861df172 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:28.521656 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:28.533750 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850ea27-ca09-4b33-b5c9-bf74fb7028b6 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:28.538275 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-4d9740f2-7880-478f-86d2-34c3861df172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55e87c7d57284316b7540352d6c56e39'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:28.545159 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21dd09-e916-4a69-ba39-ec432fdc08a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:28.545985 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21dd09-e916-4a69-ba39-ec432fdc08a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:28.546633 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21dd09-e916-4a69-ba39-ec432fdc08a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:28.547108 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21dd09-e916-4a69-ba39-ec432fdc08a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:28.549680 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d21dd09-e916-4a69-ba39-ec432fdc08a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:28.555921 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d21dd09-e916-4a69-ba39-ec432fdc08a0 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:28.558601 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-4d9740f2-7880-478f-86d2-34c3861df172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55e87c7d57284316b7540352d6c56e39'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:28.577534 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-4d9740f2-7880-478f-86d2-34c3861df172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55e87c7d57284316b7540352d6c56e39'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:28.578954 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-4d9740f2-7880-478f-86d2-34c3861df172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55e87c7d57284316b7540352d6c56e39'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:28.580305 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-4d9740f2-7880-478f-86d2-34c3861df172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55e87c7d57284316b7540352d6c56e39'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:28.621480 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1079/2145] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:28 2022] DELETE /identity/v3/users/55e87c7d57284316b7540352d6c56e39 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:28.621480 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9740f2-7880-478f-86d2-34c3861df172 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:28.622706 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-4d9740f2-7880-478f-86d2-34c3861df172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:28.637798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1067/2146] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:33:28 2022] POST /identity/v3/projects => generated 377 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:28.642895 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc0e17-ef3f-4117-91e0-8bc4f34ee54a None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:28.643193 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc0e17-ef3f-4117-91e0-8bc4f34ee54a None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:28.643505 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc0e17-ef3f-4117-91e0-8bc4f34ee54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:28.665964 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-78bc0e17-ef3f-4117-91e0-8bc4f34ee54a None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:28.667208 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-78bc0e17-ef3f-4117-91e0-8bc4f34ee54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:28.688742 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:28.729947 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9740f2-7880-478f-86d2-34c3861df172 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:28.787712 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1068/2147] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:28.788832 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc0e17-ef3f-4117-91e0-8bc4f34ee54a None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:28.792830 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-78bc0e17-ef3f-4117-91e0-8bc4f34ee54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:28.825214 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc0e17-ef3f-4117-91e0-8bc4f34ee54a None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:28.842085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7164f2-037a-48c7-a3aa-a5543a5c7f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:28.843536 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7164f2-037a-48c7-a3aa-a5543a5c7f7e admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:28.844040 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7164f2-037a-48c7-a3aa-a5543a5c7f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:28.844518 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7164f2-037a-48c7-a3aa-a5543a5c7f7e admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:28.845631 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7164f2-037a-48c7-a3aa-a5543a5c7f7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:28.852078 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7164f2-037a-48c7-a3aa-a5543a5c7f7e admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:28.894850 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdec237-8acf-4513-94d5-8a331cbd33e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:28.895893 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdec237-8acf-4513-94d5-8a331cbd33e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:28.896239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdec237-8acf-4513-94d5-8a331cbd33e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:28.896679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdec237-8acf-4513-94d5-8a331cbd33e4 admin admin] PATH_INFO: `/v3/projects/cf04a5f4ff514ac183745c49146d5b16` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:28.898759 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdec237-8acf-4513-94d5-8a331cbd33e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf04a5f4ff514ac183745c49146d5b16)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:28.901600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdec237-8acf-4513-94d5-8a331cbd33e4 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:28.913715 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1069/2148] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:33:28 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:28.915494 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7164f2-037a-48c7-a3aa-a5543a5c7f7e admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:28.919454 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-3c7164f2-037a-48c7-a3aa-a5543a5c7f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:29.018210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-3bdec237-8acf-4513-94d5-8a331cbd33e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf04a5f4ff514ac183745c49146d5b16', 'request_id': 'req-3bdec237-8acf-4513-94d5-8a331cbd33e4'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:29.029424 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-3bdec237-8acf-4513-94d5-8a331cbd33e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf04a5f4ff514ac183745c49146d5b16', 'request_id': 'req-3bdec237-8acf-4513-94d5-8a331cbd33e4'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:29.029655 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7164f2-037a-48c7-a3aa-a5543a5c7f7e admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:29.041646 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-3bdec237-8acf-4513-94d5-8a331cbd33e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf04a5f4ff514ac183745c49146d5b16', 'request_id': 'req-3bdec237-8acf-4513-94d5-8a331cbd33e4'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:29.044720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:29.057140 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-3bdec237-8acf-4513-94d5-8a331cbd33e4 admin admin] The token cache is being invalidate because project cf04a5f4ff514ac183745c49146d5b16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:29.057974 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-3bdec237-8acf-4513-94d5-8a331cbd33e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:29.059262 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-3bdec237-8acf-4513-94d5-8a331cbd33e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:29.061422 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1080/2149] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:28 2022] DELETE /identity/v3/projects/cf04a5f4ff514ac183745c49146d5b16 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:29.064377 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdec237-8acf-4513-94d5-8a331cbd33e4 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:29.066788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-3bdec237-8acf-4513-94d5-8a331cbd33e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:29.101526 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4ea32-dcd1-467a-9126-a6f076854759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:29.102259 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4ea32-dcd1-467a-9126-a6f076854759 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:29.102578 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4ea32-dcd1-467a-9126-a6f076854759 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:29.102904 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4ea32-dcd1-467a-9126-a6f076854759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:29.105407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-31e4ea32-dcd1-467a-9126-a6f076854759 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:29.151445 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdec237-8acf-4513-94d5-8a331cbd33e4 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:29.156569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cba988-be21-47a0-95ec-66a3683148a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:29.157244 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cba988-be21-47a0-95ec-66a3683148a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:29.158098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cba988-be21-47a0-95ec-66a3683148a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:29.158382 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cba988-be21-47a0-95ec-66a3683148a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:29.159124 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cba988-be21-47a0-95ec-66a3683148a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:29.161164 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cba988-be21-47a0-95ec-66a3683148a9 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:29.175034 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1081/2150] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:29.176555 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d1bf9-3317-4f6b-b6c4-86ef777e1d6a None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:29.176719 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d1bf9-3317-4f6b-b6c4-86ef777e1d6a None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:29.177003 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d1bf9-3317-4f6b-b6c4-86ef777e1d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:29.198058 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-fc5d1bf9-3317-4f6b-b6c4-86ef777e1d6a None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:29.199411 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-fc5d1bf9-3317-4f6b-b6c4-86ef777e1d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:29.208486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1082/2151] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:29.209523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d1bf9-3317-4f6b-b6c4-86ef777e1d6a None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:29.217749 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e4ea32-dcd1-467a-9126-a6f076854759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:29.219390 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e4ea32-dcd1-467a-9126-a6f076854759 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:29.227911 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d1bf9-3317-4f6b-b6c4-86ef777e1d6a None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:29.241988 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1070/2152] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:29.242225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3267b17-2015-4ac2-b6bc-11654e69614c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:29.242225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3267b17-2015-4ac2-b6bc-11654e69614c admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:29.242419 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6d8a9-1210-4bb0-9b0b-ea52050a4374 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:29.242512 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3267b17-2015-4ac2-b6bc-11654e69614c admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:29.242612 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6d8a9-1210-4bb0-9b0b-ea52050a4374 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:29.242697 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3267b17-2015-4ac2-b6bc-11654e69614c admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:29.242778 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6d8a9-1210-4bb0-9b0b-ea52050a4374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:29.242867 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3267b17-2015-4ac2-b6bc-11654e69614c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:29.242867 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3267b17-2015-4ac2-b6bc-11654e69614c admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:29.250444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1083/2153] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:29.255300 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3267b17-2015-4ac2-b6bc-11654e69614c admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:29.273350 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3267b17-2015-4ac2-b6bc-11654e69614c admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:29.274046 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-56c6d8a9-1210-4bb0-9b0b-ea52050a4374 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:29.276300 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-56c6d8a9-1210-4bb0-9b0b-ea52050a4374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:29.280792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d6886-0c77-4a33-934f-2aa1cab786e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:29.281699 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d6886-0c77-4a33-934f-2aa1cab786e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:29.281981 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d6886-0c77-4a33-934f-2aa1cab786e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:29.282259 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d6886-0c77-4a33-934f-2aa1cab786e4 admin admin] PATH_INFO: `/v3/projects/a1de8af33d1a42a79334fe74aae8fa5f/users/2026c98c1eea41eea3c6608c4f13859a/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:29.290209 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1071/2154] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:29.291888 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6d8a9-1210-4bb0-9b0b-ea52050a4374 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:29.301704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6d8a9-1210-4bb0-9b0b-ea52050a4374 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:29.304346 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d6886-0c77-4a33-934f-2aa1cab786e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1de8af33d1a42a79334fe74aae8fa5f, user_id=2026c98c1eea41eea3c6608c4f13859a, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:29.306698 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d86f21-9cf3-4a59-9e82-3d7bb883cf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:29.307521 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d6886-0c77-4a33-934f-2aa1cab786e4 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:29.310374 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d86f21-9cf3-4a59-9e82-3d7bb883cf40 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:29.310747 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d86f21-9cf3-4a59-9e82-3d7bb883cf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:29.311096 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d86f21-9cf3-4a59-9e82-3d7bb883cf40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:29.311998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d86f21-9cf3-4a59-9e82-3d7bb883cf40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:29.312376 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d86f21-9cf3-4a59-9e82-3d7bb883cf40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:29.314513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d86f21-9cf3-4a59-9e82-3d7bb883cf40 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:29.316606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:29.333550 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1072/2156] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:29.343881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1084/2156] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:29 2022] PUT /identity/v3/projects/a1de8af33d1a42a79334fe74aae8fa5f/users/2026c98c1eea41eea3c6608c4f13859a/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:29.346218 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d6886-0c77-4a33-934f-2aa1cab786e4 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:29.346547 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a83de4-b80f-46d4-ad38-4649eb0fd9a4 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:29.346863 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a83de4-b80f-46d4-ad38-4649eb0fd9a4 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:29.347203 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a83de4-b80f-46d4-ad38-4649eb0fd9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:29.383040 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-72a83de4-b80f-46d4-ad38-4649eb0fd9a4 None None] MFA Rules not processed for user `2026c98c1eea41eea3c6608c4f13859a`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:29.384798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-72a83de4-b80f-46d4-ad38-4649eb0fd9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:29.435553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d6886-0c77-4a33-934f-2aa1cab786e4 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:29.441212 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25550f-f2bc-4db0-a5ba-4905467b4044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:29.442502 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25550f-f2bc-4db0-a5ba-4905467b4044 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:29.442946 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25550f-f2bc-4db0-a5ba-4905467b4044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:29.443505 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25550f-f2bc-4db0-a5ba-4905467b4044 admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:29.444461 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25550f-f2bc-4db0-a5ba-4905467b4044 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:29.446646 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25550f-f2bc-4db0-a5ba-4905467b4044 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:29.491849 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1085/2157] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:33:29 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:29.500751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25550f-f2bc-4db0-a5ba-4905467b4044 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:29.502827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1073/2158] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:29.509460 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a83de4-b80f-46d4-ad38-4649eb0fd9a4 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:29.527662 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a83de4-b80f-46d4-ad38-4649eb0fd9a4 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:29.568553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:29.632641 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737628fc-37bf-4235-ae25-3dd10ca858f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:29.633541 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737628fc-37bf-4235-ae25-3dd10ca858f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:29.633858 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737628fc-37bf-4235-ae25-3dd10ca858f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:29.636874 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25550f-f2bc-4db0-a5ba-4905467b4044 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:29.637768 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737628fc-37bf-4235-ae25-3dd10ca858f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:29.640177 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737628fc-37bf-4235-ae25-3dd10ca858f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:29.641329 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737628fc-37bf-4235-ae25-3dd10ca858f0 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:29.650849 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ff035-db0d-492f-99ed-a50cb2924c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:29.652112 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ff035-db0d-492f-99ed-a50cb2924c05 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:29.652112 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ff035-db0d-492f-99ed-a50cb2924c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:29.652405 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ff035-db0d-492f-99ed-a50cb2924c05 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:29.653489 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ff035-db0d-492f-99ed-a50cb2924c05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:29.660215 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ff035-db0d-492f-99ed-a50cb2924c05 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:29.708936 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1086/2159] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:33:29 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:29.716871 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1074/2160] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:33:29 2022] POST /identity/v3/projects => generated 375 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:29.720116 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737628fc-37bf-4235-ae25-3dd10ca858f0 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:29.720413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ff035-db0d-492f-99ed-a50cb2924c05 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:29.744489 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ff035-db0d-492f-99ed-a50cb2924c05 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:29.865600 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737628fc-37bf-4235-ae25-3dd10ca858f0 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:29.872616 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ae413-ebec-4d39-9361-8cda82ff4975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:29.873346 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ae413-ebec-4d39-9361-8cda82ff4975 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:29.873637 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ae413-ebec-4d39-9361-8cda82ff4975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:29.873949 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ae413-ebec-4d39-9361-8cda82ff4975 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:29.874887 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ae413-ebec-4d39-9361-8cda82ff4975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:29.877302 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ae413-ebec-4d39-9361-8cda82ff4975 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:29.895308 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1075/2161] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:29.896844 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ae413-ebec-4d39-9361-8cda82ff4975 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:29.899620 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-a88ae413-ebec-4d39-9361-8cda82ff4975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:29.903662 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b5f46-beba-410a-8e42-19e3d6bd0e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:29.904636 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b5f46-beba-410a-8e42-19e3d6bd0e95 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:29.905064 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b5f46-beba-410a-8e42-19e3d6bd0e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:29.905501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b5f46-beba-410a-8e42-19e3d6bd0e95 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:29.906415 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b5f46-beba-410a-8e42-19e3d6bd0e95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:29.909582 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b5f46-beba-410a-8e42-19e3d6bd0e95 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:29.915604 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:29.921495 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ae413-ebec-4d39-9361-8cda82ff4975 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:29.933056 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77273b3-d217-41bb-8948-bf8ef7505fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:29.935555 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77273b3-d217-41bb-8948-bf8ef7505fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:29.935943 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77273b3-d217-41bb-8948-bf8ef7505fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:29.936381 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77273b3-d217-41bb-8948-bf8ef7505fb4 admin admin] PATH_INFO: `/v3/projects/6f6a9f12427345988170be391994b4af` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:29.945040 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1087/2162] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:33:29 2022] POST /identity/v3/users => generated 294 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:29.945644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77273b3-d217-41bb-8948-bf8ef7505fb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f6a9f12427345988170be391994b4af)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:29.949097 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b5f46-beba-410a-8e42-19e3d6bd0e95 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:29.949624 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77273b3-d217-41bb-8948-bf8ef7505fb4 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:29.962555 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b5f46-beba-410a-8e42-19e3d6bd0e95 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:29.970385 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb97fa-4198-4556-b9e6-a984966dbd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:29.972263 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb97fa-4198-4556-b9e6-a984966dbd72 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:29.972545 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb97fa-4198-4556-b9e6-a984966dbd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:29.972830 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb97fa-4198-4556-b9e6-a984966dbd72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:29.973732 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb97fa-4198-4556-b9e6-a984966dbd72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:29.975612 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb97fa-4198-4556-b9e6-a984966dbd72 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:29.996561 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1088/2163] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:29.997891 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb97fa-4198-4556-b9e6-a984966dbd72 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:30.012157 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb97fa-4198-4556-b9e6-a984966dbd72 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:30.029779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-c77273b3-d217-41bb-8948-bf8ef7505fb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f6a9f12427345988170be391994b4af', 'request_id': 'req-c77273b3-d217-41bb-8948-bf8ef7505fb4'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:30.041986 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-c77273b3-d217-41bb-8948-bf8ef7505fb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f6a9f12427345988170be391994b4af', 'request_id': 'req-c77273b3-d217-41bb-8948-bf8ef7505fb4'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:30.058893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-c77273b3-d217-41bb-8948-bf8ef7505fb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f6a9f12427345988170be391994b4af', 'request_id': 'req-c77273b3-d217-41bb-8948-bf8ef7505fb4'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:30.073332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-c77273b3-d217-41bb-8948-bf8ef7505fb4 admin admin] The token cache is being invalidate because project 6f6a9f12427345988170be391994b4af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:30.073564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-c77273b3-d217-41bb-8948-bf8ef7505fb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:30.074239 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-c77273b3-d217-41bb-8948-bf8ef7505fb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:30.076029 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1076/2164] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:29 2022] DELETE /identity/v3/projects/6f6a9f12427345988170be391994b4af => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:30.080075 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77273b3-d217-41bb-8948-bf8ef7505fb4 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:30.085686 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b0846-6a89-4b51-a8e4-e73d6a1d65b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:30.086372 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b0846-6a89-4b51-a8e4-e73d6a1d65b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:30.086661 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b0846-6a89-4b51-a8e4-e73d6a1d65b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:30.086943 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b0846-6a89-4b51-a8e4-e73d6a1d65b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:30.087710 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b0846-6a89-4b51-a8e4-e73d6a1d65b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:30.089372 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b0846-6a89-4b51-a8e4-e73d6a1d65b4 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:30.096112 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-c77273b3-d217-41bb-8948-bf8ef7505fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:30.100067 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1089/2165] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:30.101436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6cbc2-a55f-4a81-bc17-7c33b1db1798 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:30.101833 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6cbc2-a55f-4a81-bc17-7c33b1db1798 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:30.102256 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6cbc2-a55f-4a81-bc17-7c33b1db1798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:30.114747 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77273b3-d217-41bb-8948-bf8ef7505fb4 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:30.119987 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e378dbc-d5ca-4537-b9b4-872e84aa05c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:30.120965 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e378dbc-d5ca-4537-b9b4-872e84aa05c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:30.121401 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e378dbc-d5ca-4537-b9b4-872e84aa05c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:30.121760 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e378dbc-d5ca-4537-b9b4-872e84aa05c9 admin admin] PATH_INFO: `/v3/projects/7b70b0860fee4b9a97222b1feae5f73b/users/0a6b2e492f9e426eaf1136f60fa57bb0/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:30.124833 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-a5a6cbc2-a55f-4a81-bc17-7c33b1db1798 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:30.127647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-a5a6cbc2-a55f-4a81-bc17-7c33b1db1798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:30.145647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1090/2166] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:30.145647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6cbc2-a55f-4a81-bc17-7c33b1db1798 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:30.147143 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-a5a6cbc2-a55f-4a81-bc17-7c33b1db1798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:30.148067 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e378dbc-d5ca-4537-b9b4-872e84aa05c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b70b0860fee4b9a97222b1feae5f73b, user_id=0a6b2e492f9e426eaf1136f60fa57bb0, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:30.153309 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e378dbc-d5ca-4537-b9b4-872e84aa05c9 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:30.160897 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6cbc2-a55f-4a81-bc17-7c33b1db1798 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:30.166685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7918047-5c34-4690-9a6f-39ee2145fae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:30.167862 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7918047-5c34-4690-9a6f-39ee2145fae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:30.168227 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7918047-5c34-4690-9a6f-39ee2145fae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:30.168586 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7918047-5c34-4690-9a6f-39ee2145fae7 admin admin] PATH_INFO: `/v3/projects/310301fc13b2472bb2cca80c39e67a7e/users/45654097b7564395bd5bb08141833d76/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:30.183333 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1077/2167] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:30 2022] PUT /identity/v3/projects/7b70b0860fee4b9a97222b1feae5f73b/users/0a6b2e492f9e426eaf1136f60fa57bb0/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:30.183333 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f8a24-763c-44a2-8620-603b6a37de21 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:30.183333 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f8a24-763c-44a2-8620-603b6a37de21 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:30.183333 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f8a24-763c-44a2-8620-603b6a37de21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:30.185406 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7918047-5c34-4690-9a6f-39ee2145fae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=310301fc13b2472bb2cca80c39e67a7e, user_id=45654097b7564395bd5bb08141833d76, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:30.190665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7918047-5c34-4690-9a6f-39ee2145fae7 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:30.213956 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1091/2168] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:30 2022] PUT /identity/v3/projects/310301fc13b2472bb2cca80c39e67a7e/users/45654097b7564395bd5bb08141833d76/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:30.214341 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-ac2f8a24-763c-44a2-8620-603b6a37de21 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:30.215159 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fa8b4-c7b8-4e18-9d98-990c8084baf7 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:30.215520 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fa8b4-c7b8-4e18-9d98-990c8084baf7 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:30.215824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fa8b4-c7b8-4e18-9d98-990c8084baf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:30.216158 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-ac2f8a24-763c-44a2-8620-603b6a37de21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:30.222840 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:30.249800 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-f02fa8b4-c7b8-4e18-9d98-990c8084baf7 None None] MFA Rules not processed for user `0a6b2e492f9e426eaf1136f60fa57bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:30.251454 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-f02fa8b4-c7b8-4e18-9d98-990c8084baf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:30.303416 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1078/2169] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:30.304352 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f8a24-763c-44a2-8620-603b6a37de21 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:30.319884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f8a24-763c-44a2-8620-603b6a37de21 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:30.327581 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38134678-7f99-420c-bcdb-2ba5c1f596b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:30.328333 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38134678-7f99-420c-bcdb-2ba5c1f596b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:30.328660 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38134678-7f99-420c-bcdb-2ba5c1f596b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:30.328937 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38134678-7f99-420c-bcdb-2ba5c1f596b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:30.330576 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38134678-7f99-420c-bcdb-2ba5c1f596b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:30.333276 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38134678-7f99-420c-bcdb-2ba5c1f596b3 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:30.340802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1092/2170] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:30.342522 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02fa8b4-c7b8-4e18-9d98-990c8084baf7 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:30.350369 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1079/2171] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:30.354524 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38134678-7f99-420c-bcdb-2ba5c1f596b3 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:30.364560 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02fa8b4-c7b8-4e18-9d98-990c8084baf7 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:30.367093 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38134678-7f99-420c-bcdb-2ba5c1f596b3 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:30.370896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df274976-5925-409b-8099-1e3a83ef658a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:30.372280 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df274976-5925-409b-8099-1e3a83ef658a admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:30.372428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a4ca7-b62d-4788-a48c-8c7daad1a97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:30.372594 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df274976-5925-409b-8099-1e3a83ef658a admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:30.372843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df274976-5925-409b-8099-1e3a83ef658a admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:30.373199 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a4ca7-b62d-4788-a48c-8c7daad1a97d admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:30.373494 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a4ca7-b62d-4788-a48c-8c7daad1a97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:30.373733 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df274976-5925-409b-8099-1e3a83ef658a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:30.373812 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a4ca7-b62d-4788-a48c-8c7daad1a97d admin admin] PATH_INFO: `/v3/projects/310301fc13b2472bb2cca80c39e67a7e/users/45654097b7564395bd5bb08141833d76/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:30.373923 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df274976-5925-409b-8099-1e3a83ef658a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:30.375511 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df274976-5925-409b-8099-1e3a83ef658a admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:30.375998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a4ca7-b62d-4788-a48c-8c7daad1a97d admin admin] RBAC: Authorizing `identity:create_grant(project_id=310301fc13b2472bb2cca80c39e67a7e, user_id=45654097b7564395bd5bb08141833d76, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:30.379867 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a4ca7-b62d-4788-a48c-8c7daad1a97d admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:30.395262 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1093/2172] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:30.395262 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df274976-5925-409b-8099-1e3a83ef658a admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:30.397828 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-df274976-5925-409b-8099-1e3a83ef658a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:30.398874 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1080/2173] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:30 2022] PUT /identity/v3/projects/310301fc13b2472bb2cca80c39e67a7e/users/45654097b7564395bd5bb08141833d76/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:30.399688 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a4ca7-b62d-4788-a48c-8c7daad1a97d admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:30.452231 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:30.466241 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df274976-5925-409b-8099-1e3a83ef658a admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:30.478296 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a4ca7-b62d-4788-a48c-8c7daad1a97d admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:30.483648 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf1afa-09fc-4383-a7a2-ab5d36c96972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:30.484666 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf1afa-09fc-4383-a7a2-ab5d36c96972 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:30.484666 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf1afa-09fc-4383-a7a2-ab5d36c96972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:30.484666 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf1afa-09fc-4383-a7a2-ab5d36c96972 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:30.485935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf1afa-09fc-4383-a7a2-ab5d36c96972 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:30.487637 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf1afa-09fc-4383-a7a2-ab5d36c96972 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:30.524318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1081/2174] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:33:30 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:30.526161 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8463f7a-1348-4101-ac4f-f6b0fa2d371f None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:30.526453 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8463f7a-1348-4101-ac4f-f6b0fa2d371f None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:30.526731 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8463f7a-1348-4101-ac4f-f6b0fa2d371f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:30.533328 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34f0ae-7092-4048-bdc3-acd057dd1a82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:30.534002 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34f0ae-7092-4048-bdc3-acd057dd1a82 service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:30.534291 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34f0ae-7092-4048-bdc3-acd057dd1a82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:30.534573 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34f0ae-7092-4048-bdc3-acd057dd1a82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:30.555824 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-b8463f7a-1348-4101-ac4f-f6b0fa2d371f None None] MFA Rules not processed for user `45654097b7564395bd5bb08141833d76`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:30.557054 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-b8463f7a-1348-4101-ac4f-f6b0fa2d371f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:30.591180 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:30.600899 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34f0ae-7092-4048-bdc3-acd057dd1a82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:30.602407 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34f0ae-7092-4048-bdc3-acd057dd1a82 service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:30.612959 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1094/2175] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:30.613863 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34f0ae-7092-4048-bdc3-acd057dd1a82 service cinder] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:30.627713 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34f0ae-7092-4048-bdc3-acd057dd1a82 service cinder] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:30.640381 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1082/2176] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:30 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:30.653967 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8463f7a-1348-4101-ac4f-f6b0fa2d371f None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:30.655471 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-b8463f7a-1348-4101-ac4f-f6b0fa2d371f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:30.698576 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9474a5a-350f-48e2-9479-5f6b624dca89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:30.699416 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9474a5a-350f-48e2-9479-5f6b624dca89 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:30.700215 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9474a5a-350f-48e2-9479-5f6b624dca89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:30.700215 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9474a5a-350f-48e2-9479-5f6b624dca89 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:30.700860 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9474a5a-350f-48e2-9479-5f6b624dca89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:30.702964 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9474a5a-350f-48e2-9479-5f6b624dca89 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:30.722534 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8463f7a-1348-4101-ac4f-f6b0fa2d371f None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:30.726290 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c804d7-c556-4c8d-8819-9a2368fb7b1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:30.726947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c804d7-c556-4c8d-8819-9a2368fb7b1a service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:30.727540 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1095/2177] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:33:30 2022] POST /identity/v3/users => generated 286 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:30.730331 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c804d7-c556-4c8d-8819-9a2368fb7b1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:30.730647 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c804d7-c556-4c8d-8819-9a2368fb7b1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:30.731731 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9474a5a-350f-48e2-9479-5f6b624dca89 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:30.732845 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-f9c804d7-c556-4c8d-8819-9a2368fb7b1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:30.742454 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9474a5a-350f-48e2-9479-5f6b624dca89 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:30.748412 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f70241-4bbb-414c-948e-3e0718c04e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:30.749078 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f70241-4bbb-414c-948e-3e0718c04e2d admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:30.749362 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f70241-4bbb-414c-948e-3e0718c04e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:30.749638 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f70241-4bbb-414c-948e-3e0718c04e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:30.750366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f70241-4bbb-414c-948e-3e0718c04e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:30.752676 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f70241-4bbb-414c-948e-3e0718c04e2d admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:30.768453 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1096/2178] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:33:30.769913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f70241-4bbb-414c-948e-3e0718c04e2d admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:30.780570 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f70241-4bbb-414c-948e-3e0718c04e2d admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:30.787659 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957c28a-e666-4df3-8bd2-b5fc0801e955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:30.790315 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957c28a-e666-4df3-8bd2-b5fc0801e955 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:30.790620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957c28a-e666-4df3-8bd2-b5fc0801e955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:30.790929 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957c28a-e666-4df3-8bd2-b5fc0801e955 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:30.791832 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957c28a-e666-4df3-8bd2-b5fc0801e955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:30.793757 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957c28a-e666-4df3-8bd2-b5fc0801e955 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:30.807202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1097/2179] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:30.812182 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957c28a-e666-4df3-8bd2-b5fc0801e955 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:30.812408 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c804d7-c556-4c8d-8819-9a2368fb7b1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:30.814126 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c804d7-c556-4c8d-8819-9a2368fb7b1a service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:30.824518 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1083/2180] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:33:30.826092 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957c28a-e666-4df3-8bd2-b5fc0801e955 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:30.831953 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271cefb9-e1c6-45d2-b287-5eafe6eb95e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:30.832894 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cefb9-e1c6-45d2-b287-5eafe6eb95e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:30.833181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cefb9-e1c6-45d2-b287-5eafe6eb95e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:30.833463 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cefb9-e1c6-45d2-b287-5eafe6eb95e5 admin admin] PATH_INFO: `/v3/projects/34197e85e4034d59826e7a3553e24129/users/05c0092f8c8d46a99fc04c0c334f490d/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:30.859587 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271cefb9-e1c6-45d2-b287-5eafe6eb95e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34197e85e4034d59826e7a3553e24129, user_id=05c0092f8c8d46a99fc04c0c334f490d, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:30.866681 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271cefb9-e1c6-45d2-b287-5eafe6eb95e5 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:30.889377 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1098/2181] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:30 2022] PUT /identity/v3/projects/34197e85e4034d59826e7a3553e24129/users/05c0092f8c8d46a99fc04c0c334f490d/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:30.895141 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e4459-c280-4b98-a343-811a524b9a47 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:30.895702 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e4459-c280-4b98-a343-811a524b9a47 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:30.895784 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e4459-c280-4b98-a343-811a524b9a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:30.903984 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:30.918806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-ba9e4459-c280-4b98-a343-811a524b9a47 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:30.921850 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-ba9e4459-c280-4b98-a343-811a524b9a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:31.011913 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1084/2182] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:31.023900 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271cefb9-e1c6-45d2-b287-5eafe6eb95e5 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:31.026124 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-271cefb9-e1c6-45d2-b287-5eafe6eb95e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:31.140326 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271cefb9-e1c6-45d2-b287-5eafe6eb95e5 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:31.146253 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc22861-79f2-4775-97bf-90060c66e383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:31.146929 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc22861-79f2-4775-97bf-90060c66e383 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:31.147553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc22861-79f2-4775-97bf-90060c66e383 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:31.147790 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc22861-79f2-4775-97bf-90060c66e383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:31.163793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc22861-79f2-4775-97bf-90060c66e383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:31.166253 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc22861-79f2-4775-97bf-90060c66e383 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:31.184945 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1099/2183] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:32.157095 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0b38a-85a5-47cd-8388-5889c8e69c20 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:32.157704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0b38a-85a5-47cd-8388-5889c8e69c20 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:32.157704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0b38a-85a5-47cd-8388-5889c8e69c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:32.182495 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-42f0b38a-85a5-47cd-8388-5889c8e69c20 None None] MFA Rules not processed for user `0a6b2e492f9e426eaf1136f60fa57bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:32.184125 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-42f0b38a-85a5-47cd-8388-5889c8e69c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:32.262005 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1085/2184] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:32.589891 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc22861-79f2-4775-97bf-90060c66e383 service neutron] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:32.659430 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:32.683426 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc22861-79f2-4775-97bf-90060c66e383 service neutron] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:32.687561 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699874f2-576c-4546-98f9-7b3ff91e7f39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:32.689364 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699874f2-576c-4546-98f9-7b3ff91e7f39 service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:32.689864 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699874f2-576c-4546-98f9-7b3ff91e7f39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:32.690678 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699874f2-576c-4546-98f9-7b3ff91e7f39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:32.692893 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-699874f2-576c-4546-98f9-7b3ff91e7f39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:32.787367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699874f2-576c-4546-98f9-7b3ff91e7f39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:32.788941 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699874f2-576c-4546-98f9-7b3ff91e7f39 service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:32.799743 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1100/2185] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:33.130057 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc083ab8-1b0a-43af-a42a-f14f4e2a55c4 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:33.130963 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc083ab8-1b0a-43af-a42a-f14f4e2a55c4 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:33.131331 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc083ab8-1b0a-43af-a42a-f14f4e2a55c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:33.178974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-cc083ab8-1b0a-43af-a42a-f14f4e2a55c4 None None] MFA Rules not processed for user `05c0092f8c8d46a99fc04c0c334f490d`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:33.184475 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-cc083ab8-1b0a-43af-a42a-f14f4e2a55c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:33.268765 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1086/2186] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:33.280452 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699874f2-576c-4546-98f9-7b3ff91e7f39 service cinder] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:33.292484 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699874f2-576c-4546-98f9-7b3ff91e7f39 service cinder] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:33.301857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c22a10-c6aa-4fc7-bd3e-4cf2319819bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:33.302532 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c22a10-c6aa-4fc7-bd3e-4cf2319819bd service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:33.302822 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c22a10-c6aa-4fc7-bd3e-4cf2319819bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:33.303107 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c22a10-c6aa-4fc7-bd3e-4cf2319819bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:33.332172 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c22a10-c6aa-4fc7-bd3e-4cf2319819bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:33.333478 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c22a10-c6aa-4fc7-bd3e-4cf2319819bd service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:33.354098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1101/2187] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:34.053827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc083ab8-1b0a-43af-a42a-f14f4e2a55c4 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:34.065527 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc083ab8-1b0a-43af-a42a-f14f4e2a55c4 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:34.080537 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b37d45-8ef1-486e-9c6d-cae483b8c166 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:34.081201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b37d45-8ef1-486e-9c6d-cae483b8c166 service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:34.081493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b37d45-8ef1-486e-9c6d-cae483b8c166 service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:34.081827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b37d45-8ef1-486e-9c6d-cae483b8c166 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:34.182147 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:34.198080 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c22a10-c6aa-4fc7-bd3e-4cf2319819bd service cinder] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:34.199893 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-94c22a10-c6aa-4fc7-bd3e-4cf2319819bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:34.232523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c22a10-c6aa-4fc7-bd3e-4cf2319819bd service cinder] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:34.245526 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4b29b-ca3c-4adc-b9b4-31b2762f431e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:34.246510 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4b29b-ca3c-4adc-b9b4-31b2762f431e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:34.246801 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4b29b-ca3c-4adc-b9b4-31b2762f431e admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:34.248103 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4b29b-ca3c-4adc-b9b4-31b2762f431e admin admin] PATH_INFO: `/v3/users/3288f81d646d4a96a15d4c9a5aca254d` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:34.249430 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4b29b-ca3c-4adc-b9b4-31b2762f431e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3288f81d646d4a96a15d4c9a5aca254d)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:34.251561 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4b29b-ca3c-4adc-b9b4-31b2762f431e admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:34.254407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b37d45-8ef1-486e-9c6d-cae483b8c166 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:34.257484 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b37d45-8ef1-486e-9c6d-cae483b8c166 service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:34.283725 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1087/2188] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:34 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:34.328986 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-a5d4b29b-ca3c-4adc-b9b4-31b2762f431e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3288f81d646d4a96a15d4c9a5aca254d'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:34.347294 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-a5d4b29b-ca3c-4adc-b9b4-31b2762f431e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3288f81d646d4a96a15d4c9a5aca254d'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:34.360553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-a5d4b29b-ca3c-4adc-b9b4-31b2762f431e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3288f81d646d4a96a15d4c9a5aca254d'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:34.362310 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-a5d4b29b-ca3c-4adc-b9b4-31b2762f431e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3288f81d646d4a96a15d4c9a5aca254d'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:34.363034 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-a5d4b29b-ca3c-4adc-b9b4-31b2762f431e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3288f81d646d4a96a15d4c9a5aca254d'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:34.389518 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1102/2189] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:34 2022] DELETE /identity/v3/users/3288f81d646d4a96a15d4c9a5aca254d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:34.391066 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee531e-6c85-4cce-9531-1b1bbfbd912a None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:34.392144 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee531e-6c85-4cce-9531-1b1bbfbd912a None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:34.392606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee531e-6c85-4cce-9531-1b1bbfbd912a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:34.422847 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-daee531e-6c85-4cce-9531-1b1bbfbd912a None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:34.425028 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-daee531e-6c85-4cce-9531-1b1bbfbd912a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:34.502693 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1088/2190] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:34.513554 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4b29b-ca3c-4adc-b9b4-31b2762f431e admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:34.515215 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-a5d4b29b-ca3c-4adc-b9b4-31b2762f431e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:34.592243 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4b29b-ca3c-4adc-b9b4-31b2762f431e admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:34.596494 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5f4fb-1c31-4663-bc7e-f17c5d2942a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:34.597257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5f4fb-1c31-4663-bc7e-f17c5d2942a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:34.597682 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5f4fb-1c31-4663-bc7e-f17c5d2942a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:34.597974 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5f4fb-1c31-4663-bc7e-f17c5d2942a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:34.605879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:34.614398 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5f4fb-1c31-4663-bc7e-f17c5d2942a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:34.618295 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5f4fb-1c31-4663-bc7e-f17c5d2942a6 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:34.630999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1103/2191] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:34.999648 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee531e-6c85-4cce-9531-1b1bbfbd912a None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:35.001778 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-daee531e-6c85-4cce-9531-1b1bbfbd912a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:35.026569 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee531e-6c85-4cce-9531-1b1bbfbd912a None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:35.032153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca533d-d0d1-4485-87d8-ac7db9629007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:35.033151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca533d-d0d1-4485-87d8-ac7db9629007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:35.033513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca533d-d0d1-4485-87d8-ac7db9629007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:35.033860 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca533d-d0d1-4485-87d8-ac7db9629007 admin admin] PATH_INFO: `/v3/projects/963ced714dc94984be4fe0084d0372a4` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:35.035212 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca533d-d0d1-4485-87d8-ac7db9629007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=963ced714dc94984be4fe0084d0372a4)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:35.046464 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca533d-d0d1-4485-87d8-ac7db9629007 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:35.139956 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-6eca533d-d0d1-4485-87d8-ac7db9629007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '963ced714dc94984be4fe0084d0372a4', 'request_id': 'req-6eca533d-d0d1-4485-87d8-ac7db9629007'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:35.148457 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-6eca533d-d0d1-4485-87d8-ac7db9629007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '963ced714dc94984be4fe0084d0372a4', 'request_id': 'req-6eca533d-d0d1-4485-87d8-ac7db9629007'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:35.162544 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-6eca533d-d0d1-4485-87d8-ac7db9629007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '963ced714dc94984be4fe0084d0372a4', 'request_id': 'req-6eca533d-d0d1-4485-87d8-ac7db9629007'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:35.200890 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-6eca533d-d0d1-4485-87d8-ac7db9629007 admin admin] The token cache is being invalidate because project 963ced714dc94984be4fe0084d0372a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:35.203723 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-6eca533d-d0d1-4485-87d8-ac7db9629007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:35.208464 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-6eca533d-d0d1-4485-87d8-ac7db9629007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:35.213626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1089/2192] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:34 2022] DELETE /identity/v3/projects/963ced714dc94984be4fe0084d0372a4 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:35.218112 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5f4fb-1c31-4663-bc7e-f17c5d2942a6 service neutron] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:35.241193 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5f4fb-1c31-4663-bc7e-f17c5d2942a6 service neutron] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:35.263987 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad1d82-62e4-4275-8695-f4adad350d39 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:35.264606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad1d82-62e4-4275-8695-f4adad350d39 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:35.265132 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad1d82-62e4-4275-8695-f4adad350d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:35.334514 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-38ad1d82-62e4-4275-8695-f4adad350d39 None None] MFA Rules not processed for user `05c0092f8c8d46a99fc04c0c334f490d`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:35.335801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-38ad1d82-62e4-4275-8695-f4adad350d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:35.425303 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe9cb0-292c-40bb-abda-05596210b14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:35.427195 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe9cb0-292c-40bb-abda-05596210b14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:35.430942 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe9cb0-292c-40bb-abda-05596210b14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:35.432372 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe9cb0-292c-40bb-abda-05596210b14f admin admin] PATH_INFO: `/v3/users/0a4398b4e92e4f7cbe4966d2ff6cc8e1` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:35.439425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe9cb0-292c-40bb-abda-05596210b14f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a4398b4e92e4f7cbe4966d2ff6cc8e1)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:35.448931 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe9cb0-292c-40bb-abda-05596210b14f admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:35.501992 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1090/2193] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:33:35.603729 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-d0fe9cb0-292c-40bb-abda-05596210b14f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a4398b4e92e4f7cbe4966d2ff6cc8e1'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:35.636050 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-d0fe9cb0-292c-40bb-abda-05596210b14f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a4398b4e92e4f7cbe4966d2ff6cc8e1'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:35.656046 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-d0fe9cb0-292c-40bb-abda-05596210b14f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a4398b4e92e4f7cbe4966d2ff6cc8e1'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:35.657976 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-d0fe9cb0-292c-40bb-abda-05596210b14f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a4398b4e92e4f7cbe4966d2ff6cc8e1'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:35.659625 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-d0fe9cb0-292c-40bb-abda-05596210b14f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a4398b4e92e4f7cbe4966d2ff6cc8e1'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:35.687509 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1104/2194] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:35 2022] DELETE /identity/v3/users/0a4398b4e92e4f7cbe4966d2ff6cc8e1 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:33:36.446118 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad1d82-62e4-4275-8695-f4adad350d39 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:36.447784 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-38ad1d82-62e4-4275-8695-f4adad350d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:36.462357 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:36.477813 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad1d82-62e4-4275-8695-f4adad350d39 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:36.609950 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e8d2e-889d-4a4a-86fd-d580aa53c5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:36.610906 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e8d2e-889d-4a4a-86fd-d580aa53c5be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:36.611279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e8d2e-889d-4a4a-86fd-d580aa53c5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:36.611622 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e8d2e-889d-4a4a-86fd-d580aa53c5be admin admin] PATH_INFO: `/v3/projects/cd466ad27e344bc69138e0c89e5822db` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:36.612929 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e8d2e-889d-4a4a-86fd-d580aa53c5be admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd466ad27e344bc69138e0c89e5822db)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:36.617147 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e8d2e-889d-4a4a-86fd-d580aa53c5be admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:36.684324 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-b39e8d2e-889d-4a4a-86fd-d580aa53c5be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd466ad27e344bc69138e0c89e5822db', 'request_id': 'req-b39e8d2e-889d-4a4a-86fd-d580aa53c5be'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:36.692494 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-b39e8d2e-889d-4a4a-86fd-d580aa53c5be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd466ad27e344bc69138e0c89e5822db', 'request_id': 'req-b39e8d2e-889d-4a4a-86fd-d580aa53c5be'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:36.712106 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-b39e8d2e-889d-4a4a-86fd-d580aa53c5be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd466ad27e344bc69138e0c89e5822db', 'request_id': 'req-b39e8d2e-889d-4a4a-86fd-d580aa53c5be'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:36.722587 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-b39e8d2e-889d-4a4a-86fd-d580aa53c5be admin admin] The token cache is being invalidate because project cd466ad27e344bc69138e0c89e5822db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:36.723004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-b39e8d2e-889d-4a4a-86fd-d580aa53c5be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:36.723843 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-b39e8d2e-889d-4a4a-86fd-d580aa53c5be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:36.726506 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1091/2195] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:36 2022] DELETE /identity/v3/projects/cd466ad27e344bc69138e0c89e5822db => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:36.730599 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72a627-9ae0-4105-803d-a6dd67fb7f59 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:36.731175 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72a627-9ae0-4105-803d-a6dd67fb7f59 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:36.731306 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72a627-9ae0-4105-803d-a6dd67fb7f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:36.776097 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-db72a627-9ae0-4105-803d-a6dd67fb7f59 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:36.778132 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-db72a627-9ae0-4105-803d-a6dd67fb7f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:36.907525 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1105/2196] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:36.914367 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7d4c5-1656-411a-8a56-5f57db86d7f5 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:36.915440 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7d4c5-1656-411a-8a56-5f57db86d7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:36.916154 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7d4c5-1656-411a-8a56-5f57db86d7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:36.964651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-faf7d4c5-1656-411a-8a56-5f57db86d7f5 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:36.966019 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-faf7d4c5-1656-411a-8a56-5f57db86d7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:36.997620 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1092/2197] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:33:36.998833 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72a627-9ae0-4105-803d-a6dd67fb7f59 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:37.014217 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72a627-9ae0-4105-803d-a6dd67fb7f59 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:37.042233 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1a74a-20bb-48d6-95c6-bd30bafdfa17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:37.043120 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1a74a-20bb-48d6-95c6-bd30bafdfa17 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:37.044889 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1a74a-20bb-48d6-95c6-bd30bafdfa17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:37.045667 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1a74a-20bb-48d6-95c6-bd30bafdfa17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:37.047476 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1a74a-20bb-48d6-95c6-bd30bafdfa17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:37.048144 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1a74a-20bb-48d6-95c6-bd30bafdfa17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:37.051601 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1a74a-20bb-48d6-95c6-bd30bafdfa17 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:37.081760 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:37.088610 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1106/2198] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:37.092921 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7d4c5-1656-411a-8a56-5f57db86d7f5 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:37.123922 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7d4c5-1656-411a-8a56-5f57db86d7f5 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:37.134891 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409da447-bdf9-4429-adc2-dbf980915319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:37.136684 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409da447-bdf9-4429-adc2-dbf980915319 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:37.137564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409da447-bdf9-4429-adc2-dbf980915319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:37.138170 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409da447-bdf9-4429-adc2-dbf980915319 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:37.139395 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409da447-bdf9-4429-adc2-dbf980915319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:37.141835 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409da447-bdf9-4429-adc2-dbf980915319 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:37.197238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1093/2199] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:33:37 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:37.201593 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1a74a-20bb-48d6-95c6-bd30bafdfa17 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:37.215965 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1a74a-20bb-48d6-95c6-bd30bafdfa17 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:37.405200 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4e2bb-22eb-4afc-8bc8-c6f7af791978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:37.406429 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4e2bb-22eb-4afc-8bc8-c6f7af791978 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:37.407804 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4e2bb-22eb-4afc-8bc8-c6f7af791978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:37.409213 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4e2bb-22eb-4afc-8bc8-c6f7af791978 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:37.409394 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4e2bb-22eb-4afc-8bc8-c6f7af791978 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:37.412275 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4e2bb-22eb-4afc-8bc8-c6f7af791978 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:37.481366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1107/2200] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:33:37 2022] POST /identity/v3/users => generated 287 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:33:37.486241 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409da447-bdf9-4429-adc2-dbf980915319 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:37.502310 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409da447-bdf9-4429-adc2-dbf980915319 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:37.525751 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df57e6-b212-4a4d-8ef3-9aa45dd8dbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:37.526674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df57e6-b212-4a4d-8ef3-9aa45dd8dbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:37.527115 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df57e6-b212-4a4d-8ef3-9aa45dd8dbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:37.527561 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df57e6-b212-4a4d-8ef3-9aa45dd8dbd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:37.528568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df57e6-b212-4a4d-8ef3-9aa45dd8dbd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:37.537150 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df57e6-b212-4a4d-8ef3-9aa45dd8dbd1 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:37.611999 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1094/2201] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:33:37.616736 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4e2bb-22eb-4afc-8bc8-c6f7af791978 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:37.631485 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4e2bb-22eb-4afc-8bc8-c6f7af791978 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:37.643886 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48c099-63eb-4ecc-a1b5-f461d9130a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:37.648139 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48c099-63eb-4ecc-a1b5-f461d9130a81 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:37.648839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48c099-63eb-4ecc-a1b5-f461d9130a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:37.650535 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48c099-63eb-4ecc-a1b5-f461d9130a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:37.653329 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f48c099-63eb-4ecc-a1b5-f461d9130a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:37.656892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f48c099-63eb-4ecc-a1b5-f461d9130a81 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:37.712907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1108/2202] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:37.715092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df57e6-b212-4a4d-8ef3-9aa45dd8dbd1 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:37.729521 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df57e6-b212-4a4d-8ef3-9aa45dd8dbd1 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:37.747270 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81428f65-5c5b-4907-8766-c7154b3cd9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:37.748188 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81428f65-5c5b-4907-8766-c7154b3cd9de admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:37.748662 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81428f65-5c5b-4907-8766-c7154b3cd9de admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:37.749380 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81428f65-5c5b-4907-8766-c7154b3cd9de admin admin] PATH_INFO: `/v3/projects/6ce09a39b27f43df9e05abe8ae94e8a0/users/ef70427713e14a86aa507d18d2917150/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:37.772970 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81428f65-5c5b-4907-8766-c7154b3cd9de admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce09a39b27f43df9e05abe8ae94e8a0, user_id=ef70427713e14a86aa507d18d2917150, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:37.776343 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81428f65-5c5b-4907-8766-c7154b3cd9de admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:37.794859 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1095/2203] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:37 2022] PUT /identity/v3/projects/6ce09a39b27f43df9e05abe8ae94e8a0/users/ef70427713e14a86aa507d18d2917150/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:37.809074 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3f304-605e-4476-8799-ebaa5158ba60 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:37.809637 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3f304-605e-4476-8799-ebaa5158ba60 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:37.809822 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3f304-605e-4476-8799-ebaa5158ba60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:37.880539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-5cd3f304-605e-4476-8799-ebaa5158ba60 None None] MFA Rules not processed for user `ef70427713e14a86aa507d18d2917150`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:37.882110 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-5cd3f304-605e-4476-8799-ebaa5158ba60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:37.990740 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1109/2204] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:37.992607 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81428f65-5c5b-4907-8766-c7154b3cd9de admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:38.042852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:38.103288 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81428f65-5c5b-4907-8766-c7154b3cd9de admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:38.112356 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0da2b-002c-47af-9864-01da19cd7d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:38.113268 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0da2b-002c-47af-9864-01da19cd7d0d admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:38.114065 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0da2b-002c-47af-9864-01da19cd7d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:38.114518 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0da2b-002c-47af-9864-01da19cd7d0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:38.115856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0da2b-002c-47af-9864-01da19cd7d0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:38.117861 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0da2b-002c-47af-9864-01da19cd7d0d admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:38.173466 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1096/2205] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:33:37 2022] POST /identity/v3/projects => generated 375 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:33:38.173905 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3f304-605e-4476-8799-ebaa5158ba60 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:38.196317 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3f304-605e-4476-8799-ebaa5158ba60 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:38.281329 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4612960-eaa2-48fa-9119-90f63f2d6fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:38.282166 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4612960-eaa2-48fa-9119-90f63f2d6fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:38.282382 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4612960-eaa2-48fa-9119-90f63f2d6fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:38.282652 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4612960-eaa2-48fa-9119-90f63f2d6fe5 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:38.283479 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4612960-eaa2-48fa-9119-90f63f2d6fe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:38.285420 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4612960-eaa2-48fa-9119-90f63f2d6fe5 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:38.306114 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:38.313339 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1110/2206] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:33:38 2022] POST /identity/v3/users => generated 294 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:33:38.318841 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0da2b-002c-47af-9864-01da19cd7d0d admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:38.332647 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0da2b-002c-47af-9864-01da19cd7d0d admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:38.355798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fabdc-efeb-4ecb-965f-6647987eabaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:38.356990 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fabdc-efeb-4ecb-965f-6647987eabaf admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:38.357565 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fabdc-efeb-4ecb-965f-6647987eabaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:38.358383 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fabdc-efeb-4ecb-965f-6647987eabaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:38.359366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420fabdc-efeb-4ecb-965f-6647987eabaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:38.361876 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420fabdc-efeb-4ecb-965f-6647987eabaf admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:38.392728 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1097/2207] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:33:38.398213 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4612960-eaa2-48fa-9119-90f63f2d6fe5 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:38.412202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4612960-eaa2-48fa-9119-90f63f2d6fe5 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:38.417217 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21312892-805a-4ba2-84ff-cd34a3bc128e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:38.418173 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21312892-805a-4ba2-84ff-cd34a3bc128e admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:38.418460 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21312892-805a-4ba2-84ff-cd34a3bc128e admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:38.418740 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21312892-805a-4ba2-84ff-cd34a3bc128e admin admin] PATH_INFO: `/v3/projects/67c6cd1b081e49af82b2c001537a6a9f/users/cea9001fccb74bb4bdc2e780f4037a9c/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:38.439150 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21312892-805a-4ba2-84ff-cd34a3bc128e admin admin] RBAC: Authorizing `identity:create_grant(project_id=67c6cd1b081e49af82b2c001537a6a9f, user_id=cea9001fccb74bb4bdc2e780f4037a9c, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:38.441808 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21312892-805a-4ba2-84ff-cd34a3bc128e admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:38.459361 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1111/2208] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:38 2022] PUT /identity/v3/projects/67c6cd1b081e49af82b2c001537a6a9f/users/cea9001fccb74bb4bdc2e780f4037a9c/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:38.465627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fabdc-efeb-4ecb-965f-6647987eabaf admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:38.508490 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fabdc-efeb-4ecb-965f-6647987eabaf admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:38.704665 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bcf804-1941-412b-932d-e708213f937d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:38.705687 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bcf804-1941-412b-932d-e708213f937d admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:38.706182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bcf804-1941-412b-932d-e708213f937d admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:38.706646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bcf804-1941-412b-932d-e708213f937d admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:38.708021 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bcf804-1941-412b-932d-e708213f937d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:38.710169 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bcf804-1941-412b-932d-e708213f937d admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:38.731857 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1098/2209] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:38.736086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21312892-805a-4ba2-84ff-cd34a3bc128e admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:38.753705 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21312892-805a-4ba2-84ff-cd34a3bc128e admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:38.758554 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e75c2-685b-452f-b78d-a97b53ccb279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:38.759908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e75c2-685b-452f-b78d-a97b53ccb279 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:38.760442 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e75c2-685b-452f-b78d-a97b53ccb279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:38.760955 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e75c2-685b-452f-b78d-a97b53ccb279 admin admin] PATH_INFO: `/v3/projects/67c6cd1b081e49af82b2c001537a6a9f/users/cea9001fccb74bb4bdc2e780f4037a9c/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:38.764087 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e75c2-685b-452f-b78d-a97b53ccb279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67c6cd1b081e49af82b2c001537a6a9f, user_id=cea9001fccb74bb4bdc2e780f4037a9c, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:38.766910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e75c2-685b-452f-b78d-a97b53ccb279 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:38.786622 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1112/2210] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:38 2022] PUT /identity/v3/projects/67c6cd1b081e49af82b2c001537a6a9f/users/cea9001fccb74bb4bdc2e780f4037a9c/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:33:38.791983 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bdd47-b7f3-4db0-afb6-06adf2ddd19e None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:38.792489 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bdd47-b7f3-4db0-afb6-06adf2ddd19e None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:38.792783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bdd47-b7f3-4db0-afb6-06adf2ddd19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:38.827924 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-a22bdd47-b7f3-4db0-afb6-06adf2ddd19e None None] MFA Rules not processed for user `cea9001fccb74bb4bdc2e780f4037a9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:38.829594 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-a22bdd47-b7f3-4db0-afb6-06adf2ddd19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:38.934827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1099/2211] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:33:38.947185 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e75c2-685b-452f-b78d-a97b53ccb279 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:38.949808 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-0f8e75c2-685b-452f-b78d-a97b53ccb279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:39.062952 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e75c2-685b-452f-b78d-a97b53ccb279 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:39.067609 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e374a5-2443-450a-9614-5a4b964a2eca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:39.068306 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e374a5-2443-450a-9614-5a4b964a2eca service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:39.068730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e374a5-2443-450a-9614-5a4b964a2eca service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:39.068928 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e374a5-2443-450a-9614-5a4b964a2eca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:39.088186 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bdd47-b7f3-4db0-afb6-06adf2ddd19e None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:39.089705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-a22bdd47-b7f3-4db0-afb6-06adf2ddd19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:39.147925 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:39.211619 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e374a5-2443-450a-9614-5a4b964a2eca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:39.213242 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e374a5-2443-450a-9614-5a4b964a2eca service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:39.224297 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1113/2212] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:39.234469 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bdd47-b7f3-4db0-afb6-06adf2ddd19e None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:39.247938 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09193ee2-1d66-43a9-b8d5-ed85c12d1b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:39.249916 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09193ee2-1d66-43a9-b8d5-ed85c12d1b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:39.252704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09193ee2-1d66-43a9-b8d5-ed85c12d1b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:39.253157 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09193ee2-1d66-43a9-b8d5-ed85c12d1b61 admin admin] PATH_INFO: `/v3/users/4d290f995a124f0da90c2ccde640bbc7` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:39.256375 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09193ee2-1d66-43a9-b8d5-ed85c12d1b61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d290f995a124f0da90c2ccde640bbc7)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:39.258726 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09193ee2-1d66-43a9-b8d5-ed85c12d1b61 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:39.405634 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-09193ee2-1d66-43a9-b8d5-ed85c12d1b61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d290f995a124f0da90c2ccde640bbc7'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:39.425101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-09193ee2-1d66-43a9-b8d5-ed85c12d1b61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d290f995a124f0da90c2ccde640bbc7'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:39.439008 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-09193ee2-1d66-43a9-b8d5-ed85c12d1b61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d290f995a124f0da90c2ccde640bbc7'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:39.439008 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-09193ee2-1d66-43a9-b8d5-ed85c12d1b61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d290f995a124f0da90c2ccde640bbc7'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:39.439008 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-09193ee2-1d66-43a9-b8d5-ed85c12d1b61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d290f995a124f0da90c2ccde640bbc7'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:39.465112 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1100/2213] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:39 2022] DELETE /identity/v3/users/4d290f995a124f0da90c2ccde640bbc7 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:33:39.470277 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfe3d7-1d05-40a0-8294-db882fa86e1d None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:39.470675 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfe3d7-1d05-40a0-8294-db882fa86e1d None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:39.470969 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfe3d7-1d05-40a0-8294-db882fa86e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:39.499735 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-a2bfe3d7-1d05-40a0-8294-db882fa86e1d None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:39.501918 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-a2bfe3d7-1d05-40a0-8294-db882fa86e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:39.629811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1114/2214] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:39.693960 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09193ee2-1d66-43a9-b8d5-ed85c12d1b61 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:39.696276 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-09193ee2-1d66-43a9-b8d5-ed85c12d1b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:39.821009 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09193ee2-1d66-43a9-b8d5-ed85c12d1b61 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:39.838677 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785b0ca-3a96-4621-abd6-4a85dcf71c76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:39.839756 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785b0ca-3a96-4621-abd6-4a85dcf71c76 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:39.840203 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785b0ca-3a96-4621-abd6-4a85dcf71c76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:39.840793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785b0ca-3a96-4621-abd6-4a85dcf71c76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:39.859106 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785b0ca-3a96-4621-abd6-4a85dcf71c76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:39.863525 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785b0ca-3a96-4621-abd6-4a85dcf71c76 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:39.884546 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1101/2215] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:40.442143 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfe3d7-1d05-40a0-8294-db882fa86e1d None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:40.444206 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-a2bfe3d7-1d05-40a0-8294-db882fa86e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:40.465784 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfe3d7-1d05-40a0-8294-db882fa86e1d None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:40.482092 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13592f-8192-404d-b794-2072dc245ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:40.483291 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13592f-8192-404d-b794-2072dc245ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:40.483776 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13592f-8192-404d-b794-2072dc245ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:40.484245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13592f-8192-404d-b794-2072dc245ae7 admin admin] PATH_INFO: `/v3/users/7dbd6ff526844272b3f48e49991039ba` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:40.485987 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13592f-8192-404d-b794-2072dc245ae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dbd6ff526844272b3f48e49991039ba)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:40.488857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13592f-8192-404d-b794-2072dc245ae7 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:40.524076 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:40.603954 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-fc13592f-8192-404d-b794-2072dc245ae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dbd6ff526844272b3f48e49991039ba'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:40.627696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-fc13592f-8192-404d-b794-2072dc245ae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dbd6ff526844272b3f48e49991039ba'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:40.640815 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-fc13592f-8192-404d-b794-2072dc245ae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dbd6ff526844272b3f48e49991039ba'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:40.642194 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-fc13592f-8192-404d-b794-2072dc245ae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dbd6ff526844272b3f48e49991039ba'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:40.642820 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-fc13592f-8192-404d-b794-2072dc245ae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dbd6ff526844272b3f48e49991039ba'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:40.661396 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1115/2216] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:40 2022] DELETE /identity/v3/users/7dbd6ff526844272b3f48e49991039ba => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:41.300153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785b0ca-3a96-4621-abd6-4a85dcf71c76 service neutron] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:41.310590 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785b0ca-3a96-4621-abd6-4a85dcf71c76 service neutron] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:41.372481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:41.389938 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ed378-ec0b-465a-a786-e15082e7bf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:41.391029 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ed378-ec0b-465a-a786-e15082e7bf25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:41.392027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ed378-ec0b-465a-a786-e15082e7bf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:41.392691 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ed378-ec0b-465a-a786-e15082e7bf25 admin admin] PATH_INFO: `/v3/projects/5c971c14b3764addb5b05cc84154c8d8` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:41.394563 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ed378-ec0b-465a-a786-e15082e7bf25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c971c14b3764addb5b05cc84154c8d8)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:41.397492 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ed378-ec0b-465a-a786-e15082e7bf25 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:41.499507 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-dd9ed378-ec0b-465a-a786-e15082e7bf25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c971c14b3764addb5b05cc84154c8d8', 'request_id': 'req-dd9ed378-ec0b-465a-a786-e15082e7bf25'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:41.511853 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-dd9ed378-ec0b-465a-a786-e15082e7bf25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c971c14b3764addb5b05cc84154c8d8', 'request_id': 'req-dd9ed378-ec0b-465a-a786-e15082e7bf25'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:41.520579 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13592f-8192-404d-b794-2072dc245ae7 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:41.523739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-fc13592f-8192-404d-b794-2072dc245ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:41.526169 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-dd9ed378-ec0b-465a-a786-e15082e7bf25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c971c14b3764addb5b05cc84154c8d8', 'request_id': 'req-dd9ed378-ec0b-465a-a786-e15082e7bf25'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:41.541164 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-dd9ed378-ec0b-465a-a786-e15082e7bf25 admin admin] The token cache is being invalidate because project 5c971c14b3764addb5b05cc84154c8d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:41.541778 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-dd9ed378-ec0b-465a-a786-e15082e7bf25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:41.542744 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-dd9ed378-ec0b-465a-a786-e15082e7bf25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:41.544901 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1102/2217] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:41 2022] DELETE /identity/v3/projects/5c971c14b3764addb5b05cc84154c8d8 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:41.546065 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13592f-8192-404d-b794-2072dc245ae7 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:41.557159 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b85fe-5067-4160-a786-5a2577c6a295 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:41.557479 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b85fe-5067-4160-a786-5a2577c6a295 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:41.558205 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b85fe-5067-4160-a786-5a2577c6a295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:41.578577 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-938b85fe-5067-4160-a786-5a2577c6a295 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:41.579846 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-938b85fe-5067-4160-a786-5a2577c6a295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:41.640506 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6275a-ad47-4817-8a90-fc296edf2311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:41.641402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6275a-ad47-4817-8a90-fc296edf2311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:41.641696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6275a-ad47-4817-8a90-fc296edf2311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:41.641981 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6275a-ad47-4817-8a90-fc296edf2311 admin admin] PATH_INFO: `/v3/projects/137bf595980144d683ce2cd57e6a4dc4` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:41.643539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6275a-ad47-4817-8a90-fc296edf2311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=137bf595980144d683ce2cd57e6a4dc4)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:41.645768 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6275a-ad47-4817-8a90-fc296edf2311 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:41.664484 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1103/2218] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:33:41.675305 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c038a78-64eb-47c7-964e-18e919ba841e None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:41.676287 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c038a78-64eb-47c7-964e-18e919ba841e None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:41.676735 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c038a78-64eb-47c7-964e-18e919ba841e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:41.700922 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-7c038a78-64eb-47c7-964e-18e919ba841e None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:41.703152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-7c038a78-64eb-47c7-964e-18e919ba841e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:41.710895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-d2b6275a-ad47-4817-8a90-fc296edf2311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '137bf595980144d683ce2cd57e6a4dc4', 'request_id': 'req-d2b6275a-ad47-4817-8a90-fc296edf2311'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:41.721484 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-d2b6275a-ad47-4817-8a90-fc296edf2311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '137bf595980144d683ce2cd57e6a4dc4', 'request_id': 'req-d2b6275a-ad47-4817-8a90-fc296edf2311'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:41.735002 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-d2b6275a-ad47-4817-8a90-fc296edf2311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '137bf595980144d683ce2cd57e6a4dc4', 'request_id': 'req-d2b6275a-ad47-4817-8a90-fc296edf2311'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:41.763262 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-d2b6275a-ad47-4817-8a90-fc296edf2311 admin admin] The token cache is being invalidate because project 137bf595980144d683ce2cd57e6a4dc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:41.763582 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-d2b6275a-ad47-4817-8a90-fc296edf2311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:41.764911 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-d2b6275a-ad47-4817-8a90-fc296edf2311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:41.768439 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1116/2219] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:41 2022] DELETE /identity/v3/projects/137bf595980144d683ce2cd57e6a4dc4 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:41.776599 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6275a-ad47-4817-8a90-fc296edf2311 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:41.782600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-d2b6275a-ad47-4817-8a90-fc296edf2311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:41.797585 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1104/2220] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:41.801658 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c038a78-64eb-47c7-964e-18e919ba841e None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:41.813609 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c038a78-64eb-47c7-964e-18e919ba841e None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:41.818842 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d88ceb-f99d-4706-9905-1b714d7b808f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:41.819967 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d88ceb-f99d-4706-9905-1b714d7b808f admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:41.819967 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d88ceb-f99d-4706-9905-1b714d7b808f admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:41.820290 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d88ceb-f99d-4706-9905-1b714d7b808f admin admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:41.820921 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:41.822071 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d88ceb-f99d-4706-9905-1b714d7b808f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:41.822509 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d88ceb-f99d-4706-9905-1b714d7b808f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:41.824451 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d88ceb-f99d-4706-9905-1b714d7b808f admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:41.843531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1105/2221] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:41.845892 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d88ceb-f99d-4706-9905-1b714d7b808f admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:41.860201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:41.866985 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d88ceb-f99d-4706-9905-1b714d7b808f admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:41.874566 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a79b6-1267-4482-ae12-79232d3cfec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:41.875399 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a79b6-1267-4482-ae12-79232d3cfec4 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:41.876420 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a79b6-1267-4482-ae12-79232d3cfec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:41.876768 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a79b6-1267-4482-ae12-79232d3cfec4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:41.877657 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a79b6-1267-4482-ae12-79232d3cfec4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:41.879880 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a79b6-1267-4482-ae12-79232d3cfec4 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:41.903407 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6275a-ad47-4817-8a90-fc296edf2311 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:41.909889 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46b0ee-64f9-4807-b2ab-1c43d4bd3dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:41.911334 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46b0ee-64f9-4807-b2ab-1c43d4bd3dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:41.911630 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46b0ee-64f9-4807-b2ab-1c43d4bd3dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:41.912030 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46b0ee-64f9-4807-b2ab-1c43d4bd3dbe admin admin] PATH_INFO: `/v3/users/2026c98c1eea41eea3c6608c4f13859a` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:41.915259 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed46b0ee-64f9-4807-b2ab-1c43d4bd3dbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=2026c98c1eea41eea3c6608c4f13859a)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:41.918187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed46b0ee-64f9-4807-b2ab-1c43d4bd3dbe admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:41.924300 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1106/2222] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:33:41 2022] POST /identity/v3/projects => generated 389 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:41.925870 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a79b6-1267-4482-ae12-79232d3cfec4 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:42.063010 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ed46b0ee-64f9-4807-b2ab-1c43d4bd3dbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2026c98c1eea41eea3c6608c4f13859a'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:42.089891 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ed46b0ee-64f9-4807-b2ab-1c43d4bd3dbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2026c98c1eea41eea3c6608c4f13859a'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:42.109546 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ed46b0ee-64f9-4807-b2ab-1c43d4bd3dbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2026c98c1eea41eea3c6608c4f13859a'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:42.112955 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ed46b0ee-64f9-4807-b2ab-1c43d4bd3dbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2026c98c1eea41eea3c6608c4f13859a'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:42.113822 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a79b6-1267-4482-ae12-79232d3cfec4 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:42.114988 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ed46b0ee-64f9-4807-b2ab-1c43d4bd3dbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2026c98c1eea41eea3c6608c4f13859a'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:42.135648 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06c6dc-208c-472a-acf0-acfdc7577879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:42.137035 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06c6dc-208c-472a-acf0-acfdc7577879 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:42.137546 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06c6dc-208c-472a-acf0-acfdc7577879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:42.138035 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06c6dc-208c-472a-acf0-acfdc7577879 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:42.139351 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06c6dc-208c-472a-acf0-acfdc7577879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:42.142476 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06c6dc-208c-472a-acf0-acfdc7577879 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:42.156687 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1117/2223] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:41 2022] DELETE /identity/v3/users/2026c98c1eea41eea3c6608c4f13859a => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:33:42.158066 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46b0ee-64f9-4807-b2ab-1c43d4bd3dbe admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:42.160012 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-ed46b0ee-64f9-4807-b2ab-1c43d4bd3dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:42.181036 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1107/2224] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:33:41 2022] POST /identity/v3/users => generated 295 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:42.181036 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06c6dc-208c-472a-acf0-acfdc7577879 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:42.183807 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-ff06c6dc-208c-472a-acf0-acfdc7577879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:42.266844 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46b0ee-64f9-4807-b2ab-1c43d4bd3dbe admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:42.280870 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6504f-c05c-42ed-b532-f5848f44ac13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:42.282158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6504f-c05c-42ed-b532-f5848f44ac13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:42.282769 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6504f-c05c-42ed-b532-f5848f44ac13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:42.283262 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6504f-c05c-42ed-b532-f5848f44ac13 admin admin] PATH_INFO: `/v3/users/ef70427713e14a86aa507d18d2917150` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:42.283456 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06c6dc-208c-472a-acf0-acfdc7577879 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:42.285097 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6504f-c05c-42ed-b532-f5848f44ac13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef70427713e14a86aa507d18d2917150)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:42.287952 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6504f-c05c-42ed-b532-f5848f44ac13 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:42.361175 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:42.371739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-f3e6504f-c05c-42ed-b532-f5848f44ac13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef70427713e14a86aa507d18d2917150'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:42.379488 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846e91f-d389-4014-b2d0-f5455e011e6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:42.380321 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846e91f-d389-4014-b2d0-f5455e011e6c service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:42.380626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846e91f-d389-4014-b2d0-f5455e011e6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:42.381285 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846e91f-d389-4014-b2d0-f5455e011e6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:42.384205 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-b846e91f-d389-4014-b2d0-f5455e011e6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:42.391712 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-f3e6504f-c05c-42ed-b532-f5848f44ac13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef70427713e14a86aa507d18d2917150'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:42.404257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-f3e6504f-c05c-42ed-b532-f5848f44ac13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef70427713e14a86aa507d18d2917150'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:42.405158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-f3e6504f-c05c-42ed-b532-f5848f44ac13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef70427713e14a86aa507d18d2917150'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:42.407748 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-f3e6504f-c05c-42ed-b532-f5848f44ac13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef70427713e14a86aa507d18d2917150'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:42.430241 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1118/2225] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:42 2022] DELETE /identity/v3/users/ef70427713e14a86aa507d18d2917150 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:42.431415 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6504f-c05c-42ed-b532-f5848f44ac13 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:42.433139 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-f3e6504f-c05c-42ed-b532-f5848f44ac13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:42.453550 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:42.511763 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b846e91f-d389-4014-b2d0-f5455e011e6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:42.514087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b846e91f-d389-4014-b2d0-f5455e011e6c service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:42.529433 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1108/2226] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:42 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:42.531336 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40b0fe-83a1-410b-860d-787793838779 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:42.531762 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40b0fe-83a1-410b-860d-787793838779 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:42.532699 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40b0fe-83a1-410b-860d-787793838779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:42.558977 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-3c40b0fe-83a1-410b-860d-787793838779 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:42.560821 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-3c40b0fe-83a1-410b-860d-787793838779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:42.571553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6504f-c05c-42ed-b532-f5848f44ac13 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:42.580449 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e92148-ce7b-441e-9273-a4acdedb4e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:42.581270 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e92148-ce7b-441e-9273-a4acdedb4e16 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:42.581678 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e92148-ce7b-441e-9273-a4acdedb4e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:42.582032 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e92148-ce7b-441e-9273-a4acdedb4e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:42.582853 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e92148-ce7b-441e-9273-a4acdedb4e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:42.583541 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1109/2227] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:42.588916 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e92148-ce7b-441e-9273-a4acdedb4e16 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:42.599744 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40b0fe-83a1-410b-860d-787793838779 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:42.601577 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-3c40b0fe-83a1-410b-860d-787793838779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:42.601973 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1119/2228] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:42.608161 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e92148-ce7b-441e-9273-a4acdedb4e16 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:42.629572 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e92148-ce7b-441e-9273-a4acdedb4e16 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:42.638199 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822687e-11fb-40aa-b673-688b750c6d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:42.638925 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822687e-11fb-40aa-b673-688b750c6d18 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:42.639186 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822687e-11fb-40aa-b673-688b750c6d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:42.639502 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822687e-11fb-40aa-b673-688b750c6d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:42.640261 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822687e-11fb-40aa-b673-688b750c6d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:42.642277 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822687e-11fb-40aa-b673-688b750c6d18 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:42.656272 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1120/2229] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:42.661684 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822687e-11fb-40aa-b673-688b750c6d18 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:42.678492 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822687e-11fb-40aa-b673-688b750c6d18 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:42.683841 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4ecda-4af5-451d-a1cb-bf69931cf2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:42.684830 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4ecda-4af5-451d-a1cb-bf69931cf2c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:42.685136 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4ecda-4af5-451d-a1cb-bf69931cf2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:42.685515 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4ecda-4af5-451d-a1cb-bf69931cf2c1 admin admin] PATH_INFO: `/v3/projects/4c157e58a3624f77a054102c7f0ea7fd/users/571414daf30540c9a0ec35c99d309826/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:42.713188 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40b0fe-83a1-410b-860d-787793838779 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:42.718211 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac6ac3-d461-4d77-a954-941a3feb4b70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:42.719013 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac6ac3-d461-4d77-a954-941a3feb4b70 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:42.719460 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac6ac3-d461-4d77-a954-941a3feb4b70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:42.719858 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac6ac3-d461-4d77-a954-941a3feb4b70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:42.720317 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4ecda-4af5-451d-a1cb-bf69931cf2c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c157e58a3624f77a054102c7f0ea7fd, user_id=571414daf30540c9a0ec35c99d309826, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:42.724033 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4ecda-4af5-451d-a1cb-bf69931cf2c1 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:42.736646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac6ac3-d461-4d77-a954-941a3feb4b70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:42.738479 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac6ac3-d461-4d77-a954-941a3feb4b70 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:42.747796 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1121/2230] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:42 2022] PUT /identity/v3/projects/4c157e58a3624f77a054102c7f0ea7fd/users/571414daf30540c9a0ec35c99d309826/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:42.747796 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4ecda-4af5-451d-a1cb-bf69931cf2c1 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:42.756459 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-e7b4ecda-4af5-451d-a1cb-bf69931cf2c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:42.763344 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1110/2231] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:33:42.763344 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546737a7-5034-4c3e-9588-a27f04823571 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:42.763344 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546737a7-5034-4c3e-9588-a27f04823571 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:42.763344 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546737a7-5034-4c3e-9588-a27f04823571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:42.803424 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-546737a7-5034-4c3e-9588-a27f04823571 None None] MFA Rules not processed for user `571414daf30540c9a0ec35c99d309826`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:42.805291 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-546737a7-5034-4c3e-9588-a27f04823571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:42.892380 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4ecda-4af5-451d-a1cb-bf69931cf2c1 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:42.900718 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f24bfc-2639-479c-ba65-b5d6f8bf389a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:42.901919 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f24bfc-2639-479c-ba65-b5d6f8bf389a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:42.902372 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f24bfc-2639-479c-ba65-b5d6f8bf389a admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:42.902752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f24bfc-2639-479c-ba65-b5d6f8bf389a admin admin] PATH_INFO: `/v3/projects/a1de8af33d1a42a79334fe74aae8fa5f` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:42.904590 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f24bfc-2639-479c-ba65-b5d6f8bf389a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1de8af33d1a42a79334fe74aae8fa5f)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:42.907792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f24bfc-2639-479c-ba65-b5d6f8bf389a admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:42.946974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1111/2232] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:42.947559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:42.952991 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546737a7-5034-4c3e-9588-a27f04823571 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:42.976788 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546737a7-5034-4c3e-9588-a27f04823571 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:42.985577 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76188b2b-954d-4e7e-8932-701ce3513a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:42.986293 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76188b2b-954d-4e7e-8932-701ce3513a87 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:42.986590 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76188b2b-954d-4e7e-8932-701ce3513a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:42.986865 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76188b2b-954d-4e7e-8932-701ce3513a87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:42.987639 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76188b2b-954d-4e7e-8932-701ce3513a87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:42.990534 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76188b2b-954d-4e7e-8932-701ce3513a87 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:43.015976 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-97f24bfc-2639-479c-ba65-b5d6f8bf389a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1de8af33d1a42a79334fe74aae8fa5f', 'request_id': 'req-97f24bfc-2639-479c-ba65-b5d6f8bf389a'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:43.027953 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-97f24bfc-2639-479c-ba65-b5d6f8bf389a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1de8af33d1a42a79334fe74aae8fa5f', 'request_id': 'req-97f24bfc-2639-479c-ba65-b5d6f8bf389a'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:43.039167 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-97f24bfc-2639-479c-ba65-b5d6f8bf389a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1de8af33d1a42a79334fe74aae8fa5f', 'request_id': 'req-97f24bfc-2639-479c-ba65-b5d6f8bf389a'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:43.041051 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1112/2233] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:33:42 2022] POST /identity/v3/projects => generated 387 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:33:43.042697 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76188b2b-954d-4e7e-8932-701ce3513a87 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:43.059301 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-97f24bfc-2639-479c-ba65-b5d6f8bf389a admin admin] The token cache is being invalidate because project a1de8af33d1a42a79334fe74aae8fa5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:43.059645 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-97f24bfc-2639-479c-ba65-b5d6f8bf389a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:43.060432 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-97f24bfc-2639-479c-ba65-b5d6f8bf389a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:43.062622 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1122/2234] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:42 2022] DELETE /identity/v3/projects/a1de8af33d1a42a79334fe74aae8fa5f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:43.069272 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f24bfc-2639-479c-ba65-b5d6f8bf389a admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:43.072795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-97f24bfc-2639-479c-ba65-b5d6f8bf389a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:43.173784 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:43.192702 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f24bfc-2639-479c-ba65-b5d6f8bf389a admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:43.199249 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262821a-c077-43a2-b93f-a809000229bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:43.200169 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262821a-c077-43a2-b93f-a809000229bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:43.200465 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262821a-c077-43a2-b93f-a809000229bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:43.200751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262821a-c077-43a2-b93f-a809000229bd admin admin] PATH_INFO: `/v3/users/45654097b7564395bd5bb08141833d76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:43.203448 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262821a-c077-43a2-b93f-a809000229bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=45654097b7564395bd5bb08141833d76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:43.204843 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76188b2b-954d-4e7e-8932-701ce3513a87 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:43.205763 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262821a-c077-43a2-b93f-a809000229bd admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:43.211349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19a59c-a1ea-4f8c-8602-dd559c29635a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:43.212062 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19a59c-a1ea-4f8c-8602-dd559c29635a admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:43.212352 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19a59c-a1ea-4f8c-8602-dd559c29635a admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:43.212628 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19a59c-a1ea-4f8c-8602-dd559c29635a admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:43.213355 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19a59c-a1ea-4f8c-8602-dd559c29635a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:43.215405 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19a59c-a1ea-4f8c-8602-dd559c29635a admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:43.263447 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1113/2235] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:33:43 2022] POST /identity/v3/users => generated 300 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:43.270663 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19a59c-a1ea-4f8c-8602-dd559c29635a admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:43.274309 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-dd19a59c-a1ea-4f8c-8602-dd559c29635a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:43.312276 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19a59c-a1ea-4f8c-8602-dd559c29635a admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:43.319302 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ea735-61b2-471a-a169-b6e353567ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:43.319991 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ea735-61b2-471a-a169-b6e353567ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:43.320281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ea735-61b2-471a-a169-b6e353567ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:43.320564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ea735-61b2-471a-a169-b6e353567ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:43.321464 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ea735-61b2-471a-a169-b6e353567ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:43.322954 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ea735-61b2-471a-a169-b6e353567ac3 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:43.341511 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-f262821a-c077-43a2-b93f-a809000229bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45654097b7564395bd5bb08141833d76'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:43.361725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-f262821a-c077-43a2-b93f-a809000229bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45654097b7564395bd5bb08141833d76'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:43.362204 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1114/2236] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:43.363267 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ea735-61b2-471a-a169-b6e353567ac3 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:43.365572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-185ea735-61b2-471a-a169-b6e353567ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:43.378091 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-f262821a-c077-43a2-b93f-a809000229bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45654097b7564395bd5bb08141833d76'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:43.379172 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-f262821a-c077-43a2-b93f-a809000229bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45654097b7564395bd5bb08141833d76'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:43.379949 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-f262821a-c077-43a2-b93f-a809000229bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45654097b7564395bd5bb08141833d76'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:43.382066 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ea735-61b2-471a-a169-b6e353567ac3 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:43.387283 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8d486-306e-4a40-b1ab-f83cdcb4c3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:43.388982 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8d486-306e-4a40-b1ab-f83cdcb4c3b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:43.389261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8d486-306e-4a40-b1ab-f83cdcb4c3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:43.389544 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8d486-306e-4a40-b1ab-f83cdcb4c3b9 admin admin] PATH_INFO: `/v3/projects/6ce09a39b27f43df9e05abe8ae94e8a0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:43.390876 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8d486-306e-4a40-b1ab-f83cdcb4c3b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ce09a39b27f43df9e05abe8ae94e8a0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:43.394656 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8d486-306e-4a40-b1ab-f83cdcb4c3b9 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:43.401427 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1123/2237] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:43 2022] DELETE /identity/v3/users/45654097b7564395bd5bb08141833d76 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:33:43.403051 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262821a-c077-43a2-b93f-a809000229bd admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:43.404866 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-f262821a-c077-43a2-b93f-a809000229bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:43.463583 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:43.499296 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-16b8d486-306e-4a40-b1ab-f83cdcb4c3b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ce09a39b27f43df9e05abe8ae94e8a0', 'request_id': 'req-16b8d486-306e-4a40-b1ab-f83cdcb4c3b9'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:43.510553 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-16b8d486-306e-4a40-b1ab-f83cdcb4c3b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ce09a39b27f43df9e05abe8ae94e8a0', 'request_id': 'req-16b8d486-306e-4a40-b1ab-f83cdcb4c3b9'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:43.524521 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-16b8d486-306e-4a40-b1ab-f83cdcb4c3b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ce09a39b27f43df9e05abe8ae94e8a0', 'request_id': 'req-16b8d486-306e-4a40-b1ab-f83cdcb4c3b9'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:43.533574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262821a-c077-43a2-b93f-a809000229bd admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:43.546811 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-16b8d486-306e-4a40-b1ab-f83cdcb4c3b9 admin admin] The token cache is being invalidate because project 6ce09a39b27f43df9e05abe8ae94e8a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:43.547983 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-16b8d486-306e-4a40-b1ab-f83cdcb4c3b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:43.549081 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-16b8d486-306e-4a40-b1ab-f83cdcb4c3b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:43.557415 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1115/2238] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:43 2022] DELETE /identity/v3/projects/6ce09a39b27f43df9e05abe8ae94e8a0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:43.559103 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8d486-306e-4a40-b1ab-f83cdcb4c3b9 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:43.561789 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-16b8d486-306e-4a40-b1ab-f83cdcb4c3b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:43.639605 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072baf4-2c81-4643-b1cd-4574bb9b62ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:43.640847 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072baf4-2c81-4643-b1cd-4574bb9b62ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:43.641757 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072baf4-2c81-4643-b1cd-4574bb9b62ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:43.642101 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072baf4-2c81-4643-b1cd-4574bb9b62ce admin admin] PATH_INFO: `/v3/projects/b4b6d64cd25d422595cd505f3fee3ec1/users/2fe0157aaa864183851332247f7c6275/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:43.668260 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072baf4-2c81-4643-b1cd-4574bb9b62ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b6d64cd25d422595cd505f3fee3ec1, user_id=2fe0157aaa864183851332247f7c6275, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:43.671124 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072baf4-2c81-4643-b1cd-4574bb9b62ce admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:43.694610 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8d486-306e-4a40-b1ab-f83cdcb4c3b9 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:43.705097 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1124/2239] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:43 2022] PUT /identity/v3/projects/b4b6d64cd25d422595cd505f3fee3ec1/users/2fe0157aaa864183851332247f7c6275/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:43.705097 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072baf4-2c81-4643-b1cd-4574bb9b62ce admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:43.706623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-f072baf4-2c81-4643-b1cd-4574bb9b62ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:43.806170 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:43.826333 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072baf4-2c81-4643-b1cd-4574bb9b62ce admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:43.826666 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c033ed-9abb-4402-99f9-5550efd1a53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:43.827651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c033ed-9abb-4402-99f9-5550efd1a53f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:43.827942 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c033ed-9abb-4402-99f9-5550efd1a53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:43.828223 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c033ed-9abb-4402-99f9-5550efd1a53f admin admin] PATH_INFO: `/v3/users/cea9001fccb74bb4bdc2e780f4037a9c` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:43.830642 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c033ed-9abb-4402-99f9-5550efd1a53f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cea9001fccb74bb4bdc2e780f4037a9c)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:43.841023 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c033ed-9abb-4402-99f9-5550efd1a53f admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:43.841231 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7416a0-8240-4996-92fd-3254d2f2db67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:43.841887 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7416a0-8240-4996-92fd-3254d2f2db67 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:43.842197 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7416a0-8240-4996-92fd-3254d2f2db67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:43.842642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7416a0-8240-4996-92fd-3254d2f2db67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:43.843469 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7416a0-8240-4996-92fd-3254d2f2db67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:43.845286 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7416a0-8240-4996-92fd-3254d2f2db67 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:43.858178 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1125/2240] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:43.863445 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7416a0-8240-4996-92fd-3254d2f2db67 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:43.877431 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7416a0-8240-4996-92fd-3254d2f2db67 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:43.886052 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03047b08-1633-4d4b-8e93-48c484ff875f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:43.887182 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03047b08-1633-4d4b-8e93-48c484ff875f admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:43.887520 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03047b08-1633-4d4b-8e93-48c484ff875f admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:43.887807 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03047b08-1633-4d4b-8e93-48c484ff875f admin admin] PATH_INFO: `/v3/projects/b4b6d64cd25d422595cd505f3fee3ec1/users/2fe0157aaa864183851332247f7c6275/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:43.891448 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03047b08-1633-4d4b-8e93-48c484ff875f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b6d64cd25d422595cd505f3fee3ec1, user_id=2fe0157aaa864183851332247f7c6275, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:43.894250 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03047b08-1633-4d4b-8e93-48c484ff875f admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:43.921197 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1126/2241] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:43 2022] PUT /identity/v3/projects/b4b6d64cd25d422595cd505f3fee3ec1/users/2fe0157aaa864183851332247f7c6275/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:43.923661 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9fb51-effe-4e01-8cd1-7a36996130c6 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:43.923661 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9fb51-effe-4e01-8cd1-7a36996130c6 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:43.923928 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9fb51-effe-4e01-8cd1-7a36996130c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:43.949061 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-e6c033ed-9abb-4402-99f9-5550efd1a53f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cea9001fccb74bb4bdc2e780f4037a9c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:43.968214 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-e6c033ed-9abb-4402-99f9-5550efd1a53f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cea9001fccb74bb4bdc2e780f4037a9c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:43.974335 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-24c9fb51-effe-4e01-8cd1-7a36996130c6 None None] MFA Rules not processed for user `2fe0157aaa864183851332247f7c6275`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:43.975766 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-24c9fb51-effe-4e01-8cd1-7a36996130c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:43.979400 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-e6c033ed-9abb-4402-99f9-5550efd1a53f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cea9001fccb74bb4bdc2e780f4037a9c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:43.980440 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-e6c033ed-9abb-4402-99f9-5550efd1a53f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cea9001fccb74bb4bdc2e780f4037a9c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:43.981868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-e6c033ed-9abb-4402-99f9-5550efd1a53f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cea9001fccb74bb4bdc2e780f4037a9c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:44.005988 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1116/2242] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:43 2022] DELETE /identity/v3/users/cea9001fccb74bb4bdc2e780f4037a9c => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:44.014078 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:44.060006 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c033ed-9abb-4402-99f9-5550efd1a53f admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:44.061553 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-e6c033ed-9abb-4402-99f9-5550efd1a53f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:44.085488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1127/2243] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:44.097251 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9fb51-effe-4e01-8cd1-7a36996130c6 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:44.098743 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-24c9fb51-effe-4e01-8cd1-7a36996130c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:44.179181 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c033ed-9abb-4402-99f9-5550efd1a53f admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:44.180007 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9fb51-effe-4e01-8cd1-7a36996130c6 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:44.185145 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803628a-cd63-4abd-8267-432c0fb38c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:44.186380 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803628a-cd63-4abd-8267-432c0fb38c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:44.186816 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803628a-cd63-4abd-8267-432c0fb38c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:44.187257 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803628a-cd63-4abd-8267-432c0fb38c90 admin admin] PATH_INFO: `/v3/projects/310301fc13b2472bb2cca80c39e67a7e` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:44.189757 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803628a-cd63-4abd-8267-432c0fb38c90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=310301fc13b2472bb2cca80c39e67a7e)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:44.192199 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803628a-cd63-4abd-8267-432c0fb38c90 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:44.252755 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820572e-ba2b-4f2d-acf1-f462efe46365 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:44.253505 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820572e-ba2b-4f2d-acf1-f462efe46365 service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:44.254122 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820572e-ba2b-4f2d-acf1-f462efe46365 service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:44.254265 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820572e-ba2b-4f2d-acf1-f462efe46365 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:44.278677 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-1803628a-cd63-4abd-8267-432c0fb38c90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '310301fc13b2472bb2cca80c39e67a7e', 'request_id': 'req-1803628a-cd63-4abd-8267-432c0fb38c90'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:44.286507 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-1803628a-cd63-4abd-8267-432c0fb38c90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '310301fc13b2472bb2cca80c39e67a7e', 'request_id': 'req-1803628a-cd63-4abd-8267-432c0fb38c90'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:44.298055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-1803628a-cd63-4abd-8267-432c0fb38c90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '310301fc13b2472bb2cca80c39e67a7e', 'request_id': 'req-1803628a-cd63-4abd-8267-432c0fb38c90'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:44.309019 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:44.315974 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-1803628a-cd63-4abd-8267-432c0fb38c90 admin admin] The token cache is being invalidate because project 310301fc13b2472bb2cca80c39e67a7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:44.317144 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-1803628a-cd63-4abd-8267-432c0fb38c90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:44.318637 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-1803628a-cd63-4abd-8267-432c0fb38c90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:44.323328 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1117/2244] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:44 2022] DELETE /identity/v3/projects/310301fc13b2472bb2cca80c39e67a7e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:33:44.334155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820572e-ba2b-4f2d-acf1-f462efe46365 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:44.335971 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820572e-ba2b-4f2d-acf1-f462efe46365 service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:44.355470 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1128/2245] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:33:44.406959 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803628a-cd63-4abd-8267-432c0fb38c90 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:44.412146 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-1803628a-cd63-4abd-8267-432c0fb38c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:44.538784 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803628a-cd63-4abd-8267-432c0fb38c90 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:44.543985 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9f725-8e60-424f-b0ba-2cc2c0d76d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:44.545057 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9f725-8e60-424f-b0ba-2cc2c0d76d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:44.545453 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9f725-8e60-424f-b0ba-2cc2c0d76d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:44.546117 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9f725-8e60-424f-b0ba-2cc2c0d76d66 admin admin] PATH_INFO: `/v3/projects/67c6cd1b081e49af82b2c001537a6a9f` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:44.549200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9f725-8e60-424f-b0ba-2cc2c0d76d66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67c6cd1b081e49af82b2c001537a6a9f)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:44.551801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9f725-8e60-424f-b0ba-2cc2c0d76d66 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:44.576385 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820572e-ba2b-4f2d-acf1-f462efe46365 service cinder] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:44.577917 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-c820572e-ba2b-4f2d-acf1-f462efe46365 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:44.597547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820572e-ba2b-4f2d-acf1-f462efe46365 service cinder] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:44.604169 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628e5be-ff00-4776-a3ce-4d4468b20245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:44.605319 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628e5be-ff00-4776-a3ce-4d4468b20245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:44.605613 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628e5be-ff00-4776-a3ce-4d4468b20245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:44.605890 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628e5be-ff00-4776-a3ce-4d4468b20245 admin admin] PATH_INFO: `/v3/users/571414daf30540c9a0ec35c99d309826` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:44.607715 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628e5be-ff00-4776-a3ce-4d4468b20245 admin admin] RBAC: Authorizing `identity:delete_user(user_id=571414daf30540c9a0ec35c99d309826)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:44.610308 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628e5be-ff00-4776-a3ce-4d4468b20245 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:44.627572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-05b9f725-8e60-424f-b0ba-2cc2c0d76d66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67c6cd1b081e49af82b2c001537a6a9f', 'request_id': 'req-05b9f725-8e60-424f-b0ba-2cc2c0d76d66'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:44.638511 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-05b9f725-8e60-424f-b0ba-2cc2c0d76d66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67c6cd1b081e49af82b2c001537a6a9f', 'request_id': 'req-05b9f725-8e60-424f-b0ba-2cc2c0d76d66'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:44.648717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:44.655779 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-05b9f725-8e60-424f-b0ba-2cc2c0d76d66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67c6cd1b081e49af82b2c001537a6a9f', 'request_id': 'req-05b9f725-8e60-424f-b0ba-2cc2c0d76d66'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:44.675824 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-05b9f725-8e60-424f-b0ba-2cc2c0d76d66 admin admin] The token cache is being invalidate because project 67c6cd1b081e49af82b2c001537a6a9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:44.676122 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-05b9f725-8e60-424f-b0ba-2cc2c0d76d66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:44.676798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-05b9f725-8e60-424f-b0ba-2cc2c0d76d66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:44.678400 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1118/2246] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:44 2022] DELETE /identity/v3/projects/67c6cd1b081e49af82b2c001537a6a9f => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:44.683451 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f8266-1b7c-4663-9eec-29a000ea2f6f None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:44.683746 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f8266-1b7c-4663-9eec-29a000ea2f6f None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:44.684034 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f8266-1b7c-4663-9eec-29a000ea2f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:44.689296 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-7628e5be-ff00-4776-a3ce-4d4468b20245 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '571414daf30540c9a0ec35c99d309826'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:44.705930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-7628e5be-ff00-4776-a3ce-4d4468b20245 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '571414daf30540c9a0ec35c99d309826'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:44.710870 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-b43f8266-1b7c-4663-9eec-29a000ea2f6f None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:44.713854 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-b43f8266-1b7c-4663-9eec-29a000ea2f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:44.722626 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-7628e5be-ff00-4776-a3ce-4d4468b20245 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '571414daf30540c9a0ec35c99d309826'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:44.724446 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-7628e5be-ff00-4776-a3ce-4d4468b20245 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '571414daf30540c9a0ec35c99d309826'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:44.725093 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-7628e5be-ff00-4776-a3ce-4d4468b20245 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '571414daf30540c9a0ec35c99d309826'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:44.752461 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1129/2247] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:44 2022] DELETE /identity/v3/users/571414daf30540c9a0ec35c99d309826 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:44.757709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea23d55-574b-45ce-9062-13f4c22ff5e2 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:44.758410 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea23d55-574b-45ce-9062-13f4c22ff5e2 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:44.758893 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea23d55-574b-45ce-9062-13f4c22ff5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:44.783075 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-2ea23d55-574b-45ce-9062-13f4c22ff5e2 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:44.787739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-2ea23d55-574b-45ce-9062-13f4c22ff5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:44.815645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1119/2248] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:33:44.823017 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5af653-c27d-465f-bd03-f08f4fd161a3 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:44.823308 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5af653-c27d-465f-bd03-f08f4fd161a3 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:44.823629 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5af653-c27d-465f-bd03-f08f4fd161a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:44.855276 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-1a5af653-c27d-465f-bd03-f08f4fd161a3 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:44.857087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-1a5af653-c27d-465f-bd03-f08f4fd161a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:44.881446 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1130/2249] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:33:44.887060 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:44.893006 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea23d55-574b-45ce-9062-13f4c22ff5e2 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:44.895369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-2ea23d55-574b-45ce-9062-13f4c22ff5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:44.934846 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1120/2250] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:33:44.939206 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5af653-c27d-465f-bd03-f08f4fd161a3 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:44.949191 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5af653-c27d-465f-bd03-f08f4fd161a3 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:44.954833 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678a382-2d75-417b-80df-3171dc706c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:44.955552 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678a382-2d75-417b-80df-3171dc706c63 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:44.955841 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678a382-2d75-417b-80df-3171dc706c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:44.956120 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678a382-2d75-417b-80df-3171dc706c63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:44.956861 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678a382-2d75-417b-80df-3171dc706c63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:44.957294 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678a382-2d75-417b-80df-3171dc706c63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:44.958926 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678a382-2d75-417b-80df-3171dc706c63 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:44.967725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea23d55-574b-45ce-9062-13f4c22ff5e2 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:44.973203 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43cb3d-313c-46ae-9a53-73f144b0a799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:44.973889 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43cb3d-313c-46ae-9a53-73f144b0a799 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:44.974164 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43cb3d-313c-46ae-9a53-73f144b0a799 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:44.974441 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43cb3d-313c-46ae-9a53-73f144b0a799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:44.975615 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1121/2251] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:44.978988 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678a382-2d75-417b-80df-3171dc706c63 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:44.986239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43cb3d-313c-46ae-9a53-73f144b0a799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:44.987633 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43cb3d-313c-46ae-9a53-73f144b0a799 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:44.990539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678a382-2d75-417b-80df-3171dc706c63 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:44.996935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642501b-a662-4007-b297-1d267c6f08e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:44.997249 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642501b-a662-4007-b297-1d267c6f08e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:44.997536 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642501b-a662-4007-b297-1d267c6f08e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:44.997853 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642501b-a662-4007-b297-1d267c6f08e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:44.999961 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1131/2252] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:33:45.000124 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642501b-a662-4007-b297-1d267c6f08e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:45.002419 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642501b-a662-4007-b297-1d267c6f08e7 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:45.032360 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1122/2253] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:33:44 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:45.038493 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43cb3d-313c-46ae-9a53-73f144b0a799 service neutron] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:45.051372 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43cb3d-313c-46ae-9a53-73f144b0a799 service neutron] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:45.117493 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:45.137465 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9831f2-056d-441d-9ad1-3a18b2ac257f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:45.138173 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9831f2-056d-441d-9ad1-3a18b2ac257f admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:45.138461 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9831f2-056d-441d-9ad1-3a18b2ac257f admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:45.138749 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9831f2-056d-441d-9ad1-3a18b2ac257f admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:45.139542 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9831f2-056d-441d-9ad1-3a18b2ac257f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:45.141561 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9831f2-056d-441d-9ad1-3a18b2ac257f admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:45.166265 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1132/2254] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:33:45 2022] POST /identity/v3/users => generated 284 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:45.170441 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642501b-a662-4007-b297-1d267c6f08e7 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:45.205395 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642501b-a662-4007-b297-1d267c6f08e7 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:45.214326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70770e-c456-4cb7-9b39-6b2e0595ed0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:45.215633 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70770e-c456-4cb7-9b39-6b2e0595ed0a admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:45.216168 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70770e-c456-4cb7-9b39-6b2e0595ed0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:45.216668 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70770e-c456-4cb7-9b39-6b2e0595ed0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:45.217688 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70770e-c456-4cb7-9b39-6b2e0595ed0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:45.219733 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70770e-c456-4cb7-9b39-6b2e0595ed0a admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:45.233744 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1123/2255] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:33:45.238721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9831f2-056d-441d-9ad1-3a18b2ac257f admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:45.254286 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9831f2-056d-441d-9ad1-3a18b2ac257f admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:45.260426 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2b178-0e4e-4dfd-b9b7-8e07d1a2b5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:45.261174 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2b178-0e4e-4dfd-b9b7-8e07d1a2b5b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:45.262440 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2b178-0e4e-4dfd-b9b7-8e07d1a2b5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:45.262736 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2b178-0e4e-4dfd-b9b7-8e07d1a2b5b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:45.263753 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2b178-0e4e-4dfd-b9b7-8e07d1a2b5b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:45.265433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2b178-0e4e-4dfd-b9b7-8e07d1a2b5b6 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:45.286042 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1133/2256] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:45.286703 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70770e-c456-4cb7-9b39-6b2e0595ed0a admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:45.317187 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70770e-c456-4cb7-9b39-6b2e0595ed0a admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:45.345426 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47463c-35fc-4165-b5f2-7ea88764d4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:45.346758 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47463c-35fc-4165-b5f2-7ea88764d4a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:45.347426 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47463c-35fc-4165-b5f2-7ea88764d4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:45.347912 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47463c-35fc-4165-b5f2-7ea88764d4a0 admin admin] PATH_INFO: `/v3/projects/47a9b9855112442aab701701134b34d8/users/18629b89d83b4c1aae4a22443c5e132a/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:45.369912 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47463c-35fc-4165-b5f2-7ea88764d4a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47a9b9855112442aab701701134b34d8, user_id=18629b89d83b4c1aae4a22443c5e132a, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:45.372990 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47463c-35fc-4165-b5f2-7ea88764d4a0 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:45.389683 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1124/2257] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:45 2022] PUT /identity/v3/projects/47a9b9855112442aab701701134b34d8/users/18629b89d83b4c1aae4a22443c5e132a/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:45.466699 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf76e3-7cad-4d9d-be1c-b9dfe23cb4f8 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:45.467048 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf76e3-7cad-4d9d-be1c-b9dfe23cb4f8 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:45.467362 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf76e3-7cad-4d9d-be1c-b9dfe23cb4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:45.503770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-1adf76e3-7cad-4d9d-be1c-b9dfe23cb4f8 None None] MFA Rules not processed for user `18629b89d83b4c1aae4a22443c5e132a`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:45.505504 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-1adf76e3-7cad-4d9d-be1c-b9dfe23cb4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:45.576414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47463c-35fc-4165-b5f2-7ea88764d4a0 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:45.578392 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-2a47463c-35fc-4165-b5f2-7ea88764d4a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:45.624249 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1134/2258] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:45 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:33:45.631665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf76e3-7cad-4d9d-be1c-b9dfe23cb4f8 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:45.637270 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-1adf76e3-7cad-4d9d-be1c-b9dfe23cb4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:45.707043 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47463c-35fc-4165-b5f2-7ea88764d4a0 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:45.720631 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fd283-a97f-4ded-830b-548eea847179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:45.722322 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fd283-a97f-4ded-830b-548eea847179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:45.722921 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fd283-a97f-4ded-830b-548eea847179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:45.723523 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fd283-a97f-4ded-830b-548eea847179 admin admin] PATH_INFO: `/v3/projects/4c157e58a3624f77a054102c7f0ea7fd` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:45.726321 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fd283-a97f-4ded-830b-548eea847179 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c157e58a3624f77a054102c7f0ea7fd)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:45.730579 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fd283-a97f-4ded-830b-548eea847179 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:45.779911 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf76e3-7cad-4d9d-be1c-b9dfe23cb4f8 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:45.794329 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6153adf-4f35-4d4e-9ff3-4b7466f861db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e66abbda1744a71b4d26677dcef76be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:45.795014 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6153adf-4f35-4d4e-9ff3-4b7466f861db service glance] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:45.795325 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6153adf-4f35-4d4e-9ff3-4b7466f861db service glance] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:45.795605 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6153adf-4f35-4d4e-9ff3-4b7466f861db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:45.809245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6153adf-4f35-4d4e-9ff3-4b7466f861db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:45.811043 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6153adf-4f35-4d4e-9ff3-4b7466f861db service glance] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:45.837273 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1135/2259] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:45 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:33:45.842374 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-466fd283-a97f-4ded-830b-548eea847179 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c157e58a3624f77a054102c7f0ea7fd', 'request_id': 'req-466fd283-a97f-4ded-830b-548eea847179'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:45.850081 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-466fd283-a97f-4ded-830b-548eea847179 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c157e58a3624f77a054102c7f0ea7fd', 'request_id': 'req-466fd283-a97f-4ded-830b-548eea847179'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:45.874722 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-466fd283-a97f-4ded-830b-548eea847179 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c157e58a3624f77a054102c7f0ea7fd', 'request_id': 'req-466fd283-a97f-4ded-830b-548eea847179'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:45.880510 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:45.893841 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-466fd283-a97f-4ded-830b-548eea847179 admin admin] The token cache is being invalidate because project 4c157e58a3624f77a054102c7f0ea7fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:45.894282 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-466fd283-a97f-4ded-830b-548eea847179 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:45.895768 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-466fd283-a97f-4ded-830b-548eea847179 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:45.898282 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1125/2260] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:45 2022] DELETE /identity/v3/projects/4c157e58a3624f77a054102c7f0ea7fd => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:45.902328 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6153adf-4f35-4d4e-9ff3-4b7466f861db service glance] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:45.917593 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6153adf-4f35-4d4e-9ff3-4b7466f861db service glance] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:45.970768 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:45.998536 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89076bf6-c533-43c5-b26e-28a65a2868f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:45.999474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89076bf6-c533-43c5-b26e-28a65a2868f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:45.999768 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89076bf6-c533-43c5-b26e-28a65a2868f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:46.000168 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89076bf6-c533-43c5-b26e-28a65a2868f5 admin admin] PATH_INFO: `/v3/users/2fe0157aaa864183851332247f7c6275` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:46.001504 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89076bf6-c533-43c5-b26e-28a65a2868f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fe0157aaa864183851332247f7c6275)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:46.003663 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89076bf6-c533-43c5-b26e-28a65a2868f5 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:46.086389 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-89076bf6-c533-43c5-b26e-28a65a2868f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fe0157aaa864183851332247f7c6275'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:46.103548 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-89076bf6-c533-43c5-b26e-28a65a2868f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fe0157aaa864183851332247f7c6275'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:46.112439 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-89076bf6-c533-43c5-b26e-28a65a2868f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fe0157aaa864183851332247f7c6275'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:46.113287 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-89076bf6-c533-43c5-b26e-28a65a2868f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fe0157aaa864183851332247f7c6275'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:46.113992 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-89076bf6-c533-43c5-b26e-28a65a2868f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fe0157aaa864183851332247f7c6275'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:46.141909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1136/2261] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:45 2022] DELETE /identity/v3/users/2fe0157aaa864183851332247f7c6275 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:47.006952 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fd283-a97f-4ded-830b-548eea847179 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:47.008956 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-466fd283-a97f-4ded-830b-548eea847179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:47.025868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fd283-a97f-4ded-830b-548eea847179 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:47.130080 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301c5c4-413b-4658-831c-1bda238c266f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:47.131027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301c5c4-413b-4658-831c-1bda238c266f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:47.131352 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301c5c4-413b-4658-831c-1bda238c266f admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:47.131639 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301c5c4-413b-4658-831c-1bda238c266f admin admin] PATH_INFO: `/v3/projects/b4b6d64cd25d422595cd505f3fee3ec1` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:47.132935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f301c5c4-413b-4658-831c-1bda238c266f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4b6d64cd25d422595cd505f3fee3ec1)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:47.134912 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f301c5c4-413b-4658-831c-1bda238c266f admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:47.210719 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-f301c5c4-413b-4658-831c-1bda238c266f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4b6d64cd25d422595cd505f3fee3ec1', 'request_id': 'req-f301c5c4-413b-4658-831c-1bda238c266f'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:47.217675 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-f301c5c4-413b-4658-831c-1bda238c266f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4b6d64cd25d422595cd505f3fee3ec1', 'request_id': 'req-f301c5c4-413b-4658-831c-1bda238c266f'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:47.225255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-f301c5c4-413b-4658-831c-1bda238c266f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4b6d64cd25d422595cd505f3fee3ec1', 'request_id': 'req-f301c5c4-413b-4658-831c-1bda238c266f'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:47.238495 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-f301c5c4-413b-4658-831c-1bda238c266f admin admin] The token cache is being invalidate because project b4b6d64cd25d422595cd505f3fee3ec1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:47.238800 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-f301c5c4-413b-4658-831c-1bda238c266f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:47.239520 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-f301c5c4-413b-4658-831c-1bda238c266f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:47.241119 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1126/2262] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:47 2022] DELETE /identity/v3/projects/b4b6d64cd25d422595cd505f3fee3ec1 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:47.246404 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dba26-3a95-4485-8166-eb5f8a90d9cc None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:47.246930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dba26-3a95-4485-8166-eb5f8a90d9cc None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:47.247050 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dba26-3a95-4485-8166-eb5f8a90d9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:47.267890 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-0c4dba26-3a95-4485-8166-eb5f8a90d9cc None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:47.270726 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-0c4dba26-3a95-4485-8166-eb5f8a90d9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:47.345002 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1137/2263] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:47.354073 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db769c-f985-4522-8f60-38be47ad7387 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:47.354371 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db769c-f985-4522-8f60-38be47ad7387 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:47.354673 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db769c-f985-4522-8f60-38be47ad7387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:47.376411 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-b5db769c-f985-4522-8f60-38be47ad7387 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:47.377644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-b5db769c-f985-4522-8f60-38be47ad7387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:47.385825 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1127/2264] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:47.390251 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dba26-3a95-4485-8166-eb5f8a90d9cc None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:47.400376 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dba26-3a95-4485-8166-eb5f8a90d9cc None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:47.404970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d0eb7-fd4b-4362-b83f-a342be2af55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:47.405709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d0eb7-fd4b-4362-b83f-a342be2af55c admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:47.405986 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d0eb7-fd4b-4362-b83f-a342be2af55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:47.406262 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d0eb7-fd4b-4362-b83f-a342be2af55c admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:47.407057 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d0eb7-fd4b-4362-b83f-a342be2af55c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:47.407403 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d0eb7-fd4b-4362-b83f-a342be2af55c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:47.408978 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d0eb7-fd4b-4362-b83f-a342be2af55c admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:47.422775 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1138/2265] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:33:47.427286 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db769c-f985-4522-8f60-38be47ad7387 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:47.436863 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db769c-f985-4522-8f60-38be47ad7387 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:47.442111 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207f3b5-f557-42e6-a7c9-734df7771e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:47.442770 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207f3b5-f557-42e6-a7c9-734df7771e84 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:47.443057 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207f3b5-f557-42e6-a7c9-734df7771e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:47.443376 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207f3b5-f557-42e6-a7c9-734df7771e84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:47.444090 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207f3b5-f557-42e6-a7c9-734df7771e84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:47.445995 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207f3b5-f557-42e6-a7c9-734df7771e84 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:47.476914 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1128/2266] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:33:47 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:47.481181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d0eb7-fd4b-4362-b83f-a342be2af55c admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:47.492441 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d0eb7-fd4b-4362-b83f-a342be2af55c admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:47.546722 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:47.588923 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94340e30-ae91-46b5-916c-fb91e5975835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:47.589623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94340e30-ae91-46b5-916c-fb91e5975835 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:47.589915 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94340e30-ae91-46b5-916c-fb91e5975835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:47.590200 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94340e30-ae91-46b5-916c-fb91e5975835 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:47.590931 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94340e30-ae91-46b5-916c-fb91e5975835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:47.593163 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94340e30-ae91-46b5-916c-fb91e5975835 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:47.631560 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1139/2267] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:33:47 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:33:47.631760 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207f3b5-f557-42e6-a7c9-734df7771e84 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:47.646877 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207f3b5-f557-42e6-a7c9-734df7771e84 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:47.654066 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8bd50-95ac-499b-a6f1-9195f8aad68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:47.655319 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8bd50-95ac-499b-a6f1-9195f8aad68c admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:47.655319 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8bd50-95ac-499b-a6f1-9195f8aad68c admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:47.656318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8bd50-95ac-499b-a6f1-9195f8aad68c admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:47.658609 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8bd50-95ac-499b-a6f1-9195f8aad68c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:47.660766 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8bd50-95ac-499b-a6f1-9195f8aad68c admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:47.680033 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94340e30-ae91-46b5-916c-fb91e5975835 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:47.690112 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1129/2268] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:47.704735 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94340e30-ae91-46b5-916c-fb91e5975835 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:47.724182 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3db3d-6791-4704-8a0d-2e8aa0025b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:47.725144 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3db3d-6791-4704-8a0d-2e8aa0025b32 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:47.725590 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3db3d-6791-4704-8a0d-2e8aa0025b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:47.726069 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3db3d-6791-4704-8a0d-2e8aa0025b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:47.727086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3db3d-6791-4704-8a0d-2e8aa0025b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:47.740493 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3db3d-6791-4704-8a0d-2e8aa0025b32 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:47.763714 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1140/2269] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:47.764642 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8bd50-95ac-499b-a6f1-9195f8aad68c admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:47.782179 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8bd50-95ac-499b-a6f1-9195f8aad68c admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:47.785531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155cdc83-62d8-4b73-9d80-3d79c2dcb914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:47.785531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cdc83-62d8-4b73-9d80-3d79c2dcb914 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:47.785531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cdc83-62d8-4b73-9d80-3d79c2dcb914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:47.785531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cdc83-62d8-4b73-9d80-3d79c2dcb914 admin admin] PATH_INFO: `/v3/projects/aec5ab0d52df4e858935f6637078cccb/users/e89ccd91e9294b6ba790d0794d5ec149/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:47.803963 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155cdc83-62d8-4b73-9d80-3d79c2dcb914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aec5ab0d52df4e858935f6637078cccb, user_id=e89ccd91e9294b6ba790d0794d5ec149, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:47.806882 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155cdc83-62d8-4b73-9d80-3d79c2dcb914 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:47.837256 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1130/2270] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:47 2022] PUT /identity/v3/projects/aec5ab0d52df4e858935f6637078cccb/users/e89ccd91e9294b6ba790d0794d5ec149/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:33:47.843248 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee73560-198c-4201-bbf2-70a68c44a223 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:47.844616 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee73560-198c-4201-bbf2-70a68c44a223 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:47.844616 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee73560-198c-4201-bbf2-70a68c44a223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:47.878875 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-8ee73560-198c-4201-bbf2-70a68c44a223 None None] MFA Rules not processed for user `e89ccd91e9294b6ba790d0794d5ec149`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:47.880218 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-8ee73560-198c-4201-bbf2-70a68c44a223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:48.014398 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1141/2271] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:48.020754 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155cdc83-62d8-4b73-9d80-3d79c2dcb914 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:48.046652 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:48.098545 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155cdc83-62d8-4b73-9d80-3d79c2dcb914 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:48.104094 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7340f0-b88c-40ba-a44c-d6070423c321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:48.104871 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7340f0-b88c-40ba-a44c-d6070423c321 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:48.105164 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7340f0-b88c-40ba-a44c-d6070423c321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:48.105515 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7340f0-b88c-40ba-a44c-d6070423c321 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:48.106328 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7340f0-b88c-40ba-a44c-d6070423c321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:48.108322 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7340f0-b88c-40ba-a44c-d6070423c321 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:48.134633 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1131/2272] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:33:48 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:48.139112 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee73560-198c-4201-bbf2-70a68c44a223 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:48.151024 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee73560-198c-4201-bbf2-70a68c44a223 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:48.215460 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949f781-051f-4d7b-9336-df97f351a72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:48.216606 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949f781-051f-4d7b-9336-df97f351a72d admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:48.216905 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949f781-051f-4d7b-9336-df97f351a72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:48.217178 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949f781-051f-4d7b-9336-df97f351a72d admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:48.217894 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949f781-051f-4d7b-9336-df97f351a72d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:48.220585 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949f781-051f-4d7b-9336-df97f351a72d admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:48.244069 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1142/2273] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:33:48 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:48.248199 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7340f0-b88c-40ba-a44c-d6070423c321 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:48.259003 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7340f0-b88c-40ba-a44c-d6070423c321 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:48.263833 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96acbd-6023-4e21-a15f-95d79bb91258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:48.264501 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96acbd-6023-4e21-a15f-95d79bb91258 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:48.264783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96acbd-6023-4e21-a15f-95d79bb91258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:48.265061 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96acbd-6023-4e21-a15f-95d79bb91258 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:48.265799 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96acbd-6023-4e21-a15f-95d79bb91258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:48.268004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96acbd-6023-4e21-a15f-95d79bb91258 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:48.282746 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1132/2274] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:48.287630 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949f781-051f-4d7b-9336-df97f351a72d admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:48.298709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949f781-051f-4d7b-9336-df97f351a72d admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:48.303672 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932f938-ce04-47b4-aceb-c85dd2c015a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:48.304358 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932f938-ce04-47b4-aceb-c85dd2c015a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:48.304646 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932f938-ce04-47b4-aceb-c85dd2c015a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:48.304930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932f938-ce04-47b4-aceb-c85dd2c015a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:48.305678 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932f938-ce04-47b4-aceb-c85dd2c015a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:48.307323 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932f938-ce04-47b4-aceb-c85dd2c015a7 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:48.322054 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1143/2275] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:48.323267 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96acbd-6023-4e21-a15f-95d79bb91258 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:48.336952 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96acbd-6023-4e21-a15f-95d79bb91258 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:48.341942 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b9371-f3ab-43c1-9ef6-d7c92a9489ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:48.342837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b9371-f3ab-43c1-9ef6-d7c92a9489ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:48.343148 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b9371-f3ab-43c1-9ef6-d7c92a9489ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:48.343610 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b9371-f3ab-43c1-9ef6-d7c92a9489ff admin admin] PATH_INFO: `/v3/projects/99b67b93ddbe4bb6871bc5ab1fae7193/users/48ebae16da3842a9983d207babbfbb6b/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:48.363543 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b9371-f3ab-43c1-9ef6-d7c92a9489ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b67b93ddbe4bb6871bc5ab1fae7193, user_id=48ebae16da3842a9983d207babbfbb6b, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:48.366215 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b9371-f3ab-43c1-9ef6-d7c92a9489ff admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:48.382550 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1133/2276] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:48 2022] PUT /identity/v3/projects/99b67b93ddbe4bb6871bc5ab1fae7193/users/48ebae16da3842a9983d207babbfbb6b/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:48.394761 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2027b03-c617-491b-b49d-2022e35187f5 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:48.395061 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2027b03-c617-491b-b49d-2022e35187f5 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:48.395385 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2027b03-c617-491b-b49d-2022e35187f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:48.427064 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-e2027b03-c617-491b-b49d-2022e35187f5 None None] MFA Rules not processed for user `48ebae16da3842a9983d207babbfbb6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:48.429353 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-e2027b03-c617-491b-b49d-2022e35187f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:48.453183 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:48.542088 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1144/2277] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:48.547898 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b9371-f3ab-43c1-9ef6-d7c92a9489ff admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:48.618891 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b9371-f3ab-43c1-9ef6-d7c92a9489ff admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:48.624498 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e72fc-b891-45c1-84fd-a4a7f1e6061d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:48.625196 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e72fc-b891-45c1-84fd-a4a7f1e6061d admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:48.625485 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e72fc-b891-45c1-84fd-a4a7f1e6061d admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:48.625777 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e72fc-b891-45c1-84fd-a4a7f1e6061d admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:48.626490 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e72fc-b891-45c1-84fd-a4a7f1e6061d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:48.628454 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e72fc-b891-45c1-84fd-a4a7f1e6061d admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:48.664600 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1134/2278] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:33:48 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:48.666855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2027b03-c617-491b-b49d-2022e35187f5 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:48.679074 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2027b03-c617-491b-b49d-2022e35187f5 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:48.746360 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853f297-d2c5-4ba6-b445-20fd7959a2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:48.747041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853f297-d2c5-4ba6-b445-20fd7959a2e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:48.747372 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853f297-d2c5-4ba6-b445-20fd7959a2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:48.747655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853f297-d2c5-4ba6-b445-20fd7959a2e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:48.748375 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853f297-d2c5-4ba6-b445-20fd7959a2e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:48.750368 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853f297-d2c5-4ba6-b445-20fd7959a2e8 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:48.775541 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1145/2279] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:33:48 2022] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:48.779850 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e72fc-b891-45c1-84fd-a4a7f1e6061d admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:48.792347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e72fc-b891-45c1-84fd-a4a7f1e6061d admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:48.798758 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e1dc3-bf1b-4fa3-a5db-03a3dec585b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:48.799962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e1dc3-bf1b-4fa3-a5db-03a3dec585b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:48.800348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e1dc3-bf1b-4fa3-a5db-03a3dec585b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:48.800829 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e1dc3-bf1b-4fa3-a5db-03a3dec585b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:48.801979 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e1dc3-bf1b-4fa3-a5db-03a3dec585b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:48.804262 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e1dc3-bf1b-4fa3-a5db-03a3dec585b9 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:48.817830 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1135/2280] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:48.822496 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853f297-d2c5-4ba6-b445-20fd7959a2e8 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:48.835245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853f297-d2c5-4ba6-b445-20fd7959a2e8 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:48.842547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabb400-f0db-464c-ba19-46af8d899703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:48.843746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabb400-f0db-464c-ba19-46af8d899703 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:48.844854 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabb400-f0db-464c-ba19-46af8d899703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:48.845304 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabb400-f0db-464c-ba19-46af8d899703 admin admin] PATH_INFO: `/v3/projects/738e35d0255d478785cbea5f9c5e881c/users/3194035f3a4d438e9cfd22a9d67826b5/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:48.869460 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fabb400-f0db-464c-ba19-46af8d899703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=738e35d0255d478785cbea5f9c5e881c, user_id=3194035f3a4d438e9cfd22a9d67826b5, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:48.872848 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fabb400-f0db-464c-ba19-46af8d899703 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:48.890332 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1146/2281] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:48 2022] PUT /identity/v3/projects/738e35d0255d478785cbea5f9c5e881c/users/3194035f3a4d438e9cfd22a9d67826b5/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:48.894785 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e1dc3-bf1b-4fa3-a5db-03a3dec585b9 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:48.909971 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e1dc3-bf1b-4fa3-a5db-03a3dec585b9 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:48.975435 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:49.003056 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76764be0-9934-477a-9bc1-f6073e8c3103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:49.003972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76764be0-9934-477a-9bc1-f6073e8c3103 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:49.004553 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76764be0-9934-477a-9bc1-f6073e8c3103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:49.005038 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76764be0-9934-477a-9bc1-f6073e8c3103 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:49.006376 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76764be0-9934-477a-9bc1-f6073e8c3103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:49.008445 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76764be0-9934-477a-9bc1-f6073e8c3103 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:49.021369 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1136/2282] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:49.026127 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabb400-f0db-464c-ba19-46af8d899703 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:49.039789 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabb400-f0db-464c-ba19-46af8d899703 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:49.044976 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb50c5d-c83d-47c4-b1d2-5cb96a1b45d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:49.045979 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb50c5d-c83d-47c4-b1d2-5cb96a1b45d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:49.046267 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb50c5d-c83d-47c4-b1d2-5cb96a1b45d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:49.046547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb50c5d-c83d-47c4-b1d2-5cb96a1b45d7 admin admin] PATH_INFO: `/v3/projects/738e35d0255d478785cbea5f9c5e881c/users/3194035f3a4d438e9cfd22a9d67826b5/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:49.049242 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb50c5d-c83d-47c4-b1d2-5cb96a1b45d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=738e35d0255d478785cbea5f9c5e881c, user_id=3194035f3a4d438e9cfd22a9d67826b5, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:49.051719 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb50c5d-c83d-47c4-b1d2-5cb96a1b45d7 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:49.070620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1147/2283] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:49 2022] PUT /identity/v3/projects/738e35d0255d478785cbea5f9c5e881c/users/3194035f3a4d438e9cfd22a9d67826b5/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:49.081484 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916b8fa-4e79-42f7-9188-696e118763bc None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:49.081768 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916b8fa-4e79-42f7-9188-696e118763bc None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:49.082032 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916b8fa-4e79-42f7-9188-696e118763bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:49.125102 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-1916b8fa-4e79-42f7-9188-696e118763bc None None] MFA Rules not processed for user `3194035f3a4d438e9cfd22a9d67826b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:49.127202 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-1916b8fa-4e79-42f7-9188-696e118763bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:49.240632 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1137/2284] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:49 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:49.258948 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb50c5d-c83d-47c4-b1d2-5cb96a1b45d7 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:49.260935 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-ceb50c5d-c83d-47c4-b1d2-5cb96a1b45d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:49.335247 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb50c5d-c83d-47c4-b1d2-5cb96a1b45d7 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:49.340101 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe4c54-3a58-492b-b36a-e7f5f5c1f7b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:49.340934 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe4c54-3a58-492b-b36a-e7f5f5c1f7b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:49.341373 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe4c54-3a58-492b-b36a-e7f5f5c1f7b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:49.341730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe4c54-3a58-492b-b36a-e7f5f5c1f7b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:49.354295 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe4c54-3a58-492b-b36a-e7f5f5c1f7b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:49.356781 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe4c54-3a58-492b-b36a-e7f5f5c1f7b7 service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:49.367777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1148/2285] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:49.420189 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916b8fa-4e79-42f7-9188-696e118763bc None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:49.421721 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-1916b8fa-4e79-42f7-9188-696e118763bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:49.437388 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916b8fa-4e79-42f7-9188-696e118763bc None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:49.442414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa9c70-5296-44c3-bd1d-3a5996431b58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:49.443391 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa9c70-5296-44c3-bd1d-3a5996431b58 service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:49.443735 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa9c70-5296-44c3-bd1d-3a5996431b58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:49.444061 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa9c70-5296-44c3-bd1d-3a5996431b58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:49.519928 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa9c70-5296-44c3-bd1d-3a5996431b58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:49.525684 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa9c70-5296-44c3-bd1d-3a5996431b58 service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:49.542371 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1138/2286] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:33:52.717747 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe4c54-3a58-492b-b36a-e7f5f5c1f7b7 service cinder] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:52.736403 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:52.792726 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe4c54-3a58-492b-b36a-e7f5f5c1f7b7 service cinder] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:52.798219 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07adada-76a9-48a7-b278-07c279e6d0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:52.799199 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07adada-76a9-48a7-b278-07c279e6d0c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:52.799587 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07adada-76a9-48a7-b278-07c279e6d0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:52.799943 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07adada-76a9-48a7-b278-07c279e6d0c3 admin admin] PATH_INFO: `/v3/users/e89ccd91e9294b6ba790d0794d5ec149` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:52.801296 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07adada-76a9-48a7-b278-07c279e6d0c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e89ccd91e9294b6ba790d0794d5ec149)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:52.803578 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07adada-76a9-48a7-b278-07c279e6d0c3 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:52.885025 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-b07adada-76a9-48a7-b278-07c279e6d0c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e89ccd91e9294b6ba790d0794d5ec149'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:52.902907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-b07adada-76a9-48a7-b278-07c279e6d0c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e89ccd91e9294b6ba790d0794d5ec149'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:52.914752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-b07adada-76a9-48a7-b278-07c279e6d0c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e89ccd91e9294b6ba790d0794d5ec149'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:52.914752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-b07adada-76a9-48a7-b278-07c279e6d0c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e89ccd91e9294b6ba790d0794d5ec149'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:52.914752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-b07adada-76a9-48a7-b278-07c279e6d0c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e89ccd91e9294b6ba790d0794d5ec149'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:52.941311 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1149/2287] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:52 2022] DELETE /identity/v3/users/e89ccd91e9294b6ba790d0794d5ec149 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:52.946587 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d0029-cdb9-4167-88bf-91b16f258904 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:52.947159 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d0029-cdb9-4167-88bf-91b16f258904 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:52.947594 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d0029-cdb9-4167-88bf-91b16f258904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:52.983537 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-c68d0029-cdb9-4167-88bf-91b16f258904 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:52.984935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-c68d0029-cdb9-4167-88bf-91b16f258904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:53.070086 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1139/2288] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:53.080422 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07adada-76a9-48a7-b278-07c279e6d0c3 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:53.082090 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-b07adada-76a9-48a7-b278-07c279e6d0c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:53.164316 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07adada-76a9-48a7-b278-07c279e6d0c3 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:53.168066 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96630408-5a3d-4646-b338-8fd0ea8a3ca1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:53.168735 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96630408-5a3d-4646-b338-8fd0ea8a3ca1 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:53.169319 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96630408-5a3d-4646-b338-8fd0ea8a3ca1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:53.169319 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96630408-5a3d-4646-b338-8fd0ea8a3ca1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:53.180497 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96630408-5a3d-4646-b338-8fd0ea8a3ca1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:53.181961 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96630408-5a3d-4646-b338-8fd0ea8a3ca1 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:53.193031 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1150/2289] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:53.525340 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d0029-cdb9-4167-88bf-91b16f258904 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:53.527027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-c68d0029-cdb9-4167-88bf-91b16f258904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:53.536375 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:53.547719 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d0029-cdb9-4167-88bf-91b16f258904 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:53.556790 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378db788-c6d6-42b4-b1a7-fb6176453107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:53.557769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378db788-c6d6-42b4-b1a7-fb6176453107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:53.558043 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378db788-c6d6-42b4-b1a7-fb6176453107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:53.558324 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378db788-c6d6-42b4-b1a7-fb6176453107 admin admin] PATH_INFO: `/v3/projects/aec5ab0d52df4e858935f6637078cccb` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:53.559631 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378db788-c6d6-42b4-b1a7-fb6176453107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aec5ab0d52df4e858935f6637078cccb)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:53.561517 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378db788-c6d6-42b4-b1a7-fb6176453107 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:53.614527 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-378db788-c6d6-42b4-b1a7-fb6176453107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aec5ab0d52df4e858935f6637078cccb', 'request_id': 'req-378db788-c6d6-42b4-b1a7-fb6176453107'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:53.623012 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-378db788-c6d6-42b4-b1a7-fb6176453107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aec5ab0d52df4e858935f6637078cccb', 'request_id': 'req-378db788-c6d6-42b4-b1a7-fb6176453107'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:53.632957 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-378db788-c6d6-42b4-b1a7-fb6176453107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aec5ab0d52df4e858935f6637078cccb', 'request_id': 'req-378db788-c6d6-42b4-b1a7-fb6176453107'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:53.653399 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-378db788-c6d6-42b4-b1a7-fb6176453107 admin admin] The token cache is being invalidate because project aec5ab0d52df4e858935f6637078cccb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:53.653743 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-378db788-c6d6-42b4-b1a7-fb6176453107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:53.654438 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-378db788-c6d6-42b4-b1a7-fb6176453107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:53.657416 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1140/2290] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:53 2022] DELETE /identity/v3/projects/aec5ab0d52df4e858935f6637078cccb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:53.661212 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96630408-5a3d-4646-b338-8fd0ea8a3ca1 service neutron] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:53.671679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96630408-5a3d-4646-b338-8fd0ea8a3ca1 service neutron] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:53.718437 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:53.748421 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0fd04-e216-4f75-9fa2-5797fee6b507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:53.749664 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0fd04-e216-4f75-9fa2-5797fee6b507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:53.750045 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0fd04-e216-4f75-9fa2-5797fee6b507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:53.750388 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0fd04-e216-4f75-9fa2-5797fee6b507 admin admin] PATH_INFO: `/v3/users/48ebae16da3842a9983d207babbfbb6b` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:53.751881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0fd04-e216-4f75-9fa2-5797fee6b507 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48ebae16da3842a9983d207babbfbb6b)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:53.754149 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0fd04-e216-4f75-9fa2-5797fee6b507 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:53.833601 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-10c0fd04-e216-4f75-9fa2-5797fee6b507 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48ebae16da3842a9983d207babbfbb6b'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:53.865935 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-10c0fd04-e216-4f75-9fa2-5797fee6b507 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48ebae16da3842a9983d207babbfbb6b'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:53.873898 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-10c0fd04-e216-4f75-9fa2-5797fee6b507 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48ebae16da3842a9983d207babbfbb6b'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:53.874722 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-10c0fd04-e216-4f75-9fa2-5797fee6b507 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48ebae16da3842a9983d207babbfbb6b'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:53.875492 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-10c0fd04-e216-4f75-9fa2-5797fee6b507 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48ebae16da3842a9983d207babbfbb6b'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:53.898936 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1151/2291] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:53 2022] DELETE /identity/v3/users/48ebae16da3842a9983d207babbfbb6b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:33:54.289969 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378db788-c6d6-42b4-b1a7-fb6176453107 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:54.292486 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-378db788-c6d6-42b4-b1a7-fb6176453107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:54.332578 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378db788-c6d6-42b4-b1a7-fb6176453107 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:54.505261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989f5cf-5f77-4dbf-8b43-c44520b18955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:54.506700 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989f5cf-5f77-4dbf-8b43-c44520b18955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:54.507094 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989f5cf-5f77-4dbf-8b43-c44520b18955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:54.508558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989f5cf-5f77-4dbf-8b43-c44520b18955 admin admin] PATH_INFO: `/v3/projects/99b67b93ddbe4bb6871bc5ab1fae7193` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:54.510400 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989f5cf-5f77-4dbf-8b43-c44520b18955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99b67b93ddbe4bb6871bc5ab1fae7193)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:54.514396 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989f5cf-5f77-4dbf-8b43-c44520b18955 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:54.634746 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-3989f5cf-5f77-4dbf-8b43-c44520b18955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99b67b93ddbe4bb6871bc5ab1fae7193', 'request_id': 'req-3989f5cf-5f77-4dbf-8b43-c44520b18955'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:54.644058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-3989f5cf-5f77-4dbf-8b43-c44520b18955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99b67b93ddbe4bb6871bc5ab1fae7193', 'request_id': 'req-3989f5cf-5f77-4dbf-8b43-c44520b18955'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:54.655155 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-3989f5cf-5f77-4dbf-8b43-c44520b18955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99b67b93ddbe4bb6871bc5ab1fae7193', 'request_id': 'req-3989f5cf-5f77-4dbf-8b43-c44520b18955'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:54.668962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-3989f5cf-5f77-4dbf-8b43-c44520b18955 admin admin] The token cache is being invalidate because project 99b67b93ddbe4bb6871bc5ab1fae7193 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:54.669184 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-3989f5cf-5f77-4dbf-8b43-c44520b18955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:54.669945 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-3989f5cf-5f77-4dbf-8b43-c44520b18955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:54.672060 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1141/2292] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:54 2022] DELETE /identity/v3/projects/99b67b93ddbe4bb6871bc5ab1fae7193 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:54.676678 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0fd04-e216-4f75-9fa2-5797fee6b507 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:54.678219 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-10c0fd04-e216-4f75-9fa2-5797fee6b507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:54.693481 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0fd04-e216-4f75-9fa2-5797fee6b507 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:54.763051 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92895d6b-1d28-4286-89d7-35737cf27955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:54.764013 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92895d6b-1d28-4286-89d7-35737cf27955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:54.764286 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92895d6b-1d28-4286-89d7-35737cf27955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:54.764559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92895d6b-1d28-4286-89d7-35737cf27955 admin admin] PATH_INFO: `/v3/users/3194035f3a4d438e9cfd22a9d67826b5` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:54.766777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92895d6b-1d28-4286-89d7-35737cf27955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3194035f3a4d438e9cfd22a9d67826b5)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:54.768758 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92895d6b-1d28-4286-89d7-35737cf27955 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:54.831579 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-92895d6b-1d28-4286-89d7-35737cf27955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3194035f3a4d438e9cfd22a9d67826b5'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:54.841277 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:54.849060 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-92895d6b-1d28-4286-89d7-35737cf27955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3194035f3a4d438e9cfd22a9d67826b5'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:54.865674 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-92895d6b-1d28-4286-89d7-35737cf27955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3194035f3a4d438e9cfd22a9d67826b5'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:54.867838 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-92895d6b-1d28-4286-89d7-35737cf27955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3194035f3a4d438e9cfd22a9d67826b5'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:54.869035 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-92895d6b-1d28-4286-89d7-35737cf27955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3194035f3a4d438e9cfd22a9d67826b5'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:54.889550 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1152/2293] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:33:54 2022] DELETE /identity/v3/users/3194035f3a4d438e9cfd22a9d67826b5 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:55.308452 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989f5cf-5f77-4dbf-8b43-c44520b18955 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:55.310912 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-3989f5cf-5f77-4dbf-8b43-c44520b18955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:55.336247 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989f5cf-5f77-4dbf-8b43-c44520b18955 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:55.363564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:55.470595 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f322435-6de9-4fef-aa8f-6f939a5e5e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:55.472306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f322435-6de9-4fef-aa8f-6f939a5e5e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:55.472862 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f322435-6de9-4fef-aa8f-6f939a5e5e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:55.473347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f322435-6de9-4fef-aa8f-6f939a5e5e6c admin admin] PATH_INFO: `/v3/projects/738e35d0255d478785cbea5f9c5e881c` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:55.476662 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f322435-6de9-4fef-aa8f-6f939a5e5e6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=738e35d0255d478785cbea5f9c5e881c)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:55.480267 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f322435-6de9-4fef-aa8f-6f939a5e5e6c admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:55.570142 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0f322435-6de9-4fef-aa8f-6f939a5e5e6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '738e35d0255d478785cbea5f9c5e881c', 'request_id': 'req-0f322435-6de9-4fef-aa8f-6f939a5e5e6c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:55.579855 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0f322435-6de9-4fef-aa8f-6f939a5e5e6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '738e35d0255d478785cbea5f9c5e881c', 'request_id': 'req-0f322435-6de9-4fef-aa8f-6f939a5e5e6c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:55.596156 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0f322435-6de9-4fef-aa8f-6f939a5e5e6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '738e35d0255d478785cbea5f9c5e881c', 'request_id': 'req-0f322435-6de9-4fef-aa8f-6f939a5e5e6c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:55.614703 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0f322435-6de9-4fef-aa8f-6f939a5e5e6c admin admin] The token cache is being invalidate because project 738e35d0255d478785cbea5f9c5e881c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:33:55.615247 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0f322435-6de9-4fef-aa8f-6f939a5e5e6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:55.616400 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0f322435-6de9-4fef-aa8f-6f939a5e5e6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:33:55.618587 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1142/2294] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:33:55 2022] DELETE /identity/v3/projects/738e35d0255d478785cbea5f9c5e881c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:55.628447 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c7b16-f6d2-4b40-a6e1-940a9cb7cdaf None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:55.629025 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c7b16-f6d2-4b40-a6e1-940a9cb7cdaf None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:55.629579 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c7b16-f6d2-4b40-a6e1-940a9cb7cdaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:55.661119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-191c7b16-f6d2-4b40-a6e1-940a9cb7cdaf None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:55.662382 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-191c7b16-f6d2-4b40-a6e1-940a9cb7cdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:55.821149 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1153/2295] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:55.822130 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0eff48-bfd8-4915-9b69-a78286ac8645 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:55.822426 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0eff48-bfd8-4915-9b69-a78286ac8645 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:55.822706 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0eff48-bfd8-4915-9b69-a78286ac8645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:55.850412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-8c0eff48-bfd8-4915-9b69-a78286ac8645 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:55.864500 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-8c0eff48-bfd8-4915-9b69-a78286ac8645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:55.887294 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1143/2296] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:33:55.889735 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c7b16-f6d2-4b40-a6e1-940a9cb7cdaf None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:55.915793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c7b16-f6d2-4b40-a6e1-940a9cb7cdaf None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:55.925381 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b240a04-b36c-4bd3-a4c2-3762e43df97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:55.927103 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b240a04-b36c-4bd3-a4c2-3762e43df97e admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:55.927571 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b240a04-b36c-4bd3-a4c2-3762e43df97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:55.928155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b240a04-b36c-4bd3-a4c2-3762e43df97e admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:55.929660 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b240a04-b36c-4bd3-a4c2-3762e43df97e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:33:55.930247 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b240a04-b36c-4bd3-a4c2-3762e43df97e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:55.933402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b240a04-b36c-4bd3-a4c2-3762e43df97e admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:55.964725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1154/2297] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:33:55.974024 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0eff48-bfd8-4915-9b69-a78286ac8645 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:55.991861 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0eff48-bfd8-4915-9b69-a78286ac8645 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:56.000402 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d295692-7388-4c7d-b04b-2b317e71e975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:56.001578 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d295692-7388-4c7d-b04b-2b317e71e975 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:56.001969 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d295692-7388-4c7d-b04b-2b317e71e975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:56.002346 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d295692-7388-4c7d-b04b-2b317e71e975 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:56.005400 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d295692-7388-4c7d-b04b-2b317e71e975 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:56.006943 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d295692-7388-4c7d-b04b-2b317e71e975 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:56.049441 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1144/2298] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:33:55 2022] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:56.055824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b240a04-b36c-4bd3-a4c2-3762e43df97e admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:56.069750 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b240a04-b36c-4bd3-a4c2-3762e43df97e admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:56.190052 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3372d-67f0-4698-8b55-6c43591899ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:56.190871 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3372d-67f0-4698-8b55-6c43591899ec admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:56.191034 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3372d-67f0-4698-8b55-6c43591899ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:56.191519 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3372d-67f0-4698-8b55-6c43591899ec admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:56.192674 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3372d-67f0-4698-8b55-6c43591899ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:56.194968 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3372d-67f0-4698-8b55-6c43591899ec admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:56.244648 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1155/2299] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:33:56 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:33:56.256320 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d295692-7388-4c7d-b04b-2b317e71e975 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:56.273385 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d295692-7388-4c7d-b04b-2b317e71e975 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:56.278377 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e55a4-7652-4c54-97b6-89070514e323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:56.279077 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e55a4-7652-4c54-97b6-89070514e323 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:56.279394 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e55a4-7652-4c54-97b6-89070514e323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:56.279676 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e55a4-7652-4c54-97b6-89070514e323 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:56.280427 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e55a4-7652-4c54-97b6-89070514e323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:56.282101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e55a4-7652-4c54-97b6-89070514e323 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:56.294147 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1145/2300] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:56.299998 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3372d-67f0-4698-8b55-6c43591899ec admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:56.319503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3372d-67f0-4698-8b55-6c43591899ec admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:56.334490 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2d20d-e54a-4fd3-bad3-ea8a9128aca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:56.335249 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2d20d-e54a-4fd3-bad3-ea8a9128aca1 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:56.335571 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2d20d-e54a-4fd3-bad3-ea8a9128aca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:56.335858 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2d20d-e54a-4fd3-bad3-ea8a9128aca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:56.336633 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2d20d-e54a-4fd3-bad3-ea8a9128aca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:56.338311 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2d20d-e54a-4fd3-bad3-ea8a9128aca1 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:56.357888 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e55a4-7652-4c54-97b6-89070514e323 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:56.358453 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1156/2301] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:33:56.369772 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e55a4-7652-4c54-97b6-89070514e323 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:56.374811 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd0b66-7dc0-4dc5-b762-c5af4b52df8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:56.376532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd0b66-7dc0-4dc5-b762-c5af4b52df8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:56.376887 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd0b66-7dc0-4dc5-b762-c5af4b52df8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:56.377331 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd0b66-7dc0-4dc5-b762-c5af4b52df8a admin admin] PATH_INFO: `/v3/projects/b9d8409cb92b446bae533b066cd43d31/users/01711810f5974c1f8bad4b5ecd716242/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:56.399183 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd0b66-7dc0-4dc5-b762-c5af4b52df8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9d8409cb92b446bae533b066cd43d31, user_id=01711810f5974c1f8bad4b5ecd716242, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:56.402118 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd0b66-7dc0-4dc5-b762-c5af4b52df8a admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:56.422733 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1146/2302] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:33:56 2022] PUT /identity/v3/projects/b9d8409cb92b446bae533b066cd43d31/users/01711810f5974c1f8bad4b5ecd716242/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:33:56.435458 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f4aee-904d-437d-b042-97ffbb147705 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:56.436089 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f4aee-904d-437d-b042-97ffbb147705 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:56.436557 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f4aee-904d-437d-b042-97ffbb147705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:56.493719 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-8c2f4aee-904d-437d-b042-97ffbb147705 None None] MFA Rules not processed for user `01711810f5974c1f8bad4b5ecd716242`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:33:56.496066 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-8c2f4aee-904d-437d-b042-97ffbb147705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:56.544787 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:56.601573 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1157/2303] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:33:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:33:56.614568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd0b66-7dc0-4dc5-b762-c5af4b52df8a admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:56.616860 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-e2fd0b66-7dc0-4dc5-b762-c5af4b52df8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:33:56.716626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:56.752708 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd0b66-7dc0-4dc5-b762-c5af4b52df8a admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:56.759484 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e1f79-6756-40c4-bc1f-d93fdf238a78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:56.760238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e1f79-6756-40c4-bc1f-d93fdf238a78 service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:56.760681 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e1f79-6756-40c4-bc1f-d93fdf238a78 service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:56.761012 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e1f79-6756-40c4-bc1f-d93fdf238a78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:56.788238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e1f79-6756-40c4-bc1f-d93fdf238a78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:56.789752 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e1f79-6756-40c4-bc1f-d93fdf238a78 service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:56.803246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1147/2304] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:34:00.764221 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f4aee-904d-437d-b042-97ffbb147705 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:00.835417 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f4aee-904d-437d-b042-97ffbb147705 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:00.840056 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef1bcf-cc68-4bec-8cd3-041e1f6a1c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:00.840939 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef1bcf-cc68-4bec-8cd3-041e1f6a1c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:00.841225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef1bcf-cc68-4bec-8cd3-041e1f6a1c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:00.841507 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef1bcf-cc68-4bec-8cd3-041e1f6a1c4c admin admin] PATH_INFO: `/v3/users/01711810f5974c1f8bad4b5ecd716242` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:00.842712 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef1bcf-cc68-4bec-8cd3-041e1f6a1c4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=01711810f5974c1f8bad4b5ecd716242)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:00.844679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef1bcf-cc68-4bec-8cd3-041e1f6a1c4c admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:00.901510 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-9fef1bcf-cc68-4bec-8cd3-041e1f6a1c4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01711810f5974c1f8bad4b5ecd716242'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:00.914395 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-9fef1bcf-cc68-4bec-8cd3-041e1f6a1c4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01711810f5974c1f8bad4b5ecd716242'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:00.921321 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-9fef1bcf-cc68-4bec-8cd3-041e1f6a1c4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01711810f5974c1f8bad4b5ecd716242'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:00.922566 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-9fef1bcf-cc68-4bec-8cd3-041e1f6a1c4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01711810f5974c1f8bad4b5ecd716242'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:00.923343 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-9fef1bcf-cc68-4bec-8cd3-041e1f6a1c4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01711810f5974c1f8bad4b5ecd716242'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:00.941015 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1158/2305] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:34:00 2022] DELETE /identity/v3/users/01711810f5974c1f8bad4b5ecd716242 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:34:00.945994 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacbe4f-5553-4154-917c-84bba10d169d None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:00.946585 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacbe4f-5553-4154-917c-84bba10d169d None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:00.946585 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacbe4f-5553-4154-917c-84bba10d169d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:00.963862 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-adacbe4f-5553-4154-917c-84bba10d169d None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:00.965085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-adacbe4f-5553-4154-917c-84bba10d169d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:01.037087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1148/2306] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:34:01.048410 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef1bcf-cc68-4bec-8cd3-041e1f6a1c4c admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:01.050608 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-9fef1bcf-cc68-4bec-8cd3-041e1f6a1c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:01.114859 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef1bcf-cc68-4bec-8cd3-041e1f6a1c4c admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:01.118680 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14680250-7be7-4de9-9749-41dc0e8e0c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:01.119368 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14680250-7be7-4de9-9749-41dc0e8e0c9d service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:01.119657 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14680250-7be7-4de9-9749-41dc0e8e0c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:01.119939 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14680250-7be7-4de9-9749-41dc0e8e0c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:01.126734 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:01.131867 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14680250-7be7-4de9-9749-41dc0e8e0c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:01.133775 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14680250-7be7-4de9-9749-41dc0e8e0c9d service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:01.145511 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1159/2307] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:34:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:34:01.592202 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacbe4f-5553-4154-917c-84bba10d169d None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:01.594392 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-adacbe4f-5553-4154-917c-84bba10d169d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:01.607927 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacbe4f-5553-4154-917c-84bba10d169d None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:01.629705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38756c9a-759d-40e7-83b4-d8dc5c9d706c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:01.630653 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38756c9a-759d-40e7-83b4-d8dc5c9d706c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:01.632512 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38756c9a-759d-40e7-83b4-d8dc5c9d706c admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:01.632905 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38756c9a-759d-40e7-83b4-d8dc5c9d706c admin admin] PATH_INFO: `/v3/projects/b9d8409cb92b446bae533b066cd43d31` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:01.634224 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38756c9a-759d-40e7-83b4-d8dc5c9d706c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9d8409cb92b446bae533b066cd43d31)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:01.636225 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38756c9a-759d-40e7-83b4-d8dc5c9d706c admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:01.697483 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-38756c9a-759d-40e7-83b4-d8dc5c9d706c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9d8409cb92b446bae533b066cd43d31', 'request_id': 'req-38756c9a-759d-40e7-83b4-d8dc5c9d706c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:01.704748 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-38756c9a-759d-40e7-83b4-d8dc5c9d706c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9d8409cb92b446bae533b066cd43d31', 'request_id': 'req-38756c9a-759d-40e7-83b4-d8dc5c9d706c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:01.714738 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-38756c9a-759d-40e7-83b4-d8dc5c9d706c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9d8409cb92b446bae533b066cd43d31', 'request_id': 'req-38756c9a-759d-40e7-83b4-d8dc5c9d706c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:01.726757 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-38756c9a-759d-40e7-83b4-d8dc5c9d706c admin admin] The token cache is being invalidate because project b9d8409cb92b446bae533b066cd43d31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:34:01.727061 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-38756c9a-759d-40e7-83b4-d8dc5c9d706c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:01.727740 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-38756c9a-759d-40e7-83b4-d8dc5c9d706c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:01.731273 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1149/2308] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:34:01 2022] DELETE /identity/v3/projects/b9d8409cb92b446bae533b066cd43d31 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:34:01.734638 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51482ffb-7638-4366-9943-8f64ad1ed9b0 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:01.734929 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51482ffb-7638-4366-9943-8f64ad1ed9b0 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:01.735214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51482ffb-7638-4366-9943-8f64ad1ed9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:01.754759 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-51482ffb-7638-4366-9943-8f64ad1ed9b0 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:01.756071 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-51482ffb-7638-4366-9943-8f64ad1ed9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:01.819868 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1160/2309] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:34:01.828343 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66980b7f-fbe2-4914-aba3-74e76a1a3d32 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:01.828639 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66980b7f-fbe2-4914-aba3-74e76a1a3d32 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:01.828928 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66980b7f-fbe2-4914-aba3-74e76a1a3d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:01.849227 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-66980b7f-fbe2-4914-aba3-74e76a1a3d32 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:01.850451 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-66980b7f-fbe2-4914-aba3-74e76a1a3d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:01.859909 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1150/2310] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:34:01.864031 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51482ffb-7638-4366-9943-8f64ad1ed9b0 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:01.874393 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51482ffb-7638-4366-9943-8f64ad1ed9b0 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:01.880046 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8a0b0-d783-4d70-a84e-4b1bec90c44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:01.880732 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8a0b0-d783-4d70-a84e-4b1bec90c44a admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:01.881015 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8a0b0-d783-4d70-a84e-4b1bec90c44a admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:01.881294 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8a0b0-d783-4d70-a84e-4b1bec90c44a admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:01.882057 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8a0b0-d783-4d70-a84e-4b1bec90c44a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:34:01.882328 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8a0b0-d783-4d70-a84e-4b1bec90c44a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:01.883970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8a0b0-d783-4d70-a84e-4b1bec90c44a admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:01.912658 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1161/2311] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:34:01.913766 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66980b7f-fbe2-4914-aba3-74e76a1a3d32 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:01.923315 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66980b7f-fbe2-4914-aba3-74e76a1a3d32 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:01.929089 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701e434-bdf5-42bb-97e9-95bd94cf15da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:01.929778 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701e434-bdf5-42bb-97e9-95bd94cf15da admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:01.930066 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701e434-bdf5-42bb-97e9-95bd94cf15da admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:01.930333 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701e434-bdf5-42bb-97e9-95bd94cf15da admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:01.931481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701e434-bdf5-42bb-97e9-95bd94cf15da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:01.933097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701e434-bdf5-42bb-97e9-95bd94cf15da admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:01.964357 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1151/2312] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:34:01 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:34:01.968727 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8a0b0-d783-4d70-a84e-4b1bec90c44a admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:01.979744 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8a0b0-d783-4d70-a84e-4b1bec90c44a admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:02.050002 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010bcbb-672e-460c-be8b-0d3e4a70a247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:02.050711 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010bcbb-672e-460c-be8b-0d3e4a70a247 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:02.051259 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010bcbb-672e-460c-be8b-0d3e4a70a247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:02.051545 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010bcbb-672e-460c-be8b-0d3e4a70a247 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:02.052244 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010bcbb-672e-460c-be8b-0d3e4a70a247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:02.054136 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010bcbb-672e-460c-be8b-0d3e4a70a247 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:02.074894 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1162/2313] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:34:01 2022] POST /identity/v3/users => generated 286 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:34:02.080877 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701e434-bdf5-42bb-97e9-95bd94cf15da admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:02.091848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701e434-bdf5-42bb-97e9-95bd94cf15da admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:02.096645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c0ba2-be71-4aa5-9acc-21cab72ef954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:02.097348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c0ba2-be71-4aa5-9acc-21cab72ef954 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:02.097638 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c0ba2-be71-4aa5-9acc-21cab72ef954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:02.097916 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c0ba2-be71-4aa5-9acc-21cab72ef954 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:02.098728 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c0ba2-be71-4aa5-9acc-21cab72ef954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:02.100639 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c0ba2-be71-4aa5-9acc-21cab72ef954 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:02.111803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1152/2314] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:34:02.116023 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010bcbb-672e-460c-be8b-0d3e4a70a247 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:02.127020 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010bcbb-672e-460c-be8b-0d3e4a70a247 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:02.131734 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b46e81-9390-45a1-a345-83105e7dcff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:02.132405 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b46e81-9390-45a1-a345-83105e7dcff6 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:02.132694 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b46e81-9390-45a1-a345-83105e7dcff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:02.132974 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b46e81-9390-45a1-a345-83105e7dcff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:02.133716 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b46e81-9390-45a1-a345-83105e7dcff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:02.135334 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b46e81-9390-45a1-a345-83105e7dcff6 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:02.146684 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1163/2315] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:34:02.151266 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c0ba2-be71-4aa5-9acc-21cab72ef954 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:02.161684 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c0ba2-be71-4aa5-9acc-21cab72ef954 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:02.166568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd43151-ea06-40ec-b0cf-b3b858c56069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:02.167499 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd43151-ea06-40ec-b0cf-b3b858c56069 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:02.167781 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd43151-ea06-40ec-b0cf-b3b858c56069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:02.168057 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd43151-ea06-40ec-b0cf-b3b858c56069 admin admin] PATH_INFO: `/v3/projects/3afd79f7a6494784a957233ff110155f/users/c9fa35b562b34c42a7d4f2a6f27a6a44/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:02.184485 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd43151-ea06-40ec-b0cf-b3b858c56069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3afd79f7a6494784a957233ff110155f, user_id=c9fa35b562b34c42a7d4f2a6f27a6a44, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:02.187727 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd43151-ea06-40ec-b0cf-b3b858c56069 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:02.215381 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1153/2316] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:34:02 2022] PUT /identity/v3/projects/3afd79f7a6494784a957233ff110155f/users/c9fa35b562b34c42a7d4f2a6f27a6a44/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:34:02.219180 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c69299-c7e8-4147-abc7-99d39e6279a5 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:02.219510 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c69299-c7e8-4147-abc7-99d39e6279a5 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:02.219796 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c69299-c7e8-4147-abc7-99d39e6279a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:02.263187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-a8c69299-c7e8-4147-abc7-99d39e6279a5 None None] MFA Rules not processed for user `c9fa35b562b34c42a7d4f2a6f27a6a44`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:02.264474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-a8c69299-c7e8-4147-abc7-99d39e6279a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:02.333765 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:02.367352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1164/2317] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:34:02.401899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd43151-ea06-40ec-b0cf-b3b858c56069 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:02.404388 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-6bd43151-ea06-40ec-b0cf-b3b858c56069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:02.412322 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:02.483009 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd43151-ea06-40ec-b0cf-b3b858c56069 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:02.488763 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9d672-2e0a-4f41-8c56-11ffc3e6f62f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:02.489509 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9d672-2e0a-4f41-8c56-11ffc3e6f62f service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:02.489935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9d672-2e0a-4f41-8c56-11ffc3e6f62f service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:02.490224 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9d672-2e0a-4f41-8c56-11ffc3e6f62f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:02.501682 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9d672-2e0a-4f41-8c56-11ffc3e6f62f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:02.502907 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9d672-2e0a-4f41-8c56-11ffc3e6f62f service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:02.513329 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1154/2318] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:34:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:34:02.545608 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c69299-c7e8-4147-abc7-99d39e6279a5 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:02.710576 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c69299-c7e8-4147-abc7-99d39e6279a5 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:02.722278 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1982be-7959-43c2-a352-3acb4d90df1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:02.723195 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1982be-7959-43c2-a352-3acb4d90df1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:02.724921 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1982be-7959-43c2-a352-3acb4d90df1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:02.724921 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1982be-7959-43c2-a352-3acb4d90df1a admin admin] PATH_INFO: `/v3/users/c9fa35b562b34c42a7d4f2a6f27a6a44` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:02.725257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1982be-7959-43c2-a352-3acb4d90df1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9fa35b562b34c42a7d4f2a6f27a6a44)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:02.727109 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1982be-7959-43c2-a352-3acb4d90df1a admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:02.819478 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-4b1982be-7959-43c2-a352-3acb4d90df1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9fa35b562b34c42a7d4f2a6f27a6a44'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:02.839631 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-4b1982be-7959-43c2-a352-3acb4d90df1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9fa35b562b34c42a7d4f2a6f27a6a44'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:02.848368 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-4b1982be-7959-43c2-a352-3acb4d90df1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9fa35b562b34c42a7d4f2a6f27a6a44'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:02.849136 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-4b1982be-7959-43c2-a352-3acb4d90df1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9fa35b562b34c42a7d4f2a6f27a6a44'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:02.849885 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-4b1982be-7959-43c2-a352-3acb4d90df1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9fa35b562b34c42a7d4f2a6f27a6a44'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:02.874780 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1165/2319] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:34:02 2022] DELETE /identity/v3/users/c9fa35b562b34c42a7d4f2a6f27a6a44 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:34:02.881076 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6615d73-421c-477c-b7b3-902cb6c458f9 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:02.881482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6615d73-421c-477c-b7b3-902cb6c458f9 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:02.881899 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6615d73-421c-477c-b7b3-902cb6c458f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:02.915686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-b6615d73-421c-477c-b7b3-902cb6c458f9 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:02.917481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-b6615d73-421c-477c-b7b3-902cb6c458f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:03.001916 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1155/2320] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:34:03.017070 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1982be-7959-43c2-a352-3acb4d90df1a admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:03.024372 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-4b1982be-7959-43c2-a352-3acb4d90df1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:03.110656 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1982be-7959-43c2-a352-3acb4d90df1a admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:03.115561 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ebe97-cbc8-4163-be49-3e419b0d1aea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:03.116699 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ebe97-cbc8-4163-be49-3e419b0d1aea service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:03.117397 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ebe97-cbc8-4163-be49-3e419b0d1aea service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:03.117913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ebe97-cbc8-4163-be49-3e419b0d1aea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:03.130243 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ebe97-cbc8-4163-be49-3e419b0d1aea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:03.131640 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ebe97-cbc8-4163-be49-3e419b0d1aea service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:03.142449 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1166/2321] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:34:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:34:03.491541 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6615d73-421c-477c-b7b3-902cb6c458f9 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:03.493967 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-b6615d73-421c-477c-b7b3-902cb6c458f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:03.510151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6615d73-421c-477c-b7b3-902cb6c458f9 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:03.536341 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482da9c-87e8-44d7-9654-86931c43ad41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:03.539009 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482da9c-87e8-44d7-9654-86931c43ad41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:03.539830 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482da9c-87e8-44d7-9654-86931c43ad41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:03.540929 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482da9c-87e8-44d7-9654-86931c43ad41 admin admin] PATH_INFO: `/v3/projects/3afd79f7a6494784a957233ff110155f` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:03.550235 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0482da9c-87e8-44d7-9654-86931c43ad41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3afd79f7a6494784a957233ff110155f)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:03.554294 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0482da9c-87e8-44d7-9654-86931c43ad41 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:03.617648 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0482da9c-87e8-44d7-9654-86931c43ad41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3afd79f7a6494784a957233ff110155f', 'request_id': 'req-0482da9c-87e8-44d7-9654-86931c43ad41'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:03.625867 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0482da9c-87e8-44d7-9654-86931c43ad41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3afd79f7a6494784a957233ff110155f', 'request_id': 'req-0482da9c-87e8-44d7-9654-86931c43ad41'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:03.635136 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0482da9c-87e8-44d7-9654-86931c43ad41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3afd79f7a6494784a957233ff110155f', 'request_id': 'req-0482da9c-87e8-44d7-9654-86931c43ad41'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:03.652182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0482da9c-87e8-44d7-9654-86931c43ad41 admin admin] The token cache is being invalidate because project 3afd79f7a6494784a957233ff110155f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:34:03.652594 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0482da9c-87e8-44d7-9654-86931c43ad41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:03.653437 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0482da9c-87e8-44d7-9654-86931c43ad41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:03.655951 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1156/2322] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:34:03 2022] DELETE /identity/v3/projects/3afd79f7a6494784a957233ff110155f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:34:03.662423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7861535-bc88-419e-8c7f-aaa554cdb101 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:03.662920 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7861535-bc88-419e-8c7f-aaa554cdb101 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:03.663436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7861535-bc88-419e-8c7f-aaa554cdb101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:03.684931 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-d7861535-bc88-419e-8c7f-aaa554cdb101 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:03.686217 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-d7861535-bc88-419e-8c7f-aaa554cdb101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:03.695896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:03.715212 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97497cd4-668c-4680-801a-ad3f808559e5 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:03.715927 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97497cd4-668c-4680-801a-ad3f808559e5 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:03.716453 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97497cd4-668c-4680-801a-ad3f808559e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:03.735580 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-97497cd4-668c-4680-801a-ad3f808559e5 None None] MFA Rules not processed for user `cea1d8409c754ec797d6c694481a3112`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:03.736804 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-97497cd4-668c-4680-801a-ad3f808559e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:03.782301 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1167/2323] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:34:03.784851 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f3c8e-e2ae-4df7-86f4-28e7ad0b4265 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:03.785239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f3c8e-e2ae-4df7-86f4-28e7ad0b4265 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:03.785524 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f3c8e-e2ae-4df7-86f4-28e7ad0b4265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:03.786715 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:03.828507 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-3d0f3c8e-e2ae-4df7-86f4-28e7ad0b4265 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:03.829929 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-3d0f3c8e-e2ae-4df7-86f4-28e7ad0b4265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:03.833597 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1157/2324] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jul 19 15:34:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:34:03.844225 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c5cde-7861-4554-ae2d-3c6878506eb7 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:03.844588 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c5cde-7861-4554-ae2d-3c6878506eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:03.844937 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c5cde-7861-4554-ae2d-3c6878506eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:03.851072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1168/2325] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:34:03.853077 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f3c8e-e2ae-4df7-86f4-28e7ad0b4265 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:03.870786 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-934c5cde-7861-4554-ae2d-3c6878506eb7 None None] MFA Rules not processed for user `05c0092f8c8d46a99fc04c0c334f490d`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:03.872034 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-934c5cde-7861-4554-ae2d-3c6878506eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:03.873280 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f3c8e-e2ae-4df7-86f4-28e7ad0b4265 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:03.882686 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a265645-b37c-485a-9af1-9a68e991cf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:03.883902 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a265645-b37c-485a-9af1-9a68e991cf76 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:03.884487 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a265645-b37c-485a-9af1-9a68e991cf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:03.884989 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a265645-b37c-485a-9af1-9a68e991cf76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:03.886458 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a265645-b37c-485a-9af1-9a68e991cf76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:34:03.887040 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a265645-b37c-485a-9af1-9a68e991cf76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:03.890076 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a265645-b37c-485a-9af1-9a68e991cf76 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:03.912268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1169/2326] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:34:03.913792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a265645-b37c-485a-9af1-9a68e991cf76 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:03.916424 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-2a265645-b37c-485a-9af1-9a68e991cf76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:03.939261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1158/2327] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:34:03.940185 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c5cde-7861-4554-ae2d-3c6878506eb7 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:03.958647 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c5cde-7861-4554-ae2d-3c6878506eb7 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:03.967443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec69504-43d8-4383-b3fa-0e1ea75c4dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:03.968594 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec69504-43d8-4383-b3fa-0e1ea75c4dfb admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:03.968884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec69504-43d8-4383-b3fa-0e1ea75c4dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:03.969169 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec69504-43d8-4383-b3fa-0e1ea75c4dfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:03.969888 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec69504-43d8-4383-b3fa-0e1ea75c4dfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:03.972119 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec69504-43d8-4383-b3fa-0e1ea75c4dfb admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:04.011982 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1159/2328] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:34:03 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:34:04.017097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec69504-43d8-4383-b3fa-0e1ea75c4dfb admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:04.025254 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a265645-b37c-485a-9af1-9a68e991cf76 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:04.140326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec69504-43d8-4383-b3fa-0e1ea75c4dfb admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:04.151522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2b5e8-d8d2-4ad1-a8c0-0eaf83f75a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:04.152763 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2b5e8-d8d2-4ad1-a8c0-0eaf83f75a6b admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:04.153298 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2b5e8-d8d2-4ad1-a8c0-0eaf83f75a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:04.153924 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2b5e8-d8d2-4ad1-a8c0-0eaf83f75a6b admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:04.155394 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2b5e8-d8d2-4ad1-a8c0-0eaf83f75a6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:04.161578 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2b5e8-d8d2-4ad1-a8c0-0eaf83f75a6b admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:04.174101 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c3959-26b4-41ee-bdc4-1e5950f350c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1dceaddb6e414faef0e0448cdf1be8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:04.176065 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c3959-26b4-41ee-bdc4-1e5950f350c3 service swift] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:04.176740 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c3959-26b4-41ee-bdc4-1e5950f350c3 service swift] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:04.178066 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c3959-26b4-41ee-bdc4-1e5950f350c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:04.200029 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1160/2329] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:34:04 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:34:04.214622 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2b5e8-d8d2-4ad1-a8c0-0eaf83f75a6b admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:04.246152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2b5e8-d8d2-4ad1-a8c0-0eaf83f75a6b admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:04.264678 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318685d-c099-4be8-9765-4b1114f451cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:04.265947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318685d-c099-4be8-9765-4b1114f451cd admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:04.266231 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318685d-c099-4be8-9765-4b1114f451cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:04.266513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318685d-c099-4be8-9765-4b1114f451cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:04.267342 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318685d-c099-4be8-9765-4b1114f451cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:04.269029 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318685d-c099-4be8-9765-4b1114f451cd admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:04.273928 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:04.293910 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1161/2330] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:34:04.299593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318685d-c099-4be8-9765-4b1114f451cd admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:04.316301 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318685d-c099-4be8-9765-4b1114f451cd admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:04.321458 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c3959-26b4-41ee-bdc4-1e5950f350c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:04.323649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c3959-26b4-41ee-bdc4-1e5950f350c3 service swift] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:04.334758 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1170/2331] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jul 19 15:34:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:34:04.336130 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122f384-158e-4db9-81b9-ca73f7890d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:04.338571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122f384-158e-4db9-81b9-ca73f7890d32 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:04.339760 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122f384-158e-4db9-81b9-ca73f7890d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:04.340235 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122f384-158e-4db9-81b9-ca73f7890d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:04.347059 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122f384-158e-4db9-81b9-ca73f7890d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:04.351692 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122f384-158e-4db9-81b9-ca73f7890d32 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:04.380516 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1162/2332] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:34:04.384750 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c3959-26b4-41ee-bdc4-1e5950f350c3 service swift] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:04.401454 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c3959-26b4-41ee-bdc4-1e5950f350c3 service swift] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:04.413519 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d2345-aa88-4569-b6d9-1ed46ae8382f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:04.416584 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d2345-aa88-4569-b6d9-1ed46ae8382f admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:04.416989 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d2345-aa88-4569-b6d9-1ed46ae8382f admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:04.418360 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d2345-aa88-4569-b6d9-1ed46ae8382f admin admin] PATH_INFO: `/v3/projects/bcf10b39357d49bf8a6587d38cce9719/users/f443bdddfe274794a35d7b5340229d19/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:04.464511 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d2345-aa88-4569-b6d9-1ed46ae8382f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf10b39357d49bf8a6587d38cce9719, user_id=f443bdddfe274794a35d7b5340229d19, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:04.468893 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d2345-aa88-4569-b6d9-1ed46ae8382f admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:04.505917 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1171/2333] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:34:04 2022] PUT /identity/v3/projects/bcf10b39357d49bf8a6587d38cce9719/users/f443bdddfe274794a35d7b5340229d19/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:34:04.506438 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac128739-9836-4adc-87bf-a358d92535ca None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:04.506775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac128739-9836-4adc-87bf-a358d92535ca None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:04.508470 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac128739-9836-4adc-87bf-a358d92535ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:04.550360 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-ac128739-9836-4adc-87bf-a358d92535ca None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:04.552841 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-ac128739-9836-4adc-87bf-a358d92535ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:04.628000 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:04.709795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1163/2334] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:34:04.723115 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d2345-aa88-4569-b6d9-1ed46ae8382f admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:04.728095 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-4c0d2345-aa88-4569-b6d9-1ed46ae8382f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:04.830263 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d2345-aa88-4569-b6d9-1ed46ae8382f admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:04.841717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3d504-e925-49f8-9d8b-ec82fb0cd849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:04.842395 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3d504-e925-49f8-9d8b-ec82fb0cd849 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:04.842678 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3d504-e925-49f8-9d8b-ec82fb0cd849 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:04.842954 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3d504-e925-49f8-9d8b-ec82fb0cd849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:04.858036 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3d504-e925-49f8-9d8b-ec82fb0cd849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:04.858036 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3d504-e925-49f8-9d8b-ec82fb0cd849 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:04.883601 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1172/2335] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:34:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:34:05.198951 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764237d-2ab2-40f4-ae41-2fa60206051a None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:05.199484 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764237d-2ab2-40f4-ae41-2fa60206051a None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:05.199604 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764237d-2ab2-40f4-ae41-2fa60206051a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:05.221695 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-7764237d-2ab2-40f4-ae41-2fa60206051a None None] MFA Rules not processed for user `cea1d8409c754ec797d6c694481a3112`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:05.222941 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-7764237d-2ab2-40f4-ae41-2fa60206051a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:05.306984 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1164/2336] 10.222.0.44 () {58 vars in 967 bytes} [Tue Jul 19 15:34:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:34:05.325882 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3d504-e925-49f8-9d8b-ec82fb0cd849 service neutron] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:05.440511 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3d504-e925-49f8-9d8b-ec82fb0cd849 service neutron] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:05.449105 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537778e-8640-4509-afd5-f19e4d735d57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1dceaddb6e414faef0e0448cdf1be8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:05.450291 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537778e-8640-4509-afd5-f19e4d735d57 service swift] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:05.450777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537778e-8640-4509-afd5-f19e4d735d57 service swift] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:05.451339 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537778e-8640-4509-afd5-f19e4d735d57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:05.462663 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537778e-8640-4509-afd5-f19e4d735d57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:05.464336 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537778e-8640-4509-afd5-f19e4d735d57 service swift] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:05.475681 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1173/2337] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jul 19 15:34:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:34:05.699188 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2be3e8-d140-4d9e-8afc-bcdfc6cd49b5 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:05.699867 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2be3e8-d140-4d9e-8afc-bcdfc6cd49b5 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:05.700359 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2be3e8-d140-4d9e-8afc-bcdfc6cd49b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:05.741686 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-3e2be3e8-d140-4d9e-8afc-bcdfc6cd49b5 None None] MFA Rules not processed for user `f443bdddfe274794a35d7b5340229d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:05.744094 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-3e2be3e8-d140-4d9e-8afc-bcdfc6cd49b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:05.781515 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341b7c3-d552-4270-9218-04f6ca68c7ba None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:05.782128 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341b7c3-d552-4270-9218-04f6ca68c7ba None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:05.782530 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341b7c3-d552-4270-9218-04f6ca68c7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:05.815097 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-c341b7c3-d552-4270-9218-04f6ca68c7ba None None] MFA Rules not processed for user `cea1d8409c754ec797d6c694481a3112`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:05.816472 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-c341b7c3-d552-4270-9218-04f6ca68c7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:05.828628 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1174/2338] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jul 19 15:34:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:34:05.850148 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341b7c3-d552-4270-9218-04f6ca68c7ba None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:05.871523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341b7c3-d552-4270-9218-04f6ca68c7ba None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:05.873733 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1165/2339] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:34:05.884776 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4848115-6b47-4ead-8374-4c123dd639a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1dceaddb6e414faef0e0448cdf1be8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:05.886759 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2be3e8-d140-4d9e-8afc-bcdfc6cd49b5 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:05.887835 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4848115-6b47-4ead-8374-4c123dd639a7 service swift] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:05.888333 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4848115-6b47-4ead-8374-4c123dd639a7 service swift] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:05.888970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4848115-6b47-4ead-8374-4c123dd639a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:05.890760 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-3e2be3e8-d140-4d9e-8afc-bcdfc6cd49b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:05.916344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4848115-6b47-4ead-8374-4c123dd639a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:05.918905 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4848115-6b47-4ead-8374-4c123dd639a7 service swift] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:05.929664 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1175/2340] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jul 19 15:34:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 15:34:06.007179 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2be3e8-d140-4d9e-8afc-bcdfc6cd49b5 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:06.017120 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fdfd9-ab9b-4279-9474-62d76dbf451a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:06.017817 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fdfd9-ab9b-4279-9474-62d76dbf451a service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:06.018185 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fdfd9-ab9b-4279-9474-62d76dbf451a service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:06.018564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fdfd9-ab9b-4279-9474-62d76dbf451a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:06.032167 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9fdfd9-ab9b-4279-9474-62d76dbf451a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:06.036102 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9fdfd9-ab9b-4279-9474-62d76dbf451a service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:06.054542 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1166/2341] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:34:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:34:06.709139 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e2b4a-014e-4c0f-bd87-844aecaf5b0a None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:06.709578 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e2b4a-014e-4c0f-bd87-844aecaf5b0a None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:06.709993 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e2b4a-014e-4c0f-bd87-844aecaf5b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:06.730437 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-a20e2b4a-014e-4c0f-bd87-844aecaf5b0a None None] MFA Rules not processed for user `cea1d8409c754ec797d6c694481a3112`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:06.731830 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-a20e2b4a-014e-4c0f-bd87-844aecaf5b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:06.739949 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1176/2342] 10.222.0.44 () {58 vars in 967 bytes} [Tue Jul 19 15:34:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:34:06.752884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fdfd9-ab9b-4279-9474-62d76dbf451a service cinder] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:06.761380 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:06.768007 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fdfd9-ab9b-4279-9474-62d76dbf451a service cinder] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:06.773408 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd0d4c-a397-4d43-b114-0dc3613a4690 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1dceaddb6e414faef0e0448cdf1be8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:06.774058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd0d4c-a397-4d43-b114-0dc3613a4690 service swift] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:06.774351 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd0d4c-a397-4d43-b114-0dc3613a4690 service swift] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:06.774635 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd0d4c-a397-4d43-b114-0dc3613a4690 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:06.784550 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd0d4c-a397-4d43-b114-0dc3613a4690 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:06.786448 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd0d4c-a397-4d43-b114-0dc3613a4690 service swift] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:06.795747 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1167/2343] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jul 19 15:34:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:34:07.634135 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932e3e2-9c8a-452f-98cd-3e9b9ee0c747 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:07.634632 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932e3e2-9c8a-452f-98cd-3e9b9ee0c747 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:07.634734 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932e3e2-9c8a-452f-98cd-3e9b9ee0c747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:07.653092 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-6932e3e2-9c8a-452f-98cd-3e9b9ee0c747 None None] MFA Rules not processed for user `f443bdddfe274794a35d7b5340229d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:07.654308 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-6932e3e2-9c8a-452f-98cd-3e9b9ee0c747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:07.661531 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1177/2344] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:34:09.055571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd0d4c-a397-4d43-b114-0dc3613a4690 service swift] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:09.059026 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-8edd0d4c-a397-4d43-b114-0dc3613a4690 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:09.088958 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd0d4c-a397-4d43-b114-0dc3613a4690 service swift] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:09.102342 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e086f-245e-42cd-9c0d-614f474f9cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:09.104277 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e086f-245e-42cd-9c0d-614f474f9cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:09.104812 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e086f-245e-42cd-9c0d-614f474f9cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:09.105349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e086f-245e-42cd-9c0d-614f474f9cbf admin admin] PATH_INFO: `/v3/users/0a6b2e492f9e426eaf1136f60fa57bb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:09.108905 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e086f-245e-42cd-9c0d-614f474f9cbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a6b2e492f9e426eaf1136f60fa57bb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:09.113678 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e086f-245e-42cd-9c0d-614f474f9cbf admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:09.192009 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-f18e086f-245e-42cd-9c0d-614f474f9cbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a6b2e492f9e426eaf1136f60fa57bb0'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:09.206424 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-f18e086f-245e-42cd-9c0d-614f474f9cbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a6b2e492f9e426eaf1136f60fa57bb0'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:09.216272 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-f18e086f-245e-42cd-9c0d-614f474f9cbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a6b2e492f9e426eaf1136f60fa57bb0'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:09.217035 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-f18e086f-245e-42cd-9c0d-614f474f9cbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a6b2e492f9e426eaf1136f60fa57bb0'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:09.217760 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-f18e086f-245e-42cd-9c0d-614f474f9cbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a6b2e492f9e426eaf1136f60fa57bb0'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:09.235394 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1168/2345] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:34:09 2022] DELETE /identity/v3/users/0a6b2e492f9e426eaf1136f60fa57bb0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:34:09.241129 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dbf59-dbba-44b6-88f6-d22417d90245 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:09.242202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dbf59-dbba-44b6-88f6-d22417d90245 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:09.242664 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dbf59-dbba-44b6-88f6-d22417d90245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:09.266635 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-a71dbf59-dbba-44b6-88f6-d22417d90245 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:09.268154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-a71dbf59-dbba-44b6-88f6-d22417d90245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:09.274842 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:09.366822 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1178/2346] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:34:09.383360 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e086f-245e-42cd-9c0d-614f474f9cbf admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:09.385075 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-f18e086f-245e-42cd-9c0d-614f474f9cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:09.464360 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e086f-245e-42cd-9c0d-614f474f9cbf admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:09.469330 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107bad99-dbe4-4a03-8e00-b214b89e26c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:09.469993 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bad99-dbe4-4a03-8e00-b214b89e26c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:09.470280 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bad99-dbe4-4a03-8e00-b214b89e26c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:09.470598 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bad99-dbe4-4a03-8e00-b214b89e26c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:09.482007 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107bad99-dbe4-4a03-8e00-b214b89e26c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:09.483808 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107bad99-dbe4-4a03-8e00-b214b89e26c5 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:09.495634 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1169/2347] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:34:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:34:09.928369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71dbf59-dbba-44b6-88f6-d22417d90245 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:09.929948 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-a71dbf59-dbba-44b6-88f6-d22417d90245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:09.948552 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71dbf59-dbba-44b6-88f6-d22417d90245 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:09.953490 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bf6c9-7027-4e31-95b4-b6dfc28a3c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:09.954579 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bf6c9-7027-4e31-95b4-b6dfc28a3c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:09.954872 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bf6c9-7027-4e31-95b4-b6dfc28a3c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:09.955154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bf6c9-7027-4e31-95b4-b6dfc28a3c67 admin admin] PATH_INFO: `/v3/projects/7b70b0860fee4b9a97222b1feae5f73b` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:09.956414 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429bf6c9-7027-4e31-95b4-b6dfc28a3c67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b70b0860fee4b9a97222b1feae5f73b)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:09.959615 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429bf6c9-7027-4e31-95b4-b6dfc28a3c67 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:10.010022 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-429bf6c9-7027-4e31-95b4-b6dfc28a3c67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b70b0860fee4b9a97222b1feae5f73b', 'request_id': 'req-429bf6c9-7027-4e31-95b4-b6dfc28a3c67'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:10.016695 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-429bf6c9-7027-4e31-95b4-b6dfc28a3c67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b70b0860fee4b9a97222b1feae5f73b', 'request_id': 'req-429bf6c9-7027-4e31-95b4-b6dfc28a3c67'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:10.025568 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-429bf6c9-7027-4e31-95b4-b6dfc28a3c67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b70b0860fee4b9a97222b1feae5f73b', 'request_id': 'req-429bf6c9-7027-4e31-95b4-b6dfc28a3c67'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:10.036691 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-429bf6c9-7027-4e31-95b4-b6dfc28a3c67 admin admin] The token cache is being invalidate because project 7b70b0860fee4b9a97222b1feae5f73b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:34:10.036935 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-429bf6c9-7027-4e31-95b4-b6dfc28a3c67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:10.037571 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-429bf6c9-7027-4e31-95b4-b6dfc28a3c67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:10.039133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1179/2348] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:34:09 2022] DELETE /identity/v3/projects/7b70b0860fee4b9a97222b1feae5f73b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:34:10.044097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a00044-5994-40da-b13c-04bf796d7bc9 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:10.044468 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a00044-5994-40da-b13c-04bf796d7bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:10.044825 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a00044-5994-40da-b13c-04bf796d7bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:10.064748 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-79a00044-5994-40da-b13c-04bf796d7bc9 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:10.065976 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-79a00044-5994-40da-b13c-04bf796d7bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:10.131197 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1170/2349] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:34:10.138579 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f78bed-2d17-4b10-9190-3144e45ea8d6 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:10.138910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f78bed-2d17-4b10-9190-3144e45ea8d6 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:10.139197 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f78bed-2d17-4b10-9190-3144e45ea8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:10.158812 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-b5f78bed-2d17-4b10-9190-3144e45ea8d6 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:10.160141 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-b5f78bed-2d17-4b10-9190-3144e45ea8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:10.168751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1180/2350] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:34:10.174182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a00044-5994-40da-b13c-04bf796d7bc9 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:10.184453 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a00044-5994-40da-b13c-04bf796d7bc9 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:10.189542 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d31075-c887-4165-a375-fea88f26a893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:10.190194 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d31075-c887-4165-a375-fea88f26a893 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:10.190484 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d31075-c887-4165-a375-fea88f26a893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:10.190761 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d31075-c887-4165-a375-fea88f26a893 admin admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:10.191576 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d31075-c887-4165-a375-fea88f26a893 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:34:10.191849 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d31075-c887-4165-a375-fea88f26a893 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:10.193453 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d31075-c887-4165-a375-fea88f26a893 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:10.195178 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:10.207055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1171/2351] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:34:10.211905 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f78bed-2d17-4b10-9190-3144e45ea8d6 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:10.222371 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f78bed-2d17-4b10-9190-3144e45ea8d6 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:10.227827 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22099a7-fdd6-44be-aa7b-ca6d9fa2491c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:10.228540 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22099a7-fdd6-44be-aa7b-ca6d9fa2491c admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:10.228836 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22099a7-fdd6-44be-aa7b-ca6d9fa2491c admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:10.229124 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22099a7-fdd6-44be-aa7b-ca6d9fa2491c admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:10.229855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22099a7-fdd6-44be-aa7b-ca6d9fa2491c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:10.231856 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22099a7-fdd6-44be-aa7b-ca6d9fa2491c admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:10.261115 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1181/2352] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:34:10 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:34:10.266996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d31075-c887-4165-a375-fea88f26a893 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:10.280900 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d31075-c887-4165-a375-fea88f26a893 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:10.351406 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a36e1-571c-46da-ab41-fbca0f831c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:10.352120 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a36e1-571c-46da-ab41-fbca0f831c32 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:10.352416 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a36e1-571c-46da-ab41-fbca0f831c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:10.352696 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a36e1-571c-46da-ab41-fbca0f831c32 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:10.353664 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a36e1-571c-46da-ab41-fbca0f831c32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:10.355625 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a36e1-571c-46da-ab41-fbca0f831c32 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:10.380710 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1172/2353] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:34:10 2022] POST /identity/v3/users => generated 300 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:34:10.382630 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22099a7-fdd6-44be-aa7b-ca6d9fa2491c admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:10.396358 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22099a7-fdd6-44be-aa7b-ca6d9fa2491c admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:10.401731 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3049dff-1297-4df3-a631-8fdeefa00fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:10.402411 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3049dff-1297-4df3-a631-8fdeefa00fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:10.402697 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3049dff-1297-4df3-a631-8fdeefa00fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:10.403004 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3049dff-1297-4df3-a631-8fdeefa00fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:10.403771 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3049dff-1297-4df3-a631-8fdeefa00fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:10.405506 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3049dff-1297-4df3-a631-8fdeefa00fc2 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:10.412344 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a36e1-571c-46da-ab41-fbca0f831c32 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:10.414944 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-3d1a36e1-571c-46da-ab41-fbca0f831c32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:10.419569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1182/2354] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:34:10.423515 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3049dff-1297-4df3-a631-8fdeefa00fc2 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:10.428070 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a36e1-571c-46da-ab41-fbca0f831c32 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:10.433134 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3e880-4e34-4e7e-97f0-fa9b5e29af89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:10.433290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3049dff-1297-4df3-a631-8fdeefa00fc2 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:10.434068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3e880-4e34-4e7e-97f0-fa9b5e29af89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:10.434356 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3e880-4e34-4e7e-97f0-fa9b5e29af89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:10.434643 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3e880-4e34-4e7e-97f0-fa9b5e29af89 admin admin] PATH_INFO: `/v3/users/58a1f75d40434f0bbb749a45c190acca` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:10.435893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3e880-4e34-4e7e-97f0-fa9b5e29af89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58a1f75d40434f0bbb749a45c190acca)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:10.438383 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3e880-4e34-4e7e-97f0-fa9b5e29af89 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:10.438798 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da133fc-00b6-4b94-affe-4c37aec3d19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:10.439522 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da133fc-00b6-4b94-affe-4c37aec3d19d admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:10.439823 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da133fc-00b6-4b94-affe-4c37aec3d19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:10.440318 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da133fc-00b6-4b94-affe-4c37aec3d19d admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:10.441509 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da133fc-00b6-4b94-affe-4c37aec3d19d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:10.443120 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da133fc-00b6-4b94-affe-4c37aec3d19d admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:10.454388 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1183/2355] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:34:10.458661 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da133fc-00b6-4b94-affe-4c37aec3d19d admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:10.469211 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da133fc-00b6-4b94-affe-4c37aec3d19d admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:10.474454 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888a5cc-5256-486f-8bd6-553be3d558ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:10.475459 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888a5cc-5256-486f-8bd6-553be3d558ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:10.475803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888a5cc-5256-486f-8bd6-553be3d558ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:10.476098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888a5cc-5256-486f-8bd6-553be3d558ee admin admin] PATH_INFO: `/v3/projects/5e428bca48794c238f9f44e40a6302cd/users/a37837031f5c4b65b8e0f22fe4394cbf/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:10.492115 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-29f3e880-4e34-4e7e-97f0-fa9b5e29af89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58a1f75d40434f0bbb749a45c190acca'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:10.493753 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888a5cc-5256-486f-8bd6-553be3d558ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e428bca48794c238f9f44e40a6302cd, user_id=a37837031f5c4b65b8e0f22fe4394cbf, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:10.496437 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888a5cc-5256-486f-8bd6-553be3d558ee admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:10.505883 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-29f3e880-4e34-4e7e-97f0-fa9b5e29af89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58a1f75d40434f0bbb749a45c190acca'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:10.510351 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1184/2356] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:34:10 2022] PUT /identity/v3/projects/5e428bca48794c238f9f44e40a6302cd/users/a37837031f5c4b65b8e0f22fe4394cbf/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:34:10.513167 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-29f3e880-4e34-4e7e-97f0-fa9b5e29af89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58a1f75d40434f0bbb749a45c190acca'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:10.513881 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-29f3e880-4e34-4e7e-97f0-fa9b5e29af89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58a1f75d40434f0bbb749a45c190acca'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:10.514507 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-29f3e880-4e34-4e7e-97f0-fa9b5e29af89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58a1f75d40434f0bbb749a45c190acca'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:10.521375 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a343cb7-4506-413d-aaed-2bf1a51a0700 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:10.521953 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a343cb7-4506-413d-aaed-2bf1a51a0700 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:10.522238 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a343cb7-4506-413d-aaed-2bf1a51a0700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:10.528941 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1173/2357] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:34:10 2022] DELETE /identity/v3/users/58a1f75d40434f0bbb749a45c190acca => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:34:10.555180 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-5a343cb7-4506-413d-aaed-2bf1a51a0700 None None] MFA Rules not processed for user `a37837031f5c4b65b8e0f22fe4394cbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:10.556391 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-5a343cb7-4506-413d-aaed-2bf1a51a0700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:10.571016 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:10.702832 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1185/2358] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:34:10.704141 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3e880-4e34-4e7e-97f0-fa9b5e29af89 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:10.706043 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-29f3e880-4e34-4e7e-97f0-fa9b5e29af89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:10.800505 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3e880-4e34-4e7e-97f0-fa9b5e29af89 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:10.806589 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f62bf-935d-48ab-acdc-9aec9cd898d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:10.807569 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f62bf-935d-48ab-acdc-9aec9cd898d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:10.808048 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f62bf-935d-48ab-acdc-9aec9cd898d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:10.808525 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f62bf-935d-48ab-acdc-9aec9cd898d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:10.823098 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f62bf-935d-48ab-acdc-9aec9cd898d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:10.825505 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f62bf-935d-48ab-acdc-9aec9cd898d2 service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:10.831728 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:10.856179 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1174/2359] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:34:10 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:34:11.112593 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a343cb7-4506-413d-aaed-2bf1a51a0700 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:11.114606 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-5a343cb7-4506-413d-aaed-2bf1a51a0700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:11.272717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a343cb7-4506-413d-aaed-2bf1a51a0700 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:11.300561 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a42d5-3e57-4b1d-ae96-8fd7ad0a9251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:11.301920 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a42d5-3e57-4b1d-ae96-8fd7ad0a9251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:11.302448 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a42d5-3e57-4b1d-ae96-8fd7ad0a9251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:11.302873 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a42d5-3e57-4b1d-ae96-8fd7ad0a9251 admin admin] PATH_INFO: `/v3/projects/e47d60492ece472aadd3cc7f155031e1` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:11.307454 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a42d5-3e57-4b1d-ae96-8fd7ad0a9251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e47d60492ece472aadd3cc7f155031e1)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:11.309991 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a42d5-3e57-4b1d-ae96-8fd7ad0a9251 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:11.373418 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-782a42d5-3e57-4b1d-ae96-8fd7ad0a9251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e47d60492ece472aadd3cc7f155031e1', 'request_id': 'req-782a42d5-3e57-4b1d-ae96-8fd7ad0a9251'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:11.382386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-782a42d5-3e57-4b1d-ae96-8fd7ad0a9251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e47d60492ece472aadd3cc7f155031e1', 'request_id': 'req-782a42d5-3e57-4b1d-ae96-8fd7ad0a9251'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:11.393295 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-782a42d5-3e57-4b1d-ae96-8fd7ad0a9251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e47d60492ece472aadd3cc7f155031e1', 'request_id': 'req-782a42d5-3e57-4b1d-ae96-8fd7ad0a9251'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:11.419912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-782a42d5-3e57-4b1d-ae96-8fd7ad0a9251 admin admin] The token cache is being invalidate because project e47d60492ece472aadd3cc7f155031e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:34:11.420525 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-782a42d5-3e57-4b1d-ae96-8fd7ad0a9251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:11.422865 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-782a42d5-3e57-4b1d-ae96-8fd7ad0a9251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:11.425321 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1186/2360] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:34:11 2022] DELETE /identity/v3/projects/e47d60492ece472aadd3cc7f155031e1 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:34:11.429177 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f62bf-935d-48ab-acdc-9aec9cd898d2 service cinder] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:11.442755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f62bf-935d-48ab-acdc-9aec9cd898d2 service cinder] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:11.517069 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851cc60d-de58-4f9e-bacb-c5a4a679aac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:11.517960 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851cc60d-de58-4f9e-bacb-c5a4a679aac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:11.518250 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851cc60d-de58-4f9e-bacb-c5a4a679aac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:11.518533 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851cc60d-de58-4f9e-bacb-c5a4a679aac3 admin admin] PATH_INFO: `/v3/users/7c6c42229d024c5e9f88c26d7fd87e36` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:11.519781 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851cc60d-de58-4f9e-bacb-c5a4a679aac3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c6c42229d024c5e9f88c26d7fd87e36)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:11.522047 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851cc60d-de58-4f9e-bacb-c5a4a679aac3 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:11.578541 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-851cc60d-de58-4f9e-bacb-c5a4a679aac3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c6c42229d024c5e9f88c26d7fd87e36'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:11.590249 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-851cc60d-de58-4f9e-bacb-c5a4a679aac3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c6c42229d024c5e9f88c26d7fd87e36'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:11.597955 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-851cc60d-de58-4f9e-bacb-c5a4a679aac3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c6c42229d024c5e9f88c26d7fd87e36'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:11.598820 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-851cc60d-de58-4f9e-bacb-c5a4a679aac3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c6c42229d024c5e9f88c26d7fd87e36'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:11.599445 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-851cc60d-de58-4f9e-bacb-c5a4a679aac3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c6c42229d024c5e9f88c26d7fd87e36'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:11.613706 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1175/2361] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:34:11 2022] DELETE /identity/v3/users/7c6c42229d024c5e9f88c26d7fd87e36 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:34:12.116471 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a42d5-3e57-4b1d-ae96-8fd7ad0a9251 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:12.117121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-782a42d5-3e57-4b1d-ae96-8fd7ad0a9251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:12.131848 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a42d5-3e57-4b1d-ae96-8fd7ad0a9251 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:12.185231 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:12.210624 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed3b0f-34be-4fbf-9895-87a9b14a363d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:12.211527 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed3b0f-34be-4fbf-9895-87a9b14a363d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:12.211795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed3b0f-34be-4fbf-9895-87a9b14a363d admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:12.212100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed3b0f-34be-4fbf-9895-87a9b14a363d admin admin] PATH_INFO: `/v3/projects/7ecd41a3eaf14d659aac48f5bc409d45` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:12.223371 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed3b0f-34be-4fbf-9895-87a9b14a363d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ecd41a3eaf14d659aac48f5bc409d45)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:12.226646 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed3b0f-34be-4fbf-9895-87a9b14a363d admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:12.286188 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-b0ed3b0f-34be-4fbf-9895-87a9b14a363d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ecd41a3eaf14d659aac48f5bc409d45', 'request_id': 'req-b0ed3b0f-34be-4fbf-9895-87a9b14a363d'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:12.293862 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-b0ed3b0f-34be-4fbf-9895-87a9b14a363d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ecd41a3eaf14d659aac48f5bc409d45', 'request_id': 'req-b0ed3b0f-34be-4fbf-9895-87a9b14a363d'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:12.304448 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-b0ed3b0f-34be-4fbf-9895-87a9b14a363d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ecd41a3eaf14d659aac48f5bc409d45', 'request_id': 'req-b0ed3b0f-34be-4fbf-9895-87a9b14a363d'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:12.318264 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-b0ed3b0f-34be-4fbf-9895-87a9b14a363d admin admin] The token cache is being invalidate because project 7ecd41a3eaf14d659aac48f5bc409d45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:34:12.318574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-b0ed3b0f-34be-4fbf-9895-87a9b14a363d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:12.320085 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-b0ed3b0f-34be-4fbf-9895-87a9b14a363d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:12.325586 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1187/2362] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:34:12 2022] DELETE /identity/v3/projects/7ecd41a3eaf14d659aac48f5bc409d45 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:34:12.326875 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19788d40-2c70-4bff-825c-daad7bb77b36 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:12.327170 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19788d40-2c70-4bff-825c-daad7bb77b36 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:12.327537 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19788d40-2c70-4bff-825c-daad7bb77b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:12.349019 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-19788d40-2c70-4bff-825c-daad7bb77b36 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:12.350162 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-19788d40-2c70-4bff-825c-daad7bb77b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:12.454189 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1176/2363] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:34:12.465949 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6145fa-2f45-45a6-8967-e5f6b9f05137 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:12.466504 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6145fa-2f45-45a6-8967-e5f6b9f05137 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:12.466941 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6145fa-2f45-45a6-8967-e5f6b9f05137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:12.542970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-bc6145fa-2f45-45a6-8967-e5f6b9f05137 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:12.545768 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-bc6145fa-2f45-45a6-8967-e5f6b9f05137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:12.573257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1188/2364] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:34:12.574605 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19788d40-2c70-4bff-825c-daad7bb77b36 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:12.600065 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19788d40-2c70-4bff-825c-daad7bb77b36 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:12.618496 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707438f-9af1-407e-a1e8-934dc6359567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:12.619260 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707438f-9af1-407e-a1e8-934dc6359567 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:12.620295 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707438f-9af1-407e-a1e8-934dc6359567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:12.620624 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707438f-9af1-407e-a1e8-934dc6359567 admin admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:12.621533 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707438f-9af1-407e-a1e8-934dc6359567 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:34:12.621944 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707438f-9af1-407e-a1e8-934dc6359567 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:12.624174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707438f-9af1-407e-a1e8-934dc6359567 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:12.653168 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1177/2365] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:34:12.654886 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6145fa-2f45-45a6-8967-e5f6b9f05137 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:12.672045 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6145fa-2f45-45a6-8967-e5f6b9f05137 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:12.680551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21ec79-2843-4e08-9785-4b00d6bcab2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:12.681434 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21ec79-2843-4e08-9785-4b00d6bcab2e admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:12.681969 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21ec79-2843-4e08-9785-4b00d6bcab2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:12.682382 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21ec79-2843-4e08-9785-4b00d6bcab2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:12.683473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba21ec79-2843-4e08-9785-4b00d6bcab2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:12.685898 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba21ec79-2843-4e08-9785-4b00d6bcab2e admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:12.746965 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1189/2366] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:34:12 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:34:12.747991 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707438f-9af1-407e-a1e8-934dc6359567 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:12.759920 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:12.767772 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707438f-9af1-407e-a1e8-934dc6359567 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:12.897169 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309154a-419b-43da-9ae4-605462449aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:12.897868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309154a-419b-43da-9ae4-605462449aff admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:12.898158 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309154a-419b-43da-9ae4-605462449aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:12.898428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309154a-419b-43da-9ae4-605462449aff admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:12.899208 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309154a-419b-43da-9ae4-605462449aff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:12.901398 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309154a-419b-43da-9ae4-605462449aff admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:12.949598 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1178/2367] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:34:12 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:34:12.954943 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21ec79-2843-4e08-9785-4b00d6bcab2e admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:12.977787 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21ec79-2843-4e08-9785-4b00d6bcab2e admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:12.983152 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ecc560-0c79-4416-aa87-0c79578adeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:12.985726 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecc560-0c79-4416-aa87-0c79578adeed admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:12.986169 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecc560-0c79-4416-aa87-0c79578adeed admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:12.986462 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecc560-0c79-4416-aa87-0c79578adeed admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:12.987321 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ecc560-0c79-4416-aa87-0c79578adeed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:12.989312 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ecc560-0c79-4416-aa87-0c79578adeed admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:13.006028 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1190/2368] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:34:13.008247 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309154a-419b-43da-9ae4-605462449aff admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:13.019927 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309154a-419b-43da-9ae4-605462449aff admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:13.025236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16cc9f-0e5e-4da3-87c7-d2a115652b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:13.025914 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16cc9f-0e5e-4da3-87c7-d2a115652b6c admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:13.026194 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16cc9f-0e5e-4da3-87c7-d2a115652b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:13.026465 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16cc9f-0e5e-4da3-87c7-d2a115652b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:13.027203 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16cc9f-0e5e-4da3-87c7-d2a115652b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:13.028864 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16cc9f-0e5e-4da3-87c7-d2a115652b6c admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:13.044078 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1179/2369] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:34:13.055617 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ecc560-0c79-4416-aa87-0c79578adeed admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:13.066496 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ecc560-0c79-4416-aa87-0c79578adeed admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:13.071603 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775c00f-7ed7-47a6-9bb9-053537e5fc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:13.072555 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775c00f-7ed7-47a6-9bb9-053537e5fc9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:13.072849 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775c00f-7ed7-47a6-9bb9-053537e5fc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:13.073230 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775c00f-7ed7-47a6-9bb9-053537e5fc9b admin admin] PATH_INFO: `/v3/projects/83a12faff906418d84b01c4a5940bb1d/users/d4d4ff66975b48c0984f918614220e43/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:13.091612 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775c00f-7ed7-47a6-9bb9-053537e5fc9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=83a12faff906418d84b01c4a5940bb1d, user_id=d4d4ff66975b48c0984f918614220e43, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:13.094619 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775c00f-7ed7-47a6-9bb9-053537e5fc9b admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:13.112578 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1191/2370] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:34:13 2022] PUT /identity/v3/projects/83a12faff906418d84b01c4a5940bb1d/users/d4d4ff66975b48c0984f918614220e43/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:34:13.123195 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b1ac6-e4dc-45df-ba7c-cb133aad1357 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:13.123526 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b1ac6-e4dc-45df-ba7c-cb133aad1357 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:13.123809 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b1ac6-e4dc-45df-ba7c-cb133aad1357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:13.153895 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-480b1ac6-e4dc-45df-ba7c-cb133aad1357 None None] MFA Rules not processed for user `d4d4ff66975b48c0984f918614220e43`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:13.155126 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-480b1ac6-e4dc-45df-ba7c-cb133aad1357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:13.236576 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1180/2371] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:34:13.237809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775c00f-7ed7-47a6-9bb9-053537e5fc9b admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:13.310600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775c00f-7ed7-47a6-9bb9-053537e5fc9b admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:13.315641 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d9eb6-895e-4ecb-ad72-13b3919cfd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:13.316371 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d9eb6-895e-4ecb-ad72-13b3919cfd04 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:13.316650 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d9eb6-895e-4ecb-ad72-13b3919cfd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:13.316956 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d9eb6-895e-4ecb-ad72-13b3919cfd04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:13.317673 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d9eb6-895e-4ecb-ad72-13b3919cfd04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:13.319682 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d9eb6-895e-4ecb-ad72-13b3919cfd04 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:13.330469 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:13.353253 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1192/2372] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:34:13 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:34:13.354530 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b1ac6-e4dc-45df-ba7c-cb133aad1357 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:13.366086 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b1ac6-e4dc-45df-ba7c-cb133aad1357 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:13.428087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fb984-7085-4e8d-b669-d27ac9543ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:13.428769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fb984-7085-4e8d-b669-d27ac9543ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:13.429060 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fb984-7085-4e8d-b669-d27ac9543ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:13.429346 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fb984-7085-4e8d-b669-d27ac9543ae7 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:13.430058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1fb984-7085-4e8d-b669-d27ac9543ae7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:13.432085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1fb984-7085-4e8d-b669-d27ac9543ae7 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:13.452634 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1181/2373] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:34:13 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:34:13.456720 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d9eb6-895e-4ecb-ad72-13b3919cfd04 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:13.467618 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d9eb6-895e-4ecb-ad72-13b3919cfd04 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:13.473038 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac86cb-7a67-4fb3-80d6-cfe9085e6ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:13.473760 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac86cb-7a67-4fb3-80d6-cfe9085e6ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:13.474108 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac86cb-7a67-4fb3-80d6-cfe9085e6ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:13.474396 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac86cb-7a67-4fb3-80d6-cfe9085e6ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:13.475187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac86cb-7a67-4fb3-80d6-cfe9085e6ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:13.476949 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac86cb-7a67-4fb3-80d6-cfe9085e6ca5 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:13.489715 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1193/2374] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:34:13.494027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fb984-7085-4e8d-b669-d27ac9543ae7 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:13.499892 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:13.506333 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fb984-7085-4e8d-b669-d27ac9543ae7 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:13.511688 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0784954-6d53-4095-8abb-5e5284ff0c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:13.512748 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0784954-6d53-4095-8abb-5e5284ff0c2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:13.512872 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0784954-6d53-4095-8abb-5e5284ff0c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:13.513128 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0784954-6d53-4095-8abb-5e5284ff0c2d admin admin] PATH_INFO: `/v3/projects/50734019d29b4155a8295d32d0081add/users/b8e5022219444a69bc988e77a9ce4b14/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:13.530109 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0784954-6d53-4095-8abb-5e5284ff0c2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=50734019d29b4155a8295d32d0081add, user_id=b8e5022219444a69bc988e77a9ce4b14, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:13.533380 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0784954-6d53-4095-8abb-5e5284ff0c2d admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:13.546925 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1182/2375] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:34:13 2022] PUT /identity/v3/projects/50734019d29b4155a8295d32d0081add/users/b8e5022219444a69bc988e77a9ce4b14/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:34:13.551180 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac86cb-7a67-4fb3-80d6-cfe9085e6ca5 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:13.563434 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac86cb-7a67-4fb3-80d6-cfe9085e6ca5 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:13.635420 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613313f-7939-4f6a-a482-af3ce6c7da75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:13.636050 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613313f-7939-4f6a-a482-af3ce6c7da75 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:13.636340 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613313f-7939-4f6a-a482-af3ce6c7da75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:13.636626 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613313f-7939-4f6a-a482-af3ce6c7da75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:13.637386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613313f-7939-4f6a-a482-af3ce6c7da75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:13.639075 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613313f-7939-4f6a-a482-af3ce6c7da75 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:13.665861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1194/2376] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:34:13.669699 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0784954-6d53-4095-8abb-5e5284ff0c2d admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:13.693270 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0784954-6d53-4095-8abb-5e5284ff0c2d admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:13.699799 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ffb20-9644-49a0-9927-b26987654c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:13.701789 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ffb20-9644-49a0-9927-b26987654c5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:13.702601 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ffb20-9644-49a0-9927-b26987654c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:13.703054 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ffb20-9644-49a0-9927-b26987654c5a admin admin] PATH_INFO: `/v3/projects/50734019d29b4155a8295d32d0081add/users/b8e5022219444a69bc988e77a9ce4b14/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:13.706313 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ffb20-9644-49a0-9927-b26987654c5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=50734019d29b4155a8295d32d0081add, user_id=b8e5022219444a69bc988e77a9ce4b14, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:13.709554 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ffb20-9644-49a0-9927-b26987654c5a admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:13.727337 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1183/2377] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:34:13 2022] PUT /identity/v3/projects/50734019d29b4155a8295d32d0081add/users/b8e5022219444a69bc988e77a9ce4b14/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:34:13.736031 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3ee18-d4a9-4b67-9540-9bea4061ee9c None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:13.736323 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3ee18-d4a9-4b67-9540-9bea4061ee9c None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:13.736634 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3ee18-d4a9-4b67-9540-9bea4061ee9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:13.765712 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-64f3ee18-d4a9-4b67-9540-9bea4061ee9c None None] MFA Rules not processed for user `b8e5022219444a69bc988e77a9ce4b14`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:13.766855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-64f3ee18-d4a9-4b67-9540-9bea4061ee9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:13.911511 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1195/2378] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:34:13.926264 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ffb20-9644-49a0-9927-b26987654c5a admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:13.928556 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-7d1ffb20-9644-49a0-9927-b26987654c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:14.036528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ffb20-9644-49a0-9927-b26987654c5a admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:14.040572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a38e6-bc72-462d-9195-9d47ed528eea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:14.041496 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a38e6-bc72-462d-9195-9d47ed528eea service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:14.041843 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a38e6-bc72-462d-9195-9d47ed528eea service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:14.042211 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a38e6-bc72-462d-9195-9d47ed528eea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:14.139823 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a38e6-bc72-462d-9195-9d47ed528eea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:14.141277 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a38e6-bc72-462d-9195-9d47ed528eea service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:14.159525 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1184/2379] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:34:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:34:16.508303 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3ee18-d4a9-4b67-9540-9bea4061ee9c None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:16.509737 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-64f3ee18-d4a9-4b67-9540-9bea4061ee9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:16.579601 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3ee18-d4a9-4b67-9540-9bea4061ee9c None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:16.584383 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf433e4-95c0-4664-9705-fbacb5d3b11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:16.585267 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf433e4-95c0-4664-9705-fbacb5d3b11e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:16.585558 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf433e4-95c0-4664-9705-fbacb5d3b11e admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:16.585839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf433e4-95c0-4664-9705-fbacb5d3b11e admin admin] PATH_INFO: `/v3/users/a37837031f5c4b65b8e0f22fe4394cbf` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:16.587049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf433e4-95c0-4664-9705-fbacb5d3b11e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a37837031f5c4b65b8e0f22fe4394cbf)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:16.589091 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf433e4-95c0-4664-9705-fbacb5d3b11e admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:16.592192 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:16.650305 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-7cf433e4-95c0-4664-9705-fbacb5d3b11e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a37837031f5c4b65b8e0f22fe4394cbf'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:16.664790 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-7cf433e4-95c0-4664-9705-fbacb5d3b11e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a37837031f5c4b65b8e0f22fe4394cbf'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:16.673455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-7cf433e4-95c0-4664-9705-fbacb5d3b11e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a37837031f5c4b65b8e0f22fe4394cbf'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:16.674285 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-7cf433e4-95c0-4664-9705-fbacb5d3b11e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a37837031f5c4b65b8e0f22fe4394cbf'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:16.674980 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-7cf433e4-95c0-4664-9705-fbacb5d3b11e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a37837031f5c4b65b8e0f22fe4394cbf'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:16.693744 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1196/2380] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:34:16 2022] DELETE /identity/v3/users/a37837031f5c4b65b8e0f22fe4394cbf => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:34:16.698048 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b2dda-700c-471f-ad81-43d0a2b62c2f None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:16.698559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b2dda-700c-471f-ad81-43d0a2b62c2f None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:16.698673 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b2dda-700c-471f-ad81-43d0a2b62c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:16.718495 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-e79b2dda-700c-471f-ad81-43d0a2b62c2f None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:16.719312 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-e79b2dda-700c-471f-ad81-43d0a2b62c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:16.794365 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1185/2381] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:34:16.803880 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf433e4-95c0-4664-9705-fbacb5d3b11e admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:16.805284 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-7cf433e4-95c0-4664-9705-fbacb5d3b11e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:16.865463 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf433e4-95c0-4664-9705-fbacb5d3b11e admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:16.869186 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49cc50-1ab4-4f8c-bc66-62e4c84c5ac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:16.869837 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49cc50-1ab4-4f8c-bc66-62e4c84c5ac8 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:16.870124 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49cc50-1ab4-4f8c-bc66-62e4c84c5ac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:16.870405 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49cc50-1ab4-4f8c-bc66-62e4c84c5ac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:16.880159 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49cc50-1ab4-4f8c-bc66-62e4c84c5ac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:16.881580 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49cc50-1ab4-4f8c-bc66-62e4c84c5ac8 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:16.894043 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1197/2382] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:34:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:34:17.307705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b2dda-700c-471f-ad81-43d0a2b62c2f None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:17.308788 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-e79b2dda-700c-471f-ad81-43d0a2b62c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:17.323476 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b2dda-700c-471f-ad81-43d0a2b62c2f None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:17.329472 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bc3c3-c742-4d15-ba10-c0233719976c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:17.330634 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bc3c3-c742-4d15-ba10-c0233719976c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:17.331136 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bc3c3-c742-4d15-ba10-c0233719976c admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:17.331402 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bc3c3-c742-4d15-ba10-c0233719976c admin admin] PATH_INFO: `/v3/projects/5e428bca48794c238f9f44e40a6302cd` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:17.333256 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40bc3c3-c742-4d15-ba10-c0233719976c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e428bca48794c238f9f44e40a6302cd)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:17.335531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40bc3c3-c742-4d15-ba10-c0233719976c admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:17.359724 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:17.419120 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-d40bc3c3-c742-4d15-ba10-c0233719976c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e428bca48794c238f9f44e40a6302cd', 'request_id': 'req-d40bc3c3-c742-4d15-ba10-c0233719976c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:17.427135 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-d40bc3c3-c742-4d15-ba10-c0233719976c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e428bca48794c238f9f44e40a6302cd', 'request_id': 'req-d40bc3c3-c742-4d15-ba10-c0233719976c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:17.437585 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-d40bc3c3-c742-4d15-ba10-c0233719976c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e428bca48794c238f9f44e40a6302cd', 'request_id': 'req-d40bc3c3-c742-4d15-ba10-c0233719976c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:17.468283 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-d40bc3c3-c742-4d15-ba10-c0233719976c admin admin] The token cache is being invalidate because project 5e428bca48794c238f9f44e40a6302cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:34:17.469075 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-d40bc3c3-c742-4d15-ba10-c0233719976c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:17.469840 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-d40bc3c3-c742-4d15-ba10-c0233719976c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:17.483823 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1186/2383] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:34:17 2022] DELETE /identity/v3/projects/5e428bca48794c238f9f44e40a6302cd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:34:18.564588 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49cc50-1ab4-4f8c-bc66-62e4c84c5ac8 service neutron] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:18.566008 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-bb49cc50-1ab4-4f8c-bc66-62e4c84c5ac8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:18.630366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49cc50-1ab4-4f8c-bc66-62e4c84c5ac8 service neutron] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:18.682109 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:18.703392 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d20ec-3b3c-443b-bb06-e72b29979f42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:18.704123 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d20ec-3b3c-443b-bb06-e72b29979f42 service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:18.704354 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d20ec-3b3c-443b-bb06-e72b29979f42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:18.704685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d20ec-3b3c-443b-bb06-e72b29979f42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:18.706511 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-164d20ec-3b3c-443b-bb06-e72b29979f42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:18.783439 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d20ec-3b3c-443b-bb06-e72b29979f42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:18.785278 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d20ec-3b3c-443b-bb06-e72b29979f42 service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:18.801136 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1198/2384] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:34:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:34:19.731047 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bc3c3-c742-4d15-ba10-c0233719976c admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:19.733703 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-d40bc3c3-c742-4d15-ba10-c0233719976c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:19.803353 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bc3c3-c742-4d15-ba10-c0233719976c admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:19.807927 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a73fe1-007b-4e67-800c-0e7a3d15e22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:19.808788 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a73fe1-007b-4e67-800c-0e7a3d15e22d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:19.809067 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a73fe1-007b-4e67-800c-0e7a3d15e22d admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:19.809339 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a73fe1-007b-4e67-800c-0e7a3d15e22d admin admin] PATH_INFO: `/v3/users/18629b89d83b4c1aae4a22443c5e132a` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:19.810539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a73fe1-007b-4e67-800c-0e7a3d15e22d admin admin] RBAC: Authorizing `identity:delete_user(user_id=18629b89d83b4c1aae4a22443c5e132a)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:19.813091 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a73fe1-007b-4e67-800c-0e7a3d15e22d admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:19.868130 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-05a73fe1-007b-4e67-800c-0e7a3d15e22d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18629b89d83b4c1aae4a22443c5e132a'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:19.882457 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-05a73fe1-007b-4e67-800c-0e7a3d15e22d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18629b89d83b4c1aae4a22443c5e132a'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:19.889928 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-05a73fe1-007b-4e67-800c-0e7a3d15e22d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18629b89d83b4c1aae4a22443c5e132a'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:19.890696 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-05a73fe1-007b-4e67-800c-0e7a3d15e22d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18629b89d83b4c1aae4a22443c5e132a'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:19.891479 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-05a73fe1-007b-4e67-800c-0e7a3d15e22d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18629b89d83b4c1aae4a22443c5e132a'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:19.906627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1187/2385] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:34:19 2022] DELETE /identity/v3/users/18629b89d83b4c1aae4a22443c5e132a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:34:19.911119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfcafe-2b8c-4736-b5d8-2988fa9691ea None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:19.911714 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfcafe-2b8c-4736-b5d8-2988fa9691ea None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:19.911714 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfcafe-2b8c-4736-b5d8-2988fa9691ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:19.929722 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-04bfcafe-2b8c-4736-b5d8-2988fa9691ea None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:19.930922 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-04bfcafe-2b8c-4736-b5d8-2988fa9691ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:19.999420 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1199/2386] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:34:20.007087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a73fe1-007b-4e67-800c-0e7a3d15e22d admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:20.008897 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-05a73fe1-007b-4e67-800c-0e7a3d15e22d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:20.039767 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:20.091398 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a73fe1-007b-4e67-800c-0e7a3d15e22d admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:20.097428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c292626-fbed-4156-9dd5-22174ac16b9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:20.098250 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c292626-fbed-4156-9dd5-22174ac16b9a service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:20.099799 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c292626-fbed-4156-9dd5-22174ac16b9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:20.099799 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c292626-fbed-4156-9dd5-22174ac16b9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:20.111656 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c292626-fbed-4156-9dd5-22174ac16b9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:20.113104 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c292626-fbed-4156-9dd5-22174ac16b9a service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:20.123727 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1188/2387] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:34:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:34:20.451026 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfcafe-2b8c-4736-b5d8-2988fa9691ea None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:20.453913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-04bfcafe-2b8c-4736-b5d8-2988fa9691ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:20.467261 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfcafe-2b8c-4736-b5d8-2988fa9691ea None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:20.472976 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a91263-c221-4640-a54e-2a29d09f38f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:20.474097 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a91263-c221-4640-a54e-2a29d09f38f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:20.474345 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a91263-c221-4640-a54e-2a29d09f38f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:20.474877 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a91263-c221-4640-a54e-2a29d09f38f0 admin admin] PATH_INFO: `/v3/projects/47a9b9855112442aab701701134b34d8` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:20.476501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a91263-c221-4640-a54e-2a29d09f38f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47a9b9855112442aab701701134b34d8)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:20.478685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a91263-c221-4640-a54e-2a29d09f38f0 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:20.531258 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-33a91263-c221-4640-a54e-2a29d09f38f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47a9b9855112442aab701701134b34d8', 'request_id': 'req-33a91263-c221-4640-a54e-2a29d09f38f0'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:20.537519 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-33a91263-c221-4640-a54e-2a29d09f38f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47a9b9855112442aab701701134b34d8', 'request_id': 'req-33a91263-c221-4640-a54e-2a29d09f38f0'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:20.546465 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-33a91263-c221-4640-a54e-2a29d09f38f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47a9b9855112442aab701701134b34d8', 'request_id': 'req-33a91263-c221-4640-a54e-2a29d09f38f0'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:20.559410 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-33a91263-c221-4640-a54e-2a29d09f38f0 admin admin] The token cache is being invalidate because project 47a9b9855112442aab701701134b34d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:34:20.559702 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-33a91263-c221-4640-a54e-2a29d09f38f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:20.560411 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-33a91263-c221-4640-a54e-2a29d09f38f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:20.562014 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1200/2388] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:34:20 2022] DELETE /identity/v3/projects/47a9b9855112442aab701701134b34d8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:34:20.567527 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e8430-10c7-4587-b9c2-eed654c19be7 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:20.567823 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e8430-10c7-4587-b9c2-eed654c19be7 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:20.568108 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e8430-10c7-4587-b9c2-eed654c19be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:20.586986 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-fd7e8430-10c7-4587-b9c2-eed654c19be7 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:20.588220 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-fd7e8430-10c7-4587-b9c2-eed654c19be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:20.653027 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1189/2389] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:34:20.661166 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13fbbe-0a03-48d6-94ed-f4ad6c9e9edb None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:20.661464 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13fbbe-0a03-48d6-94ed-f4ad6c9e9edb None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:20.661749 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13fbbe-0a03-48d6-94ed-f4ad6c9e9edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:20.680349 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-6d13fbbe-0a03-48d6-94ed-f4ad6c9e9edb None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:20.681737 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-6d13fbbe-0a03-48d6-94ed-f4ad6c9e9edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:20.690586 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1201/2390] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:34:20.694881 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e8430-10c7-4587-b9c2-eed654c19be7 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:20.706130 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e8430-10c7-4587-b9c2-eed654c19be7 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:20.711152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc23a15-742d-4751-b6ef-0d6a283a0dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:20.711853 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc23a15-742d-4751-b6ef-0d6a283a0dbc admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:20.712148 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc23a15-742d-4751-b6ef-0d6a283a0dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:20.712423 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc23a15-742d-4751-b6ef-0d6a283a0dbc admin admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:20.713159 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc23a15-742d-4751-b6ef-0d6a283a0dbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:34:20.713559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc23a15-742d-4751-b6ef-0d6a283a0dbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:20.715155 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc23a15-742d-4751-b6ef-0d6a283a0dbc admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:20.727312 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1190/2391] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:34:20.732013 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13fbbe-0a03-48d6-94ed-f4ad6c9e9edb None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:20.742172 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13fbbe-0a03-48d6-94ed-f4ad6c9e9edb None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:20.747348 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dde5a3-4ea1-4e2b-ac42-8f82df568cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:20.748155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dde5a3-4ea1-4e2b-ac42-8f82df568cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:20.748452 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dde5a3-4ea1-4e2b-ac42-8f82df568cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:20.749346 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dde5a3-4ea1-4e2b-ac42-8f82df568cf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:20.750121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dde5a3-4ea1-4e2b-ac42-8f82df568cf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:20.752177 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dde5a3-4ea1-4e2b-ac42-8f82df568cf5 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:20.755656 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:20.784129 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1202/2392] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:34:20 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:34:20.785253 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc23a15-742d-4751-b6ef-0d6a283a0dbc admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:20.795985 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc23a15-742d-4751-b6ef-0d6a283a0dbc admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:20.861025 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c851c4-6d73-41e5-868e-4f3d7f593fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:20.861714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c851c4-6d73-41e5-868e-4f3d7f593fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:20.862031 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c851c4-6d73-41e5-868e-4f3d7f593fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:20.862320 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c851c4-6d73-41e5-868e-4f3d7f593fb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:20.863036 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c851c4-6d73-41e5-868e-4f3d7f593fb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:20.865037 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c851c4-6d73-41e5-868e-4f3d7f593fb6 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:20.885471 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1191/2393] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:34:20 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:34:20.890542 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dde5a3-4ea1-4e2b-ac42-8f82df568cf5 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:20.901264 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dde5a3-4ea1-4e2b-ac42-8f82df568cf5 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:20.905917 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24ba7f-e114-49a5-9bde-56f60e6eb5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:20.906573 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24ba7f-e114-49a5-9bde-56f60e6eb5fa admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:20.906857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24ba7f-e114-49a5-9bde-56f60e6eb5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:20.907133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24ba7f-e114-49a5-9bde-56f60e6eb5fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:20.907895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24ba7f-e114-49a5-9bde-56f60e6eb5fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:20.909462 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24ba7f-e114-49a5-9bde-56f60e6eb5fa admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:20.920358 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1203/2394] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:34:20.924641 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c851c4-6d73-41e5-868e-4f3d7f593fb6 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:20.935460 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c851c4-6d73-41e5-868e-4f3d7f593fb6 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:20.940817 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0287484-6f1c-4d93-bd45-e2a13bcd08ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:20.941531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0287484-6f1c-4d93-bd45-e2a13bcd08ea admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:20.941824 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0287484-6f1c-4d93-bd45-e2a13bcd08ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:20.942116 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0287484-6f1c-4d93-bd45-e2a13bcd08ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:20.942858 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0287484-6f1c-4d93-bd45-e2a13bcd08ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:20.944511 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0287484-6f1c-4d93-bd45-e2a13bcd08ea admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:20.955665 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1192/2395] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:34:20.959916 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24ba7f-e114-49a5-9bde-56f60e6eb5fa admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:20.970067 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24ba7f-e114-49a5-9bde-56f60e6eb5fa admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:20.974709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85298bea-f5a0-424a-b709-1ea881a9dec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:20.975620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85298bea-f5a0-424a-b709-1ea881a9dec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:20.975911 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85298bea-f5a0-424a-b709-1ea881a9dec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:20.976194 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85298bea-f5a0-424a-b709-1ea881a9dec6 admin admin] PATH_INFO: `/v3/projects/c42bd9218985478c94fc866b0b171e77/users/9d30a94851c840f08670c9548c2e2311/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:20.991055 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85298bea-f5a0-424a-b709-1ea881a9dec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42bd9218985478c94fc866b0b171e77, user_id=9d30a94851c840f08670c9548c2e2311, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:20.993849 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85298bea-f5a0-424a-b709-1ea881a9dec6 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:21.007400 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1204/2396] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:34:20 2022] PUT /identity/v3/projects/c42bd9218985478c94fc866b0b171e77/users/9d30a94851c840f08670c9548c2e2311/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:34:21.012505 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219346a8-a81e-47ac-8671-6fddd72e2d0a None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:21.012824 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219346a8-a81e-47ac-8671-6fddd72e2d0a None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:21.013088 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219346a8-a81e-47ac-8671-6fddd72e2d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:21.032614 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-219346a8-a81e-47ac-8671-6fddd72e2d0a None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:21.033820 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-219346a8-a81e-47ac-8671-6fddd72e2d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:21.059344 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:21.094956 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1193/2397] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:34:21.104772 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85298bea-f5a0-424a-b709-1ea881a9dec6 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:21.106466 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-85298bea-f5a0-424a-b709-1ea881a9dec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:21.164594 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85298bea-f5a0-424a-b709-1ea881a9dec6 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:21.169323 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260caa55-22aa-45fc-b0f6-6c46eec65d8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:21.169991 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260caa55-22aa-45fc-b0f6-6c46eec65d8f service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:21.170279 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260caa55-22aa-45fc-b0f6-6c46eec65d8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:21.171078 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260caa55-22aa-45fc-b0f6-6c46eec65d8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:21.180714 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260caa55-22aa-45fc-b0f6-6c46eec65d8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:21.182135 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260caa55-22aa-45fc-b0f6-6c46eec65d8f service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:21.192363 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1205/2398] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:34:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:34:23.873390 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219346a8-a81e-47ac-8671-6fddd72e2d0a None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:23.875559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-219346a8-a81e-47ac-8671-6fddd72e2d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:23.891016 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219346a8-a81e-47ac-8671-6fddd72e2d0a None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:23.904000 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce875621-7882-4b84-9ff7-fb19cb7a7240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:23.904000 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce875621-7882-4b84-9ff7-fb19cb7a7240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:23.904347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce875621-7882-4b84-9ff7-fb19cb7a7240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:23.904586 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce875621-7882-4b84-9ff7-fb19cb7a7240 admin admin] PATH_INFO: `/v3/users/d4d4ff66975b48c0984f918614220e43` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:23.906291 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce875621-7882-4b84-9ff7-fb19cb7a7240 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4d4ff66975b48c0984f918614220e43)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:23.908440 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce875621-7882-4b84-9ff7-fb19cb7a7240 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:23.978314 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-ce875621-7882-4b84-9ff7-fb19cb7a7240 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4d4ff66975b48c0984f918614220e43'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:23.993537 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-ce875621-7882-4b84-9ff7-fb19cb7a7240 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4d4ff66975b48c0984f918614220e43'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:24.004306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-ce875621-7882-4b84-9ff7-fb19cb7a7240 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4d4ff66975b48c0984f918614220e43'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:24.005095 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-ce875621-7882-4b84-9ff7-fb19cb7a7240 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4d4ff66975b48c0984f918614220e43'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:24.005715 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-ce875621-7882-4b84-9ff7-fb19cb7a7240 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4d4ff66975b48c0984f918614220e43'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:24.024677 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1194/2399] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:34:23 2022] DELETE /identity/v3/users/d4d4ff66975b48c0984f918614220e43 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:34:24.028951 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f1aa3-a109-4cbe-a38a-88231fe337a4 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:24.029470 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f1aa3-a109-4cbe-a38a-88231fe337a4 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:24.029603 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f1aa3-a109-4cbe-a38a-88231fe337a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:24.049602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-e14f1aa3-a109-4cbe-a38a-88231fe337a4 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:24.049602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-e14f1aa3-a109-4cbe-a38a-88231fe337a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:24.119732 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1206/2400] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:34:24.130151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce875621-7882-4b84-9ff7-fb19cb7a7240 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:24.131734 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-ce875621-7882-4b84-9ff7-fb19cb7a7240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:24.229579 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce875621-7882-4b84-9ff7-fb19cb7a7240 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:24.233900 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740bca13-aa8b-4109-99a4-eb3291f1a975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:24.235169 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bca13-aa8b-4109-99a4-eb3291f1a975 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:24.235515 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bca13-aa8b-4109-99a4-eb3291f1a975 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:24.235803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bca13-aa8b-4109-99a4-eb3291f1a975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:24.251703 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740bca13-aa8b-4109-99a4-eb3291f1a975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:24.253572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740bca13-aa8b-4109-99a4-eb3291f1a975 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:24.272527 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1195/2401] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:34:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:34:24.722361 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f1aa3-a109-4cbe-a38a-88231fe337a4 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:24.723872 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-e14f1aa3-a109-4cbe-a38a-88231fe337a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:24.739135 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f1aa3-a109-4cbe-a38a-88231fe337a4 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:24.743988 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49f96a-47e9-4510-9e1d-f28f9ca4a718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:24.745348 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49f96a-47e9-4510-9e1d-f28f9ca4a718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:24.745348 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49f96a-47e9-4510-9e1d-f28f9ca4a718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:24.745541 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49f96a-47e9-4510-9e1d-f28f9ca4a718 admin admin] PATH_INFO: `/v3/projects/83a12faff906418d84b01c4a5940bb1d` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:24.746705 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49f96a-47e9-4510-9e1d-f28f9ca4a718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83a12faff906418d84b01c4a5940bb1d)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:24.749275 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49f96a-47e9-4510-9e1d-f28f9ca4a718 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:24.817888 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:24.819394 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-1f49f96a-47e9-4510-9e1d-f28f9ca4a718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83a12faff906418d84b01c4a5940bb1d', 'request_id': 'req-1f49f96a-47e9-4510-9e1d-f28f9ca4a718'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:24.828251 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-1f49f96a-47e9-4510-9e1d-f28f9ca4a718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83a12faff906418d84b01c4a5940bb1d', 'request_id': 'req-1f49f96a-47e9-4510-9e1d-f28f9ca4a718'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:24.842765 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-1f49f96a-47e9-4510-9e1d-f28f9ca4a718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83a12faff906418d84b01c4a5940bb1d', 'request_id': 'req-1f49f96a-47e9-4510-9e1d-f28f9ca4a718'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:24.865326 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-1f49f96a-47e9-4510-9e1d-f28f9ca4a718 admin admin] The token cache is being invalidate because project 83a12faff906418d84b01c4a5940bb1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:34:24.865624 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-1f49f96a-47e9-4510-9e1d-f28f9ca4a718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:24.866340 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-1f49f96a-47e9-4510-9e1d-f28f9ca4a718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:24.868204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1207/2402] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:34:24 2022] DELETE /identity/v3/projects/83a12faff906418d84b01c4a5940bb1d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:34:24.872152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740bca13-aa8b-4109-99a4-eb3291f1a975 service neutron] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:24.883450 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740bca13-aa8b-4109-99a4-eb3291f1a975 service neutron] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:24.935632 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:24.959860 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb4dbe-cf1b-4e3d-85d2-2348410dafea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:24.961520 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb4dbe-cf1b-4e3d-85d2-2348410dafea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:24.962126 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb4dbe-cf1b-4e3d-85d2-2348410dafea admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:24.964760 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb4dbe-cf1b-4e3d-85d2-2348410dafea admin admin] PATH_INFO: `/v3/users/b8e5022219444a69bc988e77a9ce4b14` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:24.965803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb4dbe-cf1b-4e3d-85d2-2348410dafea admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8e5022219444a69bc988e77a9ce4b14)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:24.969422 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb4dbe-cf1b-4e3d-85d2-2348410dafea admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:25.041476 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-38fb4dbe-cf1b-4e3d-85d2-2348410dafea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8e5022219444a69bc988e77a9ce4b14'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:25.062774 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-38fb4dbe-cf1b-4e3d-85d2-2348410dafea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8e5022219444a69bc988e77a9ce4b14'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:25.076656 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-38fb4dbe-cf1b-4e3d-85d2-2348410dafea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8e5022219444a69bc988e77a9ce4b14'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:25.077409 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-38fb4dbe-cf1b-4e3d-85d2-2348410dafea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8e5022219444a69bc988e77a9ce4b14'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:25.078082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-38fb4dbe-cf1b-4e3d-85d2-2348410dafea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8e5022219444a69bc988e77a9ce4b14'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:25.096577 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1196/2403] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:34:24 2022] DELETE /identity/v3/users/b8e5022219444a69bc988e77a9ce4b14 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:34:25.597514 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49f96a-47e9-4510-9e1d-f28f9ca4a718 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:25.599791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-1f49f96a-47e9-4510-9e1d-f28f9ca4a718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:25.628598 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49f96a-47e9-4510-9e1d-f28f9ca4a718 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:25.727898 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30c875-ec8f-42d0-ab6a-c8be560a2cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:25.729098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30c875-ec8f-42d0-ab6a-c8be560a2cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:25.729417 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30c875-ec8f-42d0-ab6a-c8be560a2cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:25.729789 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30c875-ec8f-42d0-ab6a-c8be560a2cac admin admin] PATH_INFO: `/v3/projects/50734019d29b4155a8295d32d0081add` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:25.731503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30c875-ec8f-42d0-ab6a-c8be560a2cac admin admin] RBAC: Authorizing `identity:delete_project(project_id=50734019d29b4155a8295d32d0081add)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:25.733763 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30c875-ec8f-42d0-ab6a-c8be560a2cac admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:25.798472 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-eb30c875-ec8f-42d0-ab6a-c8be560a2cac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50734019d29b4155a8295d32d0081add', 'request_id': 'req-eb30c875-ec8f-42d0-ab6a-c8be560a2cac'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:25.805731 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-eb30c875-ec8f-42d0-ab6a-c8be560a2cac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50734019d29b4155a8295d32d0081add', 'request_id': 'req-eb30c875-ec8f-42d0-ab6a-c8be560a2cac'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:25.817599 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-eb30c875-ec8f-42d0-ab6a-c8be560a2cac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50734019d29b4155a8295d32d0081add', 'request_id': 'req-eb30c875-ec8f-42d0-ab6a-c8be560a2cac'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:25.884856 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-eb30c875-ec8f-42d0-ab6a-c8be560a2cac admin admin] The token cache is being invalidate because project 50734019d29b4155a8295d32d0081add was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:34:25.885160 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-eb30c875-ec8f-42d0-ab6a-c8be560a2cac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:25.888614 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-eb30c875-ec8f-42d0-ab6a-c8be560a2cac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:25.892293 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1208/2404] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:34:25 2022] DELETE /identity/v3/projects/50734019d29b4155a8295d32d0081add => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:34:25.898337 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151eec53-7e13-41eb-b428-f2e8e0216d57 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:25.898902 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151eec53-7e13-41eb-b428-f2e8e0216d57 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:25.899013 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151eec53-7e13-41eb-b428-f2e8e0216d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:25.934844 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-151eec53-7e13-41eb-b428-f2e8e0216d57 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:25.936654 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-151eec53-7e13-41eb-b428-f2e8e0216d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:26.020182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1197/2405] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:34:26.030769 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965cc02-53c4-4229-a06f-aa9c07e27626 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:26.031017 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965cc02-53c4-4229-a06f-aa9c07e27626 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:26.031272 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965cc02-53c4-4229-a06f-aa9c07e27626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:26.065188 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-c965cc02-53c4-4229-a06f-aa9c07e27626 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:26.066489 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-c965cc02-53c4-4229-a06f-aa9c07e27626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:26.077439 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1209/2406] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:34:26.081513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151eec53-7e13-41eb-b428-f2e8e0216d57 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:26.091508 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151eec53-7e13-41eb-b428-f2e8e0216d57 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:26.096933 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b41599-695a-483d-8bb7-c3a39d6c3cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:26.097627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b41599-695a-483d-8bb7-c3a39d6c3cde admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:26.097917 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b41599-695a-483d-8bb7-c3a39d6c3cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:26.098199 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b41599-695a-483d-8bb7-c3a39d6c3cde admin admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:26.098945 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b41599-695a-483d-8bb7-c3a39d6c3cde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:34:26.099285 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b41599-695a-483d-8bb7-c3a39d6c3cde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:26.100930 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b41599-695a-483d-8bb7-c3a39d6c3cde admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:26.117731 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1198/2407] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:34:26.118621 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965cc02-53c4-4229-a06f-aa9c07e27626 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:26.132026 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965cc02-53c4-4229-a06f-aa9c07e27626 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:26.143257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c3bc7-07a7-48c5-acff-0e830fbf7f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:26.143257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c3bc7-07a7-48c5-acff-0e830fbf7f26 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:26.143599 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c3bc7-07a7-48c5-acff-0e830fbf7f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:26.143696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c3bc7-07a7-48c5-acff-0e830fbf7f26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:26.144558 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c3bc7-07a7-48c5-acff-0e830fbf7f26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:26.146787 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c3bc7-07a7-48c5-acff-0e830fbf7f26 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:26.153390 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071e4a8-eb5c-4487-ba7f-4b6e270ec69b None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:26.153810 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071e4a8-eb5c-4487-ba7f-4b6e270ec69b None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:26.154193 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071e4a8-eb5c-4487-ba7f-4b6e270ec69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:26.178816 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1210/2408] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:34:26 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:34:26.182646 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c3bc7-07a7-48c5-acff-0e830fbf7f26 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:26.190742 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-2071e4a8-eb5c-4487-ba7f-4b6e270ec69b None None] MFA Rules not processed for user `9d30a94851c840f08670c9548c2e2311`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:26.192089 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-2071e4a8-eb5c-4487-ba7f-4b6e270ec69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:26.237267 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:26.246825 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:26.272412 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c3bc7-07a7-48c5-acff-0e830fbf7f26 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:26.279646 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100d80c-6ce2-4a8b-bf3e-4ac881d098c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:26.280517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100d80c-6ce2-4a8b-bf3e-4ac881d098c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:26.280940 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100d80c-6ce2-4a8b-bf3e-4ac881d098c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:26.281344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100d80c-6ce2-4a8b-bf3e-4ac881d098c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:26.282194 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100d80c-6ce2-4a8b-bf3e-4ac881d098c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:26.285716 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100d80c-6ce2-4a8b-bf3e-4ac881d098c7 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:26.294473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1199/2409] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:34:26.299175 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071e4a8-eb5c-4487-ba7f-4b6e270ec69b None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:26.300986 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-2071e4a8-eb5c-4487-ba7f-4b6e270ec69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:26.321913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1211/2410] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:34:26 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:34:26.325552 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100d80c-6ce2-4a8b-bf3e-4ac881d098c7 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:26.327185 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071e4a8-eb5c-4487-ba7f-4b6e270ec69b None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:26.338597 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a65cf-ff49-48a0-a840-3871a8c7559c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:26.338597 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a65cf-ff49-48a0-a840-3871a8c7559c admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:26.338597 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a65cf-ff49-48a0-a840-3871a8c7559c admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:26.343013 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a65cf-ff49-48a0-a840-3871a8c7559c admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:26.343013 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a65cf-ff49-48a0-a840-3871a8c7559c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:26.343352 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a65cf-ff49-48a0-a840-3871a8c7559c admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:26.344740 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100d80c-6ce2-4a8b-bf3e-4ac881d098c7 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:26.351988 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc513272-33ab-429a-ba68-f21b5ed0e9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:26.352772 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc513272-33ab-429a-ba68-f21b5ed0e9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:26.353128 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc513272-33ab-429a-ba68-f21b5ed0e9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:26.353477 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc513272-33ab-429a-ba68-f21b5ed0e9f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:26.354298 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc513272-33ab-429a-ba68-f21b5ed0e9f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:26.356036 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc513272-33ab-429a-ba68-f21b5ed0e9f7 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:26.368338 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1212/2411] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:34:26.373106 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc513272-33ab-429a-ba68-f21b5ed0e9f7 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:26.392454 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc513272-33ab-429a-ba68-f21b5ed0e9f7 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:26.397075 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1200/2412] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:34:26 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:34:26.401775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a65cf-ff49-48a0-a840-3871a8c7559c admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:26.505652 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a65cf-ff49-48a0-a840-3871a8c7559c admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:26.505879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e68311-6a63-45ab-83dd-1e620fa840e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:26.505879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e68311-6a63-45ab-83dd-1e620fa840e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:26.505879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e68311-6a63-45ab-83dd-1e620fa840e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:26.505879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e68311-6a63-45ab-83dd-1e620fa840e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:26.506258 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e68311-6a63-45ab-83dd-1e620fa840e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:26.506349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d672b4-dc2c-47b8-a320-651b71a44e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:26.506349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d672b4-dc2c-47b8-a320-651b71a44e54 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:26.506349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d672b4-dc2c-47b8-a320-651b71a44e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:26.506349 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d672b4-dc2c-47b8-a320-651b71a44e54 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:26.506671 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d672b4-dc2c-47b8-a320-651b71a44e54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:26.506837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d672b4-dc2c-47b8-a320-651b71a44e54 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:26.507589 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e68311-6a63-45ab-83dd-1e620fa840e1 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:26.523965 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1213/2413] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:34:26.528691 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e68311-6a63-45ab-83dd-1e620fa840e1 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:26.548325 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1201/2414] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:34:26 2022] POST /identity/v3/users => generated 299 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:34:26.550993 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d672b4-dc2c-47b8-a320-651b71a44e54 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:26.567253 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e68311-6a63-45ab-83dd-1e620fa840e1 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:26.571059 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d672b4-dc2c-47b8-a320-651b71a44e54 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:26.585596 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e18812-7f6c-4964-9c06-c625a1bf9891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:26.587523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e18812-7f6c-4964-9c06-c625a1bf9891 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:26.587770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e18812-7f6c-4964-9c06-c625a1bf9891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:26.588059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e18812-7f6c-4964-9c06-c625a1bf9891 admin admin] PATH_INFO: `/v3/projects/d27893bad4f244088291b78dc9b921d7/users/12f94a165cd14efab340c6a9fe39d0f3/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:26.590123 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e6c81-2626-483f-a42c-17173173412e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:26.591028 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e6c81-2626-483f-a42c-17173173412e admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:26.591810 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e6c81-2626-483f-a42c-17173173412e admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:26.592852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e6c81-2626-483f-a42c-17173173412e admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:26.593987 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e6c81-2626-483f-a42c-17173173412e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:26.596329 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e6c81-2626-483f-a42c-17173173412e admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:26.609727 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e18812-7f6c-4964-9c06-c625a1bf9891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d27893bad4f244088291b78dc9b921d7, user_id=12f94a165cd14efab340c6a9fe39d0f3, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:26.610347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1202/2415] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:34:26.615055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e6c81-2626-483f-a42c-17173173412e admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:26.615733 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e18812-7f6c-4964-9c06-c625a1bf9891 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:26.651277 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e6c81-2626-483f-a42c-17173173412e admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:26.651512 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1214/2416] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:34:26 2022] PUT /identity/v3/projects/d27893bad4f244088291b78dc9b921d7/users/12f94a165cd14efab340c6a9fe39d0f3/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:34:26.721271 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f46d8-c2a2-4efb-8e93-088d58320dde None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:26.721271 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f46d8-c2a2-4efb-8e93-088d58320dde None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:26.721271 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f46d8-c2a2-4efb-8e93-088d58320dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:26.806794 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-235f46d8-c2a2-4efb-8e93-088d58320dde None None] MFA Rules not processed for user `12f94a165cd14efab340c6a9fe39d0f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:26.808987 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-235f46d8-c2a2-4efb-8e93-088d58320dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:26.829963 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa980c-708b-4d8e-b998-7e2093bb8545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:26.830908 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa980c-708b-4d8e-b998-7e2093bb8545 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:26.831195 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa980c-708b-4d8e-b998-7e2093bb8545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:26.831525 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa980c-708b-4d8e-b998-7e2093bb8545 admin admin] PATH_INFO: `/v3/projects/4ab0d9268178482e80cf1d2dc3ff9410/users/38ab771ffab449c0af79f6fb4af63e91/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:26.866876 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa980c-708b-4d8e-b998-7e2093bb8545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ab0d9268178482e80cf1d2dc3ff9410, user_id=38ab771ffab449c0af79f6fb4af63e91, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:26.869618 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa980c-708b-4d8e-b998-7e2093bb8545 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:26.898332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1203/2417] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:34:26 2022] PUT /identity/v3/projects/4ab0d9268178482e80cf1d2dc3ff9410/users/38ab771ffab449c0af79f6fb4af63e91/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:34:26.906751 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa980c-708b-4d8e-b998-7e2093bb8545 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:26.912260 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1215/2418] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:34:26.939769 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f46d8-c2a2-4efb-8e93-088d58320dde None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:26.941515 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-235f46d8-c2a2-4efb-8e93-088d58320dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:26.963583 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:26.982551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:27.079641 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f46d8-c2a2-4efb-8e93-088d58320dde None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:27.092656 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa980c-708b-4d8e-b998-7e2093bb8545 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:27.118062 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5ff02-a563-412c-b557-d600d762277b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:27.119153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5ff02-a563-412c-b557-d600d762277b admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:27.129492 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5ff02-a563-412c-b557-d600d762277b admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:27.130074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5ff02-a563-412c-b557-d600d762277b admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:27.131096 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5ff02-a563-412c-b557-d600d762277b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:27.144231 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5ff02-a563-412c-b557-d600d762277b admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:27.168390 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68df43-9e40-4a25-9041-d0e42b920942 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:27.169072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68df43-9e40-4a25-9041-d0e42b920942 service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:27.169362 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68df43-9e40-4a25-9041-d0e42b920942 service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:27.169650 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68df43-9e40-4a25-9041-d0e42b920942 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:27.175071 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1204/2419] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:34:27.180524 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5ff02-a563-412c-b557-d600d762277b admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:27.237940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5ff02-a563-412c-b557-d600d762277b admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:27.239854 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68df43-9e40-4a25-9041-d0e42b920942 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:27.241483 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68df43-9e40-4a25-9041-d0e42b920942 service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:27.247255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dfc50f-065d-4998-ae54-377f8b9f31ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:27.248166 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfc50f-065d-4998-ae54-377f8b9f31ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:27.249021 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfc50f-065d-4998-ae54-377f8b9f31ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:27.249306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfc50f-065d-4998-ae54-377f8b9f31ba admin admin] PATH_INFO: `/v3/projects/4ab0d9268178482e80cf1d2dc3ff9410/users/38ab771ffab449c0af79f6fb4af63e91/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:27.253713 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dfc50f-065d-4998-ae54-377f8b9f31ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ab0d9268178482e80cf1d2dc3ff9410, user_id=38ab771ffab449c0af79f6fb4af63e91, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:27.265513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dfc50f-065d-4998-ae54-377f8b9f31ba admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:27.270200 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1216/2420] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:34:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:34:27.308843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68df43-9e40-4a25-9041-d0e42b920942 service cinder] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:27.318051 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1205/2421] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:34:27 2022] PUT /identity/v3/projects/4ab0d9268178482e80cf1d2dc3ff9410/users/38ab771ffab449c0af79f6fb4af63e91/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:34:27.342072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68df43-9e40-4a25-9041-d0e42b920942 service cinder] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:27.500214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e0e79-0837-4538-ad25-c359c53adf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:27.501319 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e0e79-0837-4538-ad25-c359c53adf69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:27.501701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e0e79-0837-4538-ad25-c359c53adf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:27.502921 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e0e79-0837-4538-ad25-c359c53adf69 admin admin] PATH_INFO: `/v3/users/12f94a165cd14efab340c6a9fe39d0f3` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:27.505875 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e0e79-0837-4538-ad25-c359c53adf69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12f94a165cd14efab340c6a9fe39d0f3)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:27.508492 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e0e79-0837-4538-ad25-c359c53adf69 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:27.582904 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:27.616455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-d63e0e79-0837-4538-ad25-c359c53adf69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12f94a165cd14efab340c6a9fe39d0f3'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:27.657502 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-d63e0e79-0837-4538-ad25-c359c53adf69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12f94a165cd14efab340c6a9fe39d0f3'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:27.673592 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-d63e0e79-0837-4538-ad25-c359c53adf69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12f94a165cd14efab340c6a9fe39d0f3'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:27.674744 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-d63e0e79-0837-4538-ad25-c359c53adf69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12f94a165cd14efab340c6a9fe39d0f3'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:27.676034 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-d63e0e79-0837-4538-ad25-c359c53adf69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12f94a165cd14efab340c6a9fe39d0f3'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:27.700742 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1217/2422] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:34:27 2022] DELETE /identity/v3/users/12f94a165cd14efab340c6a9fe39d0f3 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:34:27.706236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0934a-ad86-4e2d-a16c-e49575b3a2bc None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:27.706530 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0934a-ad86-4e2d-a16c-e49575b3a2bc None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:27.706813 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0934a-ad86-4e2d-a16c-e49575b3a2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:27.775440 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-74d0934a-ad86-4e2d-a16c-e49575b3a2bc None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:27.777897 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-74d0934a-ad86-4e2d-a16c-e49575b3a2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:27.883378 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1206/2423] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:34:27.907768 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e0e79-0837-4538-ad25-c359c53adf69 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:27.909486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-d63e0e79-0837-4538-ad25-c359c53adf69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:28.014932 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e0e79-0837-4538-ad25-c359c53adf69 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:28.023163 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2bcd2-8ddc-4550-bba4-607b4681ab21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:28.024428 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2bcd2-8ddc-4550-bba4-607b4681ab21 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:28.024988 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2bcd2-8ddc-4550-bba4-607b4681ab21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:28.025454 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2bcd2-8ddc-4550-bba4-607b4681ab21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:28.037571 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa2bcd2-8ddc-4550-bba4-607b4681ab21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:28.039134 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa2bcd2-8ddc-4550-bba4-607b4681ab21 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:28.050079 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1218/2424] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:34:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:34:28.669118 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0934a-ad86-4e2d-a16c-e49575b3a2bc None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:28.671834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-74d0934a-ad86-4e2d-a16c-e49575b3a2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:28.693040 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0934a-ad86-4e2d-a16c-e49575b3a2bc None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:28.700309 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0034c-d27a-4015-801e-4a654741e73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:28.701510 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0034c-d27a-4015-801e-4a654741e73c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:28.702669 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0034c-d27a-4015-801e-4a654741e73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:28.703125 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0034c-d27a-4015-801e-4a654741e73c admin admin] PATH_INFO: `/v3/projects/d27893bad4f244088291b78dc9b921d7` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:28.705525 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa0034c-d27a-4015-801e-4a654741e73c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d27893bad4f244088291b78dc9b921d7)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:28.707936 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa0034c-d27a-4015-801e-4a654741e73c admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:28.820035 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-9aa0034c-d27a-4015-801e-4a654741e73c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd27893bad4f244088291b78dc9b921d7', 'request_id': 'req-9aa0034c-d27a-4015-801e-4a654741e73c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:28.829466 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-9aa0034c-d27a-4015-801e-4a654741e73c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd27893bad4f244088291b78dc9b921d7', 'request_id': 'req-9aa0034c-d27a-4015-801e-4a654741e73c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:28.858318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-9aa0034c-d27a-4015-801e-4a654741e73c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd27893bad4f244088291b78dc9b921d7', 'request_id': 'req-9aa0034c-d27a-4015-801e-4a654741e73c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:28.886559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-9aa0034c-d27a-4015-801e-4a654741e73c admin admin] The token cache is being invalidate because project d27893bad4f244088291b78dc9b921d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:34:28.887443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-9aa0034c-d27a-4015-801e-4a654741e73c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:28.888370 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-9aa0034c-d27a-4015-801e-4a654741e73c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:34:28.898254 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1207/2425] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:34:28 2022] DELETE /identity/v3/projects/d27893bad4f244088291b78dc9b921d7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:34:28.903547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4797c8-e256-4107-80a8-a7e14b419225 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:28.905104 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4797c8-e256-4107-80a8-a7e14b419225 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:28.905695 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4797c8-e256-4107-80a8-a7e14b419225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:28.939653 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-3c4797c8-e256-4107-80a8-a7e14b419225 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:28.941121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-3c4797c8-e256-4107-80a8-a7e14b419225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:29.041464 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1219/2426] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:34:29.049596 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a162c3e-a185-4bdb-882f-02d0a1e08e3b None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:29.050042 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a162c3e-a185-4bdb-882f-02d0a1e08e3b None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:29.050195 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a162c3e-a185-4bdb-882f-02d0a1e08e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:29.070042 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-5a162c3e-a185-4bdb-882f-02d0a1e08e3b None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:29.071491 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-5a162c3e-a185-4bdb-882f-02d0a1e08e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:29.086387 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4797c8-e256-4107-80a8-a7e14b419225 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:29.093773 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1208/2427] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:34:29.100031 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4797c8-e256-4107-80a8-a7e14b419225 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:29.105239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e5b3f-bc7f-453c-97d4-57844a273047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:29.106037 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e5b3f-bc7f-453c-97d4-57844a273047 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:29.106429 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e5b3f-bc7f-453c-97d4-57844a273047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:29.106838 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e5b3f-bc7f-453c-97d4-57844a273047 admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:29.108528 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e5b3f-bc7f-453c-97d4-57844a273047 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:34:29.108886 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e5b3f-bc7f-453c-97d4-57844a273047 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:29.110944 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e5b3f-bc7f-453c-97d4-57844a273047 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:29.146017 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a162c3e-a185-4bdb-882f-02d0a1e08e3b None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:29.154391 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1220/2428] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:34:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:34:29.161787 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a162c3e-a185-4bdb-882f-02d0a1e08e3b None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:29.174821 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe5938-f165-47cf-92c6-15c6b441a06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:29.176201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe5938-f165-47cf-92c6-15c6b441a06b admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:29.176569 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe5938-f165-47cf-92c6-15c6b441a06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:29.177066 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe5938-f165-47cf-92c6-15c6b441a06b admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:29.178319 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe5938-f165-47cf-92c6-15c6b441a06b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:29.181534 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe5938-f165-47cf-92c6-15c6b441a06b admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:29.223723 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:29.237741 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1209/2429] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:34:29 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:34:29.241332 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e5b3f-bc7f-453c-97d4-57844a273047 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:29.254099 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e5b3f-bc7f-453c-97d4-57844a273047 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:29.302644 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:29.335858 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff99401d-e8e5-463c-aed7-132bb8a6f0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:29.336555 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99401d-e8e5-463c-aed7-132bb8a6f0cc admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:29.336846 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99401d-e8e5-463c-aed7-132bb8a6f0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:29.337135 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99401d-e8e5-463c-aed7-132bb8a6f0cc admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:29.337858 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff99401d-e8e5-463c-aed7-132bb8a6f0cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:29.340583 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff99401d-e8e5-463c-aed7-132bb8a6f0cc admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:29.367450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1221/2430] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:34:29 2022] POST /identity/v3/users => generated 289 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:34:29.371372 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe5938-f165-47cf-92c6-15c6b441a06b admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:29.386009 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe5938-f165-47cf-92c6-15c6b441a06b admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:29.392491 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f0557-86e4-46a0-b6eb-0436f917d73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:29.393514 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f0557-86e4-46a0-b6eb-0436f917d73f admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:29.393914 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f0557-86e4-46a0-b6eb-0436f917d73f admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:29.394527 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f0557-86e4-46a0-b6eb-0436f917d73f admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:29.396782 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f0557-86e4-46a0-b6eb-0436f917d73f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:29.399380 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f0557-86e4-46a0-b6eb-0436f917d73f admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:29.416991 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1210/2431] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:34:29.423907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff99401d-e8e5-463c-aed7-132bb8a6f0cc admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:29.438250 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff99401d-e8e5-463c-aed7-132bb8a6f0cc admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:29.448868 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c273fc-ee71-49a3-a206-40d805e73cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:29.452373 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c273fc-ee71-49a3-a206-40d805e73cdf admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:29.454030 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c273fc-ee71-49a3-a206-40d805e73cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:29.454529 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c273fc-ee71-49a3-a206-40d805e73cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:29.455523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c273fc-ee71-49a3-a206-40d805e73cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:29.459851 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c273fc-ee71-49a3-a206-40d805e73cdf admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:29.483597 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1222/2432] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:34:29.487755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f0557-86e4-46a0-b6eb-0436f917d73f admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:29.522575 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f0557-86e4-46a0-b6eb-0436f917d73f admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:29.530968 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a5868-3c3b-402d-b53f-279aefa37e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:29.532491 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a5868-3c3b-402d-b53f-279aefa37e82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:29.532871 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a5868-3c3b-402d-b53f-279aefa37e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:29.533165 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a5868-3c3b-402d-b53f-279aefa37e82 admin admin] PATH_INFO: `/v3/projects/f58635c687bf42739bee6145df97fb83/users/1a1a8296782d4e258711a2c330cf401f/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:29.563531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a5868-3c3b-402d-b53f-279aefa37e82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f58635c687bf42739bee6145df97fb83, user_id=1a1a8296782d4e258711a2c330cf401f, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:29.566256 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a5868-3c3b-402d-b53f-279aefa37e82 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:29.599683 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1211/2433] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:34:29 2022] PUT /identity/v3/projects/f58635c687bf42739bee6145df97fb83/users/1a1a8296782d4e258711a2c330cf401f/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:34:29.611340 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae63a0-ffef-4e4d-9984-5675e120e982 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:29.612151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae63a0-ffef-4e4d-9984-5675e120e982 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:29.612662 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae63a0-ffef-4e4d-9984-5675e120e982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:29.652865 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-59ae63a0-ffef-4e4d-9984-5675e120e982 None None] MFA Rules not processed for user `1a1a8296782d4e258711a2c330cf401f`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:29.654123 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-59ae63a0-ffef-4e4d-9984-5675e120e982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:29.880656 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1223/2434] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:34:29.893958 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a5868-3c3b-402d-b53f-279aefa37e82 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:29.897953 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-2c6a5868-3c3b-402d-b53f-279aefa37e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:30.083002 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a5868-3c3b-402d-b53f-279aefa37e82 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:30.093010 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578e465-06d9-46e0-940b-983dd6908c2a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e66abbda1744a71b4d26677dcef76be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:30.093953 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578e465-06d9-46e0-940b-983dd6908c2a service glance] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:30.094429 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578e465-06d9-46e0-940b-983dd6908c2a service glance] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:30.095047 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578e465-06d9-46e0-940b-983dd6908c2a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:30.120327 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578e465-06d9-46e0-940b-983dd6908c2a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:30.127508 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578e465-06d9-46e0-940b-983dd6908c2a service glance] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:30.155772 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1212/2435] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:34:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:34:31.946550 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f853c-6131-478c-b174-fc7c269727be None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:31.947031 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f853c-6131-478c-b174-fc7c269727be None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:31.947313 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f853c-6131-478c-b174-fc7c269727be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:31.985531 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-c44f853c-6131-478c-b174-fc7c269727be None None] MFA Rules not processed for user `dcd12611b7d144e28fa1358f927c9f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:31.989152 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-c44f853c-6131-478c-b174-fc7c269727be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:32.144632 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1224/2436] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:34:34.092303 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03bbf7-841d-4f46-8134-c35b43fbe9af None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:34.092845 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03bbf7-841d-4f46-8134-c35b43fbe9af None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:34.092962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03bbf7-841d-4f46-8134-c35b43fbe9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:34.126056 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-3b03bbf7-841d-4f46-8134-c35b43fbe9af None None] MFA Rules not processed for user `38ab771ffab449c0af79f6fb4af63e91`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:34.127587 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-3b03bbf7-841d-4f46-8134-c35b43fbe9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:34.213295 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1213/2437] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:34:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:34:42.128981 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=74,keystone:INSERT=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:44.210482 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=75,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:47.575533 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2f375-96a8-4521-8c32-3ddb144940ec None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:47.576647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2f375-96a8-4521-8c32-3ddb144940ec None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:47.576647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2f375-96a8-4521-8c32-3ddb144940ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:47.597079 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-04b2f375-96a8-4521-8c32-3ddb144940ec None None] MFA Rules not processed for user `cea1d8409c754ec797d6c694481a3112`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:47.599312 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-04b2f375-96a8-4521-8c32-3ddb144940ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:47.668115 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1225/2438] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jul 19 15:34:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:34:47.680717 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03bbf7-841d-4f46-8134-c35b43fbe9af None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:47.682209 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-3b03bbf7-841d-4f46-8134-c35b43fbe9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:47.767200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03bbf7-841d-4f46-8134-c35b43fbe9af None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:47.772718 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122e430-efea-4556-8f15-c66aa61c77be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1dceaddb6e414faef0e0448cdf1be8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:47.773384 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122e430-efea-4556-8f15-c66aa61c77be service swift] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:47.774096 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122e430-efea-4556-8f15-c66aa61c77be service swift] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:47.774096 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122e430-efea-4556-8f15-c66aa61c77be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:47.785813 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122e430-efea-4556-8f15-c66aa61c77be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:47.787472 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122e430-efea-4556-8f15-c66aa61c77be service swift] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:47.796153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1214/2439] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jul 19 15:34:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:34:50.294737 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2f375-96a8-4521-8c32-3ddb144940ec None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:50.315583 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2f375-96a8-4521-8c32-3ddb144940ec None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:50.324063 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e2b85-f223-4dd2-85c2-4992c76a68a1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e66abbda1744a71b4d26677dcef76be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:50.324063 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e2b85-f223-4dd2-85c2-4992c76a68a1 service glance] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:50.324568 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e2b85-f223-4dd2-85c2-4992c76a68a1 service glance] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:50.325555 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e2b85-f223-4dd2-85c2-4992c76a68a1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:50.329435 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-ef0e2b85-f223-4dd2-85c2-4992c76a68a1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:50.496597 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e2b85-f223-4dd2-85c2-4992c76a68a1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:50.498645 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e2b85-f223-4dd2-85c2-4992c76a68a1 service glance] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:50.519896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1226/2440] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:34:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:34:50.750802 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22965844-f82f-4134-a286-416f24b38254 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:50.751946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22965844-f82f-4134-a286-416f24b38254 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:50.752491 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22965844-f82f-4134-a286-416f24b38254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:50.783654 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-22965844-f82f-4134-a286-416f24b38254 None None] MFA Rules not processed for user `cea1d8409c754ec797d6c694481a3112`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:50.785892 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-22965844-f82f-4134-a286-416f24b38254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:50.800710 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1215/2441] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jul 19 15:34:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:34:50.855024 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e2b85-f223-4dd2-85c2-4992c76a68a1 service glance] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:50.876530 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e2b85-f223-4dd2-85c2-4992c76a68a1 service glance] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:50.891291 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfa6c5-3bd9-4342-96d3-e653b6c36493 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1dceaddb6e414faef0e0448cdf1be8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:50.892862 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfa6c5-3bd9-4342-96d3-e653b6c36493 service swift] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:50.894003 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfa6c5-3bd9-4342-96d3-e653b6c36493 service swift] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:50.895600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfa6c5-3bd9-4342-96d3-e653b6c36493 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:50.907304 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cfa6c5-3bd9-4342-96d3-e653b6c36493 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:50.909783 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cfa6c5-3bd9-4342-96d3-e653b6c36493 service swift] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:50.923632 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1227/2442] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jul 19 15:34:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:35:00.772681 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=35 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:00.917574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=59 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:02.639644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973a39c-ef6e-4f2e-a6d3-4b3cfd5af79e None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:02.640545 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973a39c-ef6e-4f2e-a6d3-4b3cfd5af79e None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:02.640977 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973a39c-ef6e-4f2e-a6d3-4b3cfd5af79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:02.659978 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-1973a39c-ef6e-4f2e-a6d3-4b3cfd5af79e None None] MFA Rules not processed for user `9d30a94851c840f08670c9548c2e2311`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:35:02.661603 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-1973a39c-ef6e-4f2e-a6d3-4b3cfd5af79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:02.692795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1216/2443] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:35:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:35:08.145308 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa05d5-489e-4d4d-95c6-54d2036f0d0f None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:08.146075 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa05d5-489e-4d4d-95c6-54d2036f0d0f None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:08.146316 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa05d5-489e-4d4d-95c6-54d2036f0d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:08.170000 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-cbaa05d5-489e-4d4d-95c6-54d2036f0d0f None None] MFA Rules not processed for user `cea1d8409c754ec797d6c694481a3112`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:35:08.172057 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-cbaa05d5-489e-4d4d-95c6-54d2036f0d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:08.179914 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1228/2444] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jul 19 15:35:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:35:08.196115 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973a39c-ef6e-4f2e-a6d3-4b3cfd5af79e None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:08.211531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973a39c-ef6e-4f2e-a6d3-4b3cfd5af79e None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:08.217735 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ff98c-b9ea-4edc-afc1-ecea8317e481 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1dceaddb6e414faef0e0448cdf1be8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:08.219611 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ff98c-b9ea-4edc-afc1-ecea8317e481 service swift] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:08.220092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ff98c-b9ea-4edc-afc1-ecea8317e481 service swift] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:08.220528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ff98c-b9ea-4edc-afc1-ecea8317e481 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:08.234751 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ff98c-b9ea-4edc-afc1-ecea8317e481 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:08.236443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ff98c-b9ea-4edc-afc1-ecea8317e481 service swift] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:08.249857 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1217/2445] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jul 19 15:35:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:35:11.313301 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a3596-c9e6-4809-adb4-8336340707e1 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:11.313846 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a3596-c9e6-4809-adb4-8336340707e1 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:11.313846 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a3596-c9e6-4809-adb4-8336340707e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:11.354539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-eb2a3596-c9e6-4809-adb4-8336340707e1 None None] MFA Rules not processed for user `cea1d8409c754ec797d6c694481a3112`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:35:11.355851 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-eb2a3596-c9e6-4809-adb4-8336340707e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:11.373484 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1229/2446] 10.222.0.44 () {58 vars in 967 bytes} [Tue Jul 19 15:35:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:35:11.397684 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ff98c-b9ea-4edc-afc1-ecea8317e481 service swift] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:11.425521 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ff98c-b9ea-4edc-afc1-ecea8317e481 service swift] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:11.432056 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f2e36-4f0f-498f-8dc9-3bbddcbf4622 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1dceaddb6e414faef0e0448cdf1be8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:11.433094 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f2e36-4f0f-498f-8dc9-3bbddcbf4622 service swift] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:11.433608 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f2e36-4f0f-498f-8dc9-3bbddcbf4622 service swift] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:11.434155 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f2e36-4f0f-498f-8dc9-3bbddcbf4622 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:11.456897 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f2e36-4f0f-498f-8dc9-3bbddcbf4622 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:11.459531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f2e36-4f0f-498f-8dc9-3bbddcbf4622 service swift] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:11.470673 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1218/2447] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jul 19 15:35:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:35:13.909801 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a3596-c9e6-4809-adb4-8336340707e1 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:13.911291 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-eb2a3596-c9e6-4809-adb4-8336340707e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:14.026264 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a3596-c9e6-4809-adb4-8336340707e1 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:14.051283 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186c6b4-6fed-4490-936b-61747baa00b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:14.051283 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186c6b4-6fed-4490-936b-61747baa00b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:14.051283 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186c6b4-6fed-4490-936b-61747baa00b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:14.051283 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186c6b4-6fed-4490-936b-61747baa00b8 admin admin] PATH_INFO: `/v3/users/05c0092f8c8d46a99fc04c0c334f490d` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:14.051750 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186c6b4-6fed-4490-936b-61747baa00b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05c0092f8c8d46a99fc04c0c334f490d)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:14.051750 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186c6b4-6fed-4490-936b-61747baa00b8 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:14.123153 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-1186c6b4-6fed-4490-936b-61747baa00b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05c0092f8c8d46a99fc04c0c334f490d'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:14.143565 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-1186c6b4-6fed-4490-936b-61747baa00b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05c0092f8c8d46a99fc04c0c334f490d'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:14.160161 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-1186c6b4-6fed-4490-936b-61747baa00b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05c0092f8c8d46a99fc04c0c334f490d'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:14.161686 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-1186c6b4-6fed-4490-936b-61747baa00b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05c0092f8c8d46a99fc04c0c334f490d'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:14.161873 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-1186c6b4-6fed-4490-936b-61747baa00b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05c0092f8c8d46a99fc04c0c334f490d'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:14.200750 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1230/2448] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:35:13 2022] DELETE /identity/v3/users/05c0092f8c8d46a99fc04c0c334f490d => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:35:14.431557 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f2e36-4f0f-498f-8dc9-3bbddcbf4622 service swift] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:14.446305 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f2e36-4f0f-498f-8dc9-3bbddcbf4622 service swift] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:14.515685 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad330d0-4b74-46c9-a251-720c411abc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:14.517174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad330d0-4b74-46c9-a251-720c411abc29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:14.517459 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad330d0-4b74-46c9-a251-720c411abc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:14.517737 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad330d0-4b74-46c9-a251-720c411abc29 admin admin] PATH_INFO: `/v3/projects/34197e85e4034d59826e7a3553e24129` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:14.518990 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad330d0-4b74-46c9-a251-720c411abc29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34197e85e4034d59826e7a3553e24129)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:14.521233 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad330d0-4b74-46c9-a251-720c411abc29 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:14.580719 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-fad330d0-4b74-46c9-a251-720c411abc29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34197e85e4034d59826e7a3553e24129', 'request_id': 'req-fad330d0-4b74-46c9-a251-720c411abc29'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:14.588464 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-fad330d0-4b74-46c9-a251-720c411abc29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34197e85e4034d59826e7a3553e24129', 'request_id': 'req-fad330d0-4b74-46c9-a251-720c411abc29'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:14.598487 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-fad330d0-4b74-46c9-a251-720c411abc29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34197e85e4034d59826e7a3553e24129', 'request_id': 'req-fad330d0-4b74-46c9-a251-720c411abc29'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:14.631791 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-fad330d0-4b74-46c9-a251-720c411abc29 admin admin] The token cache is being invalidate because project 34197e85e4034d59826e7a3553e24129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:35:14.632100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-fad330d0-4b74-46c9-a251-720c411abc29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:14.633093 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-fad330d0-4b74-46c9-a251-720c411abc29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:14.636192 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1219/2449] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:35:14 2022] DELETE /identity/v3/projects/34197e85e4034d59826e7a3553e24129 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:35:14.643634 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463c711-946c-471a-8bdc-c40a4e6e4615 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:14.643933 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463c711-946c-471a-8bdc-c40a4e6e4615 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:14.644216 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463c711-946c-471a-8bdc-c40a4e6e4615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:14.668461 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-0463c711-946c-471a-8bdc-c40a4e6e4615 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:35:14.670330 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-0463c711-946c-471a-8bdc-c40a4e6e4615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:14.904591 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1231/2450] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:35:14.906756 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62badb92-af69-4fb1-a772-d2d50d23c2f4 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:14.908168 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62badb92-af69-4fb1-a772-d2d50d23c2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:14.908768 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62badb92-af69-4fb1-a772-d2d50d23c2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:14.938017 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-62badb92-af69-4fb1-a772-d2d50d23c2f4 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:35:14.939353 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-62badb92-af69-4fb1-a772-d2d50d23c2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:14.951663 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1220/2451] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:35:14.952791 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463c711-946c-471a-8bdc-c40a4e6e4615 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:14.963208 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463c711-946c-471a-8bdc-c40a4e6e4615 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:14.972084 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee49277-f435-45d1-9e86-d6c53e02641e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:14.974541 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee49277-f435-45d1-9e86-d6c53e02641e admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:14.974864 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee49277-f435-45d1-9e86-d6c53e02641e admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:14.975150 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee49277-f435-45d1-9e86-d6c53e02641e admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:14.975953 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee49277-f435-45d1-9e86-d6c53e02641e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:14.976271 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee49277-f435-45d1-9e86-d6c53e02641e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:14.977874 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee49277-f435-45d1-9e86-d6c53e02641e admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:14.979922 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:15.004117 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1232/2452] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:15.008663 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62badb92-af69-4fb1-a772-d2d50d23c2f4 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:15.021679 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62badb92-af69-4fb1-a772-d2d50d23c2f4 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:15.029033 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364c0b2-3c4f-4939-af82-3ac00bf7d392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:15.030160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364c0b2-3c4f-4939-af82-3ac00bf7d392 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:15.030962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364c0b2-3c4f-4939-af82-3ac00bf7d392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:15.031558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364c0b2-3c4f-4939-af82-3ac00bf7d392 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:15.032426 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364c0b2-3c4f-4939-af82-3ac00bf7d392 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:15.034437 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364c0b2-3c4f-4939-af82-3ac00bf7d392 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:15.063069 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1221/2453] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:35:15 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:35:15.076396 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee49277-f435-45d1-9e86-d6c53e02641e admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:15.090498 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee49277-f435-45d1-9e86-d6c53e02641e admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:15.161363 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54150b9-a4a4-4def-a2ae-384411860ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:15.162154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54150b9-a4a4-4def-a2ae-384411860ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:15.162504 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54150b9-a4a4-4def-a2ae-384411860ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:15.162793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54150b9-a4a4-4def-a2ae-384411860ef8 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:15.163531 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54150b9-a4a4-4def-a2ae-384411860ef8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:15.165471 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54150b9-a4a4-4def-a2ae-384411860ef8 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:15.186274 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1233/2454] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:35:15 2022] POST /identity/v3/users => generated 285 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:35:15.190305 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364c0b2-3c4f-4939-af82-3ac00bf7d392 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:15.201743 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364c0b2-3c4f-4939-af82-3ac00bf7d392 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:15.206916 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce270dd-fedc-4d7c-8689-e00d588229ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:15.207793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce270dd-fedc-4d7c-8689-e00d588229ba admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:15.208155 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce270dd-fedc-4d7c-8689-e00d588229ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:15.208521 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce270dd-fedc-4d7c-8689-e00d588229ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:15.209327 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce270dd-fedc-4d7c-8689-e00d588229ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:15.210987 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce270dd-fedc-4d7c-8689-e00d588229ba admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:15.222875 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1222/2455] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:35:15.228086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54150b9-a4a4-4def-a2ae-384411860ef8 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:15.239070 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54150b9-a4a4-4def-a2ae-384411860ef8 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:15.254651 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da5f7b-4148-4de4-9412-f6a735e3df7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:15.255392 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da5f7b-4148-4de4-9412-f6a735e3df7a admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:15.255719 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da5f7b-4148-4de4-9412-f6a735e3df7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:15.255960 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da5f7b-4148-4de4-9412-f6a735e3df7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:15.256714 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da5f7b-4148-4de4-9412-f6a735e3df7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:15.258326 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da5f7b-4148-4de4-9412-f6a735e3df7a admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:15.271029 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1234/2456] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:35:15.275178 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce270dd-fedc-4d7c-8689-e00d588229ba admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:15.286325 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce270dd-fedc-4d7c-8689-e00d588229ba admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:15.291090 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdec896-0edd-4b5d-9177-5ca81f5a26d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:15.292042 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdec896-0edd-4b5d-9177-5ca81f5a26d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:15.292326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdec896-0edd-4b5d-9177-5ca81f5a26d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:15.292606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdec896-0edd-4b5d-9177-5ca81f5a26d9 admin admin] PATH_INFO: `/v3/projects/4249e35269d84d1b910474d1ef8e14fe/users/2ccdcfbebcdf4d559abbd11de5af20ff/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:15.309130 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdec896-0edd-4b5d-9177-5ca81f5a26d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4249e35269d84d1b910474d1ef8e14fe, user_id=2ccdcfbebcdf4d559abbd11de5af20ff, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:15.312318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdec896-0edd-4b5d-9177-5ca81f5a26d9 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:15.314907 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:15.331558 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1223/2457] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:35:15 2022] PUT /identity/v3/projects/4249e35269d84d1b910474d1ef8e14fe/users/2ccdcfbebcdf4d559abbd11de5af20ff/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:35:15.343022 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b30fd1-80a4-4f50-b684-70eadacf111b None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:15.343335 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b30fd1-80a4-4f50-b684-70eadacf111b None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:15.343618 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b30fd1-80a4-4f50-b684-70eadacf111b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:15.388311 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-b5b30fd1-80a4-4f50-b684-70eadacf111b None None] MFA Rules not processed for user `2ccdcfbebcdf4d559abbd11de5af20ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:35:15.389941 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-b5b30fd1-80a4-4f50-b684-70eadacf111b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:15.480800 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1235/2458] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:35:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:35:15.494239 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdec896-0edd-4b5d-9177-5ca81f5a26d9 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:15.496483 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-1bdec896-0edd-4b5d-9177-5ca81f5a26d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:15.567834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdec896-0edd-4b5d-9177-5ca81f5a26d9 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:15.572018 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da134f-9f46-4b02-8640-b167baaed9d9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e66abbda1744a71b4d26677dcef76be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:15.572687 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da134f-9f46-4b02-8640-b167baaed9d9 service glance] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:15.572976 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da134f-9f46-4b02-8640-b167baaed9d9 service glance] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:15.573259 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da134f-9f46-4b02-8640-b167baaed9d9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:15.583421 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da134f-9f46-4b02-8640-b167baaed9d9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:15.584924 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da134f-9f46-4b02-8640-b167baaed9d9 service glance] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:15.607924 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1224/2459] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:35:15 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:35:16.083572 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b30fd1-80a4-4f50-b684-70eadacf111b None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:16.085839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-b5b30fd1-80a4-4f50-b684-70eadacf111b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:16.185929 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b30fd1-80a4-4f50-b684-70eadacf111b None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:16.190645 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e42bb4-ee74-4064-aa30-399144cc5092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:16.191555 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e42bb4-ee74-4064-aa30-399144cc5092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:16.191844 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e42bb4-ee74-4064-aa30-399144cc5092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:16.192127 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e42bb4-ee74-4064-aa30-399144cc5092 admin admin] PATH_INFO: `/v3/users/1a1a8296782d4e258711a2c330cf401f` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:16.193320 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e42bb4-ee74-4064-aa30-399144cc5092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a1a8296782d4e258711a2c330cf401f)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:16.195236 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e42bb4-ee74-4064-aa30-399144cc5092 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:16.197671 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:16.256108 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-46e42bb4-ee74-4064-aa30-399144cc5092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a1a8296782d4e258711a2c330cf401f'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:16.275008 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-46e42bb4-ee74-4064-aa30-399144cc5092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a1a8296782d4e258711a2c330cf401f'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:16.287152 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-46e42bb4-ee74-4064-aa30-399144cc5092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a1a8296782d4e258711a2c330cf401f'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:16.287939 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-46e42bb4-ee74-4064-aa30-399144cc5092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a1a8296782d4e258711a2c330cf401f'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:16.288550 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-46e42bb4-ee74-4064-aa30-399144cc5092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a1a8296782d4e258711a2c330cf401f'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:16.306487 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1236/2460] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:35:16 2022] DELETE /identity/v3/users/1a1a8296782d4e258711a2c330cf401f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:35:16.310972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79c0e3-6f27-4096-afb2-9b0825f0aeb8 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:16.311406 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79c0e3-6f27-4096-afb2-9b0825f0aeb8 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:16.311717 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79c0e3-6f27-4096-afb2-9b0825f0aeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:16.331983 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-9c79c0e3-6f27-4096-afb2-9b0825f0aeb8 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:35:16.333429 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-9c79c0e3-6f27-4096-afb2-9b0825f0aeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:16.437043 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1225/2461] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:35:16.447553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e42bb4-ee74-4064-aa30-399144cc5092 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:16.449126 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-46e42bb4-ee74-4064-aa30-399144cc5092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:16.522745 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e42bb4-ee74-4064-aa30-399144cc5092 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:16.528683 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00f6f3-5c99-4ac3-97d8-5dfa79a3fb94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:16.529271 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00f6f3-5c99-4ac3-97d8-5dfa79a3fb94 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:16.529620 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00f6f3-5c99-4ac3-97d8-5dfa79a3fb94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:16.529972 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00f6f3-5c99-4ac3-97d8-5dfa79a3fb94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:16.543017 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00f6f3-5c99-4ac3-97d8-5dfa79a3fb94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:16.545371 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00f6f3-5c99-4ac3-97d8-5dfa79a3fb94 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:16.556168 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1237/2462] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:35:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:35:16.912260 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79c0e3-6f27-4096-afb2-9b0825f0aeb8 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:16.914257 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-9c79c0e3-6f27-4096-afb2-9b0825f0aeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:16.936645 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79c0e3-6f27-4096-afb2-9b0825f0aeb8 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:16.944033 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b4a22-b4cd-4bbe-8b50-fc7192a0c56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:16.947873 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b4a22-b4cd-4bbe-8b50-fc7192a0c56b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:16.948178 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b4a22-b4cd-4bbe-8b50-fc7192a0c56b admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:16.948473 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b4a22-b4cd-4bbe-8b50-fc7192a0c56b admin admin] PATH_INFO: `/v3/projects/f58635c687bf42739bee6145df97fb83` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:16.950447 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b4a22-b4cd-4bbe-8b50-fc7192a0c56b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f58635c687bf42739bee6145df97fb83)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:16.952435 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b4a22-b4cd-4bbe-8b50-fc7192a0c56b admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:17.040677 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-f64b4a22-b4cd-4bbe-8b50-fc7192a0c56b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f58635c687bf42739bee6145df97fb83', 'request_id': 'req-f64b4a22-b4cd-4bbe-8b50-fc7192a0c56b'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:17.048841 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-f64b4a22-b4cd-4bbe-8b50-fc7192a0c56b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f58635c687bf42739bee6145df97fb83', 'request_id': 'req-f64b4a22-b4cd-4bbe-8b50-fc7192a0c56b'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:17.058846 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-f64b4a22-b4cd-4bbe-8b50-fc7192a0c56b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f58635c687bf42739bee6145df97fb83', 'request_id': 'req-f64b4a22-b4cd-4bbe-8b50-fc7192a0c56b'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:17.085817 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-f64b4a22-b4cd-4bbe-8b50-fc7192a0c56b admin admin] The token cache is being invalidate because project f58635c687bf42739bee6145df97fb83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:35:17.086116 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-f64b4a22-b4cd-4bbe-8b50-fc7192a0c56b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:17.086797 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-f64b4a22-b4cd-4bbe-8b50-fc7192a0c56b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:17.088748 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1226/2463] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:35:16 2022] DELETE /identity/v3/projects/f58635c687bf42739bee6145df97fb83 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:35:25.508507 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00f6f3-5c99-4ac3-97d8-5dfa79a3fb94 service neutron] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:25.510710 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-9a00f6f3-5c99-4ac3-97d8-5dfa79a3fb94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:25.657005 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00f6f3-5c99-4ac3-97d8-5dfa79a3fb94 service neutron] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:25.730935 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:25.803188 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2a7fc-097e-4df1-81f4-9bfca9e261f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a27fe78683743c397fe7929e9053c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:25.804807 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2a7fc-097e-4df1-81f4-9bfca9e261f4 service placement] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:25.807779 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2a7fc-097e-4df1-81f4-9bfca9e261f4 service placement] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:25.824273 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2a7fc-097e-4df1-81f4-9bfca9e261f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:25.829708 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-5af2a7fc-097e-4df1-81f4-9bfca9e261f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:25.864863 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af2a7fc-097e-4df1-81f4-9bfca9e261f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:25.866630 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af2a7fc-097e-4df1-81f4-9bfca9e261f4 service placement] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:25.880415 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1238/2464] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:35:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:35:27.081281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:INSERT=2,keystone:SELECT=82,keystone:DELETE=7 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:30.860669 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2b565-446b-4bee-b215-498785edcf46 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:30.861196 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2b565-446b-4bee-b215-498785edcf46 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:30.861324 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2b565-446b-4bee-b215-498785edcf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:30.882411 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-88b2b565-446b-4bee-b215-498785edcf46 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:35:30.883670 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-88b2b565-446b-4bee-b215-498785edcf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:30.960975 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1227/2465] 10.222.0.40 () {58 vars in 1016 bytes} [Tue Jul 19 15:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:35:30.984154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2a7fc-097e-4df1-81f4-9bfca9e261f4 service placement] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:30.986954 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-5af2a7fc-097e-4df1-81f4-9bfca9e261f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:31.110353 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2a7fc-097e-4df1-81f4-9bfca9e261f4 service placement] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:31.116485 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0110ce6-5338-499e-8613-e0051dcb021a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:31.116795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0110ce6-5338-499e-8613-e0051dcb021a service nova] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:31.117027 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0110ce6-5338-499e-8613-e0051dcb021a service nova] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:31.117450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0110ce6-5338-499e-8613-e0051dcb021a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:31.126980 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0110ce6-5338-499e-8613-e0051dcb021a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:31.129003 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0110ce6-5338-499e-8613-e0051dcb021a service nova] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:31.142674 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1239/2466] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:35:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:35:40.951670 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=27 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:41.135607 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=54 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:45.345292 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990e460-1c77-4185-9829-391425faa0fb None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:45.345850 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990e460-1c77-4185-9829-391425faa0fb None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:45.345850 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990e460-1c77-4185-9829-391425faa0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:45.364952 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-b990e460-1c77-4185-9829-391425faa0fb None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:35:45.366238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-b990e460-1c77-4185-9829-391425faa0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:45.374498 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1228/2467] 10.222.0.40 () {58 vars in 1016 bytes} [Tue Jul 19 15:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:35:45.396229 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0110ce6-5338-499e-8613-e0051dcb021a service nova] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:45.408066 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0110ce6-5338-499e-8613-e0051dcb021a service nova] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:45.413554 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e0afe-41c3-4e84-a42f-96897adcfa75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:45.414229 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e0afe-41c3-4e84-a42f-96897adcfa75 service nova] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:45.414526 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e0afe-41c3-4e84-a42f-96897adcfa75 service nova] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:45.414786 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e0afe-41c3-4e84-a42f-96897adcfa75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:45.424157 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e0afe-41c3-4e84-a42f-96897adcfa75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:45.425723 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e0afe-41c3-4e84-a42f-96897adcfa75 service nova] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:45.435336 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1240/2468] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:35:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:35:48.232673 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990e460-1c77-4185-9829-391425faa0fb None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:48.235384 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-b990e460-1c77-4185-9829-391425faa0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:48.257047 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990e460-1c77-4185-9829-391425faa0fb None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:48.272475 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583eb83-5ca5-4a8c-9777-163d838c0c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:48.274132 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583eb83-5ca5-4a8c-9777-163d838c0c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:48.275122 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583eb83-5ca5-4a8c-9777-163d838c0c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:48.275709 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583eb83-5ca5-4a8c-9777-163d838c0c98 admin admin] PATH_INFO: `/v3/users/2ccdcfbebcdf4d559abbd11de5af20ff` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:48.278418 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583eb83-5ca5-4a8c-9777-163d838c0c98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ccdcfbebcdf4d559abbd11de5af20ff)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:48.291521 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583eb83-5ca5-4a8c-9777-163d838c0c98 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:48.355612 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-c583eb83-5ca5-4a8c-9777-163d838c0c98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ccdcfbebcdf4d559abbd11de5af20ff'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:48.383901 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-c583eb83-5ca5-4a8c-9777-163d838c0c98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ccdcfbebcdf4d559abbd11de5af20ff'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:48.394323 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-c583eb83-5ca5-4a8c-9777-163d838c0c98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ccdcfbebcdf4d559abbd11de5af20ff'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:48.395692 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-c583eb83-5ca5-4a8c-9777-163d838c0c98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ccdcfbebcdf4d559abbd11de5af20ff'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:48.396524 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-c583eb83-5ca5-4a8c-9777-163d838c0c98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ccdcfbebcdf4d559abbd11de5af20ff'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:48.421035 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1229/2469] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:35:48 2022] DELETE /identity/v3/users/2ccdcfbebcdf4d559abbd11de5af20ff => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:35:48.428713 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211bd82-e308-4b66-88f8-efc6382ce20c None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:48.430138 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211bd82-e308-4b66-88f8-efc6382ce20c None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:48.430714 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211bd82-e308-4b66-88f8-efc6382ce20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:48.456023 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-c211bd82-e308-4b66-88f8-efc6382ce20c None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:35:48.457297 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-c211bd82-e308-4b66-88f8-efc6382ce20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:48.531055 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1241/2470] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:35:48.542523 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583eb83-5ca5-4a8c-9777-163d838c0c98 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:48.544838 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-c583eb83-5ca5-4a8c-9777-163d838c0c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:48.614396 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583eb83-5ca5-4a8c-9777-163d838c0c98 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:48.618307 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a181d96-badd-48e1-9764-a139d7e15e55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:48.618990 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a181d96-badd-48e1-9764-a139d7e15e55 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:48.619315 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a181d96-badd-48e1-9764-a139d7e15e55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:48.619595 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a181d96-badd-48e1-9764-a139d7e15e55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:48.636630 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a181d96-badd-48e1-9764-a139d7e15e55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:48.639532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a181d96-badd-48e1-9764-a139d7e15e55 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:48.664019 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1230/2471] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:35:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:35:49.070621 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211bd82-e308-4b66-88f8-efc6382ce20c None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:49.072142 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-c211bd82-e308-4b66-88f8-efc6382ce20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:49.086055 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211bd82-e308-4b66-88f8-efc6382ce20c None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:49.092462 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd9903-5102-4c4e-a4ec-1ea67d5adf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:49.093345 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd9903-5102-4c4e-a4ec-1ea67d5adf93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:49.093688 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd9903-5102-4c4e-a4ec-1ea67d5adf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:49.093965 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd9903-5102-4c4e-a4ec-1ea67d5adf93 admin admin] PATH_INFO: `/v3/projects/4249e35269d84d1b910474d1ef8e14fe` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:49.095304 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd9903-5102-4c4e-a4ec-1ea67d5adf93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4249e35269d84d1b910474d1ef8e14fe)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:49.097549 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd9903-5102-4c4e-a4ec-1ea67d5adf93 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:49.157079 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-fabd9903-5102-4c4e-a4ec-1ea67d5adf93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4249e35269d84d1b910474d1ef8e14fe', 'request_id': 'req-fabd9903-5102-4c4e-a4ec-1ea67d5adf93'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:49.165362 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-fabd9903-5102-4c4e-a4ec-1ea67d5adf93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4249e35269d84d1b910474d1ef8e14fe', 'request_id': 'req-fabd9903-5102-4c4e-a4ec-1ea67d5adf93'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:49.176041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-fabd9903-5102-4c4e-a4ec-1ea67d5adf93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4249e35269d84d1b910474d1ef8e14fe', 'request_id': 'req-fabd9903-5102-4c4e-a4ec-1ea67d5adf93'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:49.192578 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-fabd9903-5102-4c4e-a4ec-1ea67d5adf93 admin admin] The token cache is being invalidate because project 4249e35269d84d1b910474d1ef8e14fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:35:49.193106 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-fabd9903-5102-4c4e-a4ec-1ea67d5adf93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:49.194197 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-fabd9903-5102-4c4e-a4ec-1ea67d5adf93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:49.196590 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1242/2472] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:35:49 2022] DELETE /identity/v3/projects/4249e35269d84d1b910474d1ef8e14fe => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:35:49.203820 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd94b9c-301f-4332-ab3c-f366eed3db7f None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:49.204137 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd94b9c-301f-4332-ab3c-f366eed3db7f None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:49.204370 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd94b9c-301f-4332-ab3c-f366eed3db7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:49.224369 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-6cd94b9c-301f-4332-ab3c-f366eed3db7f None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:35:49.226523 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-6cd94b9c-301f-4332-ab3c-f366eed3db7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:49.318476 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1231/2473] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:35:49.327018 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26da3d7-3b4c-4e21-aa1f-5df771ed2bd1 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:49.327355 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26da3d7-3b4c-4e21-aa1f-5df771ed2bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:49.327637 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26da3d7-3b4c-4e21-aa1f-5df771ed2bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:49.348050 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-d26da3d7-3b4c-4e21-aa1f-5df771ed2bd1 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:35:49.349348 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-d26da3d7-3b4c-4e21-aa1f-5df771ed2bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:49.358530 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1243/2474] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:35:49.363501 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd94b9c-301f-4332-ab3c-f366eed3db7f None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:49.374156 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd94b9c-301f-4332-ab3c-f366eed3db7f None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:49.379544 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b1333-74eb-45cf-a234-e9fe5986becc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:49.380248 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b1333-74eb-45cf-a234-e9fe5986becc admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:49.380538 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b1333-74eb-45cf-a234-e9fe5986becc admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:49.380816 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b1333-74eb-45cf-a234-e9fe5986becc admin admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:49.381577 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b1333-74eb-45cf-a234-e9fe5986becc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:49.381892 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b1333-74eb-45cf-a234-e9fe5986becc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:49.383600 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b1333-74eb-45cf-a234-e9fe5986becc admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:49.390492 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:49.420876 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1232/2475] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:49.423548 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26da3d7-3b4c-4e21-aa1f-5df771ed2bd1 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:49.440127 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26da3d7-3b4c-4e21-aa1f-5df771ed2bd1 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:49.448792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5031826-94bb-432b-b014-baee1a407d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:49.450469 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5031826-94bb-432b-b014-baee1a407d97 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:49.450966 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5031826-94bb-432b-b014-baee1a407d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:49.451354 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5031826-94bb-432b-b014-baee1a407d97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:49.452976 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5031826-94bb-432b-b014-baee1a407d97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:49.457682 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5031826-94bb-432b-b014-baee1a407d97 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:49.504396 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1244/2476] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:35:49 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:35:49.510709 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b1333-74eb-45cf-a234-e9fe5986becc admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:49.534772 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b1333-74eb-45cf-a234-e9fe5986becc admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:49.650771 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8062b3a-085e-4cf7-b255-b0c94adc170b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:49.651729 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8062b3a-085e-4cf7-b255-b0c94adc170b admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:49.652006 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8062b3a-085e-4cf7-b255-b0c94adc170b admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:49.652287 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8062b3a-085e-4cf7-b255-b0c94adc170b admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:49.653582 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8062b3a-085e-4cf7-b255-b0c94adc170b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:49.655586 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8062b3a-085e-4cf7-b255-b0c94adc170b admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:49.692090 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1233/2477] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:35:49 2022] POST /identity/v3/users => generated 287 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:35:49.693624 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5031826-94bb-432b-b014-baee1a407d97 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:49.708196 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5031826-94bb-432b-b014-baee1a407d97 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:49.714140 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b7fbd-05a8-4462-bbca-3730069e71d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:49.715941 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b7fbd-05a8-4462-bbca-3730069e71d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:49.716329 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b7fbd-05a8-4462-bbca-3730069e71d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:49.716602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b7fbd-05a8-4462-bbca-3730069e71d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:49.717403 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b7fbd-05a8-4462-bbca-3730069e71d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:49.719261 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b7fbd-05a8-4462-bbca-3730069e71d8 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:49.731289 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1245/2478] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:35:49.732738 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8b798-a02e-4564-b1ee-c8fbada5e263 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:49.733300 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8b798-a02e-4564-b1ee-c8fbada5e263 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:49.733969 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8b798-a02e-4564-b1ee-c8fbada5e263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:49.735463 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b7fbd-05a8-4462-bbca-3730069e71d8 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:49.747057 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b7fbd-05a8-4462-bbca-3730069e71d8 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:49.753563 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c161c5a-9b99-4bc2-a940-35a16d93b658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:49.754263 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c161c5a-9b99-4bc2-a940-35a16d93b658 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:49.754550 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c161c5a-9b99-4bc2-a940-35a16d93b658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:49.754832 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c161c5a-9b99-4bc2-a940-35a16d93b658 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:49.755617 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c161c5a-9b99-4bc2-a940-35a16d93b658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:49.757271 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c161c5a-9b99-4bc2-a940-35a16d93b658 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:49.769285 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-69d8b798-a02e-4564-b1ee-c8fbada5e263 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:35:49.770497 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1246/2479] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:35:49.771371 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-69d8b798-a02e-4564-b1ee-c8fbada5e263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:49.779023 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c161c5a-9b99-4bc2-a940-35a16d93b658 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:49.784648 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1234/2480] 10.222.0.40 () {58 vars in 1016 bytes} [Tue Jul 19 15:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:35:49.792261 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c161c5a-9b99-4bc2-a940-35a16d93b658 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:49.803983 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e3b1e-dda9-467b-8ee9-a38a3d14a6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:49.806065 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8b798-a02e-4564-b1ee-c8fbada5e263 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:49.806232 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e3b1e-dda9-467b-8ee9-a38a3d14a6ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:49.806678 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e3b1e-dda9-467b-8ee9-a38a3d14a6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:49.807430 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e3b1e-dda9-467b-8ee9-a38a3d14a6ab admin admin] PATH_INFO: `/v3/projects/6aff9e6382374d38b212f1f7d0890ef7/users/87f06c66b2434fb38c70b82cccd88e42/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:49.808502 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-69d8b798-a02e-4564-b1ee-c8fbada5e263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:49.833532 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e3b1e-dda9-467b-8ee9-a38a3d14a6ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aff9e6382374d38b212f1f7d0890ef7, user_id=87f06c66b2434fb38c70b82cccd88e42, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:49.836274 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e3b1e-dda9-467b-8ee9-a38a3d14a6ab admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:49.841571 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:49.873701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1247/2481] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:35:49 2022] PUT /identity/v3/projects/6aff9e6382374d38b212f1f7d0890ef7/users/87f06c66b2434fb38c70b82cccd88e42/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:35:49.879257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44d04a-c56a-4872-9133-66a88f7afbc9 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:49.879537 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44d04a-c56a-4872-9133-66a88f7afbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:49.880015 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44d04a-c56a-4872-9133-66a88f7afbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:49.901407 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-2a44d04a-c56a-4872-9133-66a88f7afbc9 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:35:49.902628 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-2a44d04a-c56a-4872-9133-66a88f7afbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:49.940821 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8b798-a02e-4564-b1ee-c8fbada5e263 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:50.019274 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1248/2482] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:35:50.030037 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44d04a-c56a-4872-9133-66a88f7afbc9 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:50.032331 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-2a44d04a-c56a-4872-9133-66a88f7afbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:50.037279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ab4d7-1d85-416e-880a-7d53e1a4acf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:50.037961 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ab4d7-1d85-416e-880a-7d53e1a4acf1 service nova] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:50.038247 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ab4d7-1d85-416e-880a-7d53e1a4acf1 service nova] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:50.038575 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ab4d7-1d85-416e-880a-7d53e1a4acf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:50.051257 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ab4d7-1d85-416e-880a-7d53e1a4acf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:50.053014 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ab4d7-1d85-416e-880a-7d53e1a4acf1 service nova] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:50.072055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1235/2483] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:35:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:35:50.147619 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44d04a-c56a-4872-9133-66a88f7afbc9 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:50.151959 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4ac73-552a-4cc5-8d36-d8bfdf627980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:50.152632 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4ac73-552a-4cc5-8d36-d8bfdf627980 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:50.153466 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4ac73-552a-4cc5-8d36-d8bfdf627980 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:50.153756 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4ac73-552a-4cc5-8d36-d8bfdf627980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:50.173457 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4ac73-552a-4cc5-8d36-d8bfdf627980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:50.174951 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4ac73-552a-4cc5-8d36-d8bfdf627980 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:50.188942 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1249/2484] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:35:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:35:54.858013 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ab4d7-1d85-416e-880a-7d53e1a4acf1 service nova] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:54.862351 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:54.875877 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ab4d7-1d85-416e-880a-7d53e1a4acf1 service nova] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:54.879907 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3ca1b-f6c3-4756-ac16-78f7c7d052cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:54.880592 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3ca1b-f6c3-4756-ac16-78f7c7d052cf service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:54.880880 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3ca1b-f6c3-4756-ac16-78f7c7d052cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:54.881160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3ca1b-f6c3-4756-ac16-78f7c7d052cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:54.883186 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-84b3ca1b-f6c3-4756-ac16-78f7c7d052cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:54.885151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982505ee-2c08-4052-955a-7ce22226c03c None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:54.885672 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982505ee-2c08-4052-955a-7ce22226c03c None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:54.885964 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982505ee-2c08-4052-955a-7ce22226c03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:54.928855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-982505ee-2c08-4052-955a-7ce22226c03c None None] MFA Rules not processed for user `87f06c66b2434fb38c70b82cccd88e42`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:35:54.930960 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-982505ee-2c08-4052-955a-7ce22226c03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:54.989502 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b3ca1b-f6c3-4756-ac16-78f7c7d052cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:54.990990 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b3ca1b-f6c3-4756-ac16-78f7c7d052cf service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:55.003302 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1236/2485] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:35:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:35:55.004518 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcca7da-468f-451c-ba6e-baeac91d85fc None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:55.004811 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcca7da-468f-451c-ba6e-baeac91d85fc None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:55.005140 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcca7da-468f-451c-ba6e-baeac91d85fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:55.016840 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1250/2486] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:35:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:35:55.021489 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982505ee-2c08-4052-955a-7ce22226c03c None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:55.028241 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-dfcca7da-468f-451c-ba6e-baeac91d85fc None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:35:55.029564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-dfcca7da-468f-451c-ba6e-baeac91d85fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:55.034365 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982505ee-2c08-4052-955a-7ce22226c03c None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:55.039526 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1237/2487] 10.222.0.40 () {58 vars in 1016 bytes} [Tue Jul 19 15:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:35:55.046547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d85a21-8519-490e-8292-78e9d11bf5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:55.047292 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d85a21-8519-490e-8292-78e9d11bf5a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:55.047585 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d85a21-8519-490e-8292-78e9d11bf5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:55.047863 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d85a21-8519-490e-8292-78e9d11bf5a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:55.048574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d85a21-8519-490e-8292-78e9d11bf5a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:55.050771 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d85a21-8519-490e-8292-78e9d11bf5a2 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:55.069815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcca7da-468f-451c-ba6e-baeac91d85fc None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:55.085407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcca7da-468f-451c-ba6e-baeac91d85fc None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:55.088089 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1251/2488] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:35:55 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:35:55.089061 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d85a21-8519-490e-8292-78e9d11bf5a2 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:55.104273 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:55.200448 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d85a21-8519-490e-8292-78e9d11bf5a2 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:55.207895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02390b-90c9-4d1f-b9c2-f3ea6894260c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:55.209205 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02390b-90c9-4d1f-b9c2-f3ea6894260c admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:55.211714 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02390b-90c9-4d1f-b9c2-f3ea6894260c admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:55.212136 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02390b-90c9-4d1f-b9c2-f3ea6894260c admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:55.214657 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02390b-90c9-4d1f-b9c2-f3ea6894260c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:55.218819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02390b-90c9-4d1f-b9c2-f3ea6894260c admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:55.222792 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebfef3-e0ac-41f3-9d53-e39b8f8046fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:55.223667 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebfef3-e0ac-41f3-9d53-e39b8f8046fa service nova] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:55.224838 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebfef3-e0ac-41f3-9d53-e39b8f8046fa service nova] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:55.225226 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebfef3-e0ac-41f3-9d53-e39b8f8046fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:55.240744 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ebfef3-e0ac-41f3-9d53-e39b8f8046fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:55.242370 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ebfef3-e0ac-41f3-9d53-e39b8f8046fa service nova] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:55.256569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1252/2489] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:35:55 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:35:55.258528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1238/2490] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:35:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:35:55.259472 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02390b-90c9-4d1f-b9c2-f3ea6894260c admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:55.274003 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02390b-90c9-4d1f-b9c2-f3ea6894260c admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:55.281278 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf65e52-16ad-4d31-8674-5a93232bf62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:55.282402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf65e52-16ad-4d31-8674-5a93232bf62e admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:55.283004 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf65e52-16ad-4d31-8674-5a93232bf62e admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:55.283528 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf65e52-16ad-4d31-8674-5a93232bf62e admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:55.284559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf65e52-16ad-4d31-8674-5a93232bf62e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:55.286390 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf65e52-16ad-4d31-8674-5a93232bf62e admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:55.301612 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1253/2491] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:35:55.306101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebfef3-e0ac-41f3-9d53-e39b8f8046fa service nova] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:55.331910 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebfef3-e0ac-41f3-9d53-e39b8f8046fa service nova] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:55.337258 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3e345-7b40-42ed-a8d7-ec5884f30aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:55.338405 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3e345-7b40-42ed-a8d7-ec5884f30aed admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:55.338886 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3e345-7b40-42ed-a8d7-ec5884f30aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:55.339088 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3e345-7b40-42ed-a8d7-ec5884f30aed admin admin] PATH_INFO: `/v3/projects/9cdcc5f4a06a49e9a03dc0cacb5b1c7c/users/646f517fbf834b95a39301314866367c/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:55.359041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3e345-7b40-42ed-a8d7-ec5884f30aed admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cdcc5f4a06a49e9a03dc0cacb5b1c7c, user_id=646f517fbf834b95a39301314866367c, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:55.361963 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3e345-7b40-42ed-a8d7-ec5884f30aed admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:55.380586 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1239/2492] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:35:55 2022] PUT /identity/v3/projects/9cdcc5f4a06a49e9a03dc0cacb5b1c7c/users/646f517fbf834b95a39301314866367c/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:35:55.384419 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf65e52-16ad-4d31-8674-5a93232bf62e admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:55.395276 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf65e52-16ad-4d31-8674-5a93232bf62e admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:55.463694 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df3ebe-72f2-4ffc-81f1-346de357fd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:55.464639 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df3ebe-72f2-4ffc-81f1-346de357fd2b admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:55.465554 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df3ebe-72f2-4ffc-81f1-346de357fd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:55.465923 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df3ebe-72f2-4ffc-81f1-346de357fd2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:55.466907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df3ebe-72f2-4ffc-81f1-346de357fd2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:55.468504 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df3ebe-72f2-4ffc-81f1-346de357fd2b admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:55.479996 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1254/2493] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:35:55.484142 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3e345-7b40-42ed-a8d7-ec5884f30aed admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:55.497051 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3e345-7b40-42ed-a8d7-ec5884f30aed admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:55.502153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295aa790-5163-47ef-8075-110d9dd6735a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:55.503124 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295aa790-5163-47ef-8075-110d9dd6735a admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:55.503491 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295aa790-5163-47ef-8075-110d9dd6735a admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:55.503850 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295aa790-5163-47ef-8075-110d9dd6735a admin admin] PATH_INFO: `/v3/projects/9cdcc5f4a06a49e9a03dc0cacb5b1c7c/users/646f517fbf834b95a39301314866367c/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:55.506239 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295aa790-5163-47ef-8075-110d9dd6735a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cdcc5f4a06a49e9a03dc0cacb5b1c7c, user_id=646f517fbf834b95a39301314866367c, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:55.509087 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295aa790-5163-47ef-8075-110d9dd6735a admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:55.522762 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1240/2494] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:35:55 2022] PUT /identity/v3/projects/9cdcc5f4a06a49e9a03dc0cacb5b1c7c/users/646f517fbf834b95a39301314866367c/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:36:00.353756 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49cfcf-5cb3-4763-93b6-de0566debe26 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:00.354248 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49cfcf-5cb3-4763-93b6-de0566debe26 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:00.354526 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49cfcf-5cb3-4763-93b6-de0566debe26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:00.400786 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-fb49cfcf-5cb3-4763-93b6-de0566debe26 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:36:00.407663 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-fb49cfcf-5cb3-4763-93b6-de0566debe26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:36:00.575443 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1255/2495] 10.222.0.40 () {58 vars in 1016 bytes} [Tue Jul 19 15:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:36:00.608557 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295aa790-5163-47ef-8075-110d9dd6735a admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:36:00.610491 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-295aa790-5163-47ef-8075-110d9dd6735a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:36:00.711425 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:00.765414 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295aa790-5163-47ef-8075-110d9dd6735a admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:36:00.772634 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c97123-65e8-4a19-9701-3350f797fcf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:36:00.773025 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c97123-65e8-4a19-9701-3350f797fcf3 service nova] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:00.773478 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c97123-65e8-4a19-9701-3350f797fcf3 service nova] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:00.773592 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c97123-65e8-4a19-9701-3350f797fcf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:00.783823 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c97123-65e8-4a19-9701-3350f797fcf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:36:00.785288 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c97123-65e8-4a19-9701-3350f797fcf3 service nova] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:36:00.798220 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1241/2496] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:36:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:36:01.643695 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369ce3a-2028-4dff-a493-665d5ac47c34 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:01.644944 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369ce3a-2028-4dff-a493-665d5ac47c34 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:01.645489 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369ce3a-2028-4dff-a493-665d5ac47c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:01.705880 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-0369ce3a-2028-4dff-a493-665d5ac47c34 None None] MFA Rules not processed for user `646f517fbf834b95a39301314866367c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:36:01.707384 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-0369ce3a-2028-4dff-a493-665d5ac47c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:36:01.721121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:01.841365 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1256/2497] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:36:01 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:36:01.905666 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c97123-65e8-4a19-9701-3350f797fcf3 service nova] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:36:01.930296 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c97123-65e8-4a19-9701-3350f797fcf3 service nova] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:36:01.952490 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb0913-db7f-474e-9458-6e78deded885 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:36:01.953526 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb0913-db7f-474e-9458-6e78deded885 service nova] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:01.968872 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb0913-db7f-474e-9458-6e78deded885 service nova] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:01.969707 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb0913-db7f-474e-9458-6e78deded885 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:02.111672 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb0913-db7f-474e-9458-6e78deded885 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:36:02.113538 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb0913-db7f-474e-9458-6e78deded885 service nova] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:36:02.146265 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1242/2498] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:36:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:36:03.540629 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18d5ee-c508-4204-9d1c-530f733de1a9 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:03.541581 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18d5ee-c508-4204-9d1c-530f733de1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:03.541862 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18d5ee-c508-4204-9d1c-530f733de1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:03.560699 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-1e18d5ee-c508-4204-9d1c-530f733de1a9 None None] MFA Rules not processed for user `87f06c66b2434fb38c70b82cccd88e42`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:36:03.561960 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-1e18d5ee-c508-4204-9d1c-530f733de1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:36:03.570475 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1257/2499] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:36:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:36:04.917403 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e13c5-e51b-47af-a9b0-320b4af19c4f None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:04.917970 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e13c5-e51b-47af-a9b0-320b4af19c4f None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:04.917970 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e13c5-e51b-47af-a9b0-320b4af19c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:04.937149 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-f01e13c5-e51b-47af-a9b0-320b4af19c4f None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:36:04.938646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-f01e13c5-e51b-47af-a9b0-320b4af19c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:36:04.947753 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1243/2500] 10.222.0.40 () {58 vars in 1016 bytes} [Tue Jul 19 15:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:36:04.977580 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18d5ee-c508-4204-9d1c-530f733de1a9 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:36:04.993110 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18d5ee-c508-4204-9d1c-530f733de1a9 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:36:05.004752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae84d76-a00a-498b-8ed0-1e14da50307e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:36:05.005453 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae84d76-a00a-498b-8ed0-1e14da50307e service nova] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:05.005743 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae84d76-a00a-498b-8ed0-1e14da50307e service nova] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:05.006047 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae84d76-a00a-498b-8ed0-1e14da50307e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:05.018398 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae84d76-a00a-498b-8ed0-1e14da50307e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:36:05.020631 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae84d76-a00a-498b-8ed0-1e14da50307e service nova] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:36:05.031885 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1258/2501] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:36:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:36:14.931532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=48 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:15.026656 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=33 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:25.212152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26552610-e77b-4a15-b7e8-4704dcba1ec6 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:25.212669 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26552610-e77b-4a15-b7e8-4704dcba1ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:25.212776 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26552610-e77b-4a15-b7e8-4704dcba1ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:25.229932 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-26552610-e77b-4a15-b7e8-4704dcba1ec6 None None] MFA Rules not processed for user `f443bdddfe274794a35d7b5340229d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:36:25.231104 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-26552610-e77b-4a15-b7e8-4704dcba1ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:36:25.284728 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1244/2502] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:36:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:36:35.277772 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=25 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:43.838932 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d173f93-b109-477a-b34d-edcd76d67f6c None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:43.839540 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d173f93-b109-477a-b34d-edcd76d67f6c None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:43.839644 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d173f93-b109-477a-b34d-edcd76d67f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:43.859270 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-4d173f93-b109-477a-b34d-edcd76d67f6c None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:36:43.860537 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-4d173f93-b109-477a-b34d-edcd76d67f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:36:43.872372 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1259/2503] 10.222.0.40 () {58 vars in 1016 bytes} [Tue Jul 19 15:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:36:43.896110 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26552610-e77b-4a15-b7e8-4704dcba1ec6 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:36:43.909795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26552610-e77b-4a15-b7e8-4704dcba1ec6 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:36:43.914957 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f70ddc-0028-4175-8921-22e47bd46ec9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:36:43.915640 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f70ddc-0028-4175-8921-22e47bd46ec9 service nova] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:43.915926 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f70ddc-0028-4175-8921-22e47bd46ec9 service nova] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:43.916207 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f70ddc-0028-4175-8921-22e47bd46ec9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:43.926039 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f70ddc-0028-4175-8921-22e47bd46ec9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:36:43.927660 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f70ddc-0028-4175-8921-22e47bd46ec9 service nova] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:36:43.943995 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1245/2504] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:36:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:36:45.441856 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d173f93-b109-477a-b34d-edcd76d67f6c None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:36:45.494951 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d173f93-b109-477a-b34d-edcd76d67f6c None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:36:45.499051 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695af00b-8af5-476a-b01d-9ddc7625572f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:36:45.499732 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695af00b-8af5-476a-b01d-9ddc7625572f service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:45.500020 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695af00b-8af5-476a-b01d-9ddc7625572f service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:45.500304 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695af00b-8af5-476a-b01d-9ddc7625572f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:45.509155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695af00b-8af5-476a-b01d-9ddc7625572f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:36:45.510573 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695af00b-8af5-476a-b01d-9ddc7625572f service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:36:45.520772 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1260/2505] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:36:45 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:36:48.118806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46a499-6c7f-469c-9a01-d8647a7ca279 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:48.119428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46a499-6c7f-469c-9a01-d8647a7ca279 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:48.119428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46a499-6c7f-469c-9a01-d8647a7ca279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:48.138033 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-cf46a499-6c7f-469c-9a01-d8647a7ca279 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:36:48.139281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-cf46a499-6c7f-469c-9a01-d8647a7ca279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:36:48.147706 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1246/2506] 10.222.0.40 () {58 vars in 1016 bytes} [Tue Jul 19 15:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:36:48.170461 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695af00b-8af5-476a-b01d-9ddc7625572f service neutron] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:36:48.184392 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695af00b-8af5-476a-b01d-9ddc7625572f service neutron] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:36:48.189862 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df9a2a-95f1-412f-9de3-5a3071982141 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:36:48.190436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df9a2a-95f1-412f-9de3-5a3071982141 service nova] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:48.190723 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df9a2a-95f1-412f-9de3-5a3071982141 service nova] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:48.190997 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df9a2a-95f1-412f-9de3-5a3071982141 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:48.200792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df9a2a-95f1-412f-9de3-5a3071982141 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:36:48.202350 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df9a2a-95f1-412f-9de3-5a3071982141 service nova] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:36:48.213210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1261/2507] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:36:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:36:52.235270 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6c591-ddbc-488a-b78c-944f6a44f5bf None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:52.235962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6c591-ddbc-488a-b78c-944f6a44f5bf None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:52.235962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6c591-ddbc-488a-b78c-944f6a44f5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:52.253587 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-bbf6c591-ddbc-488a-b78c-944f6a44f5bf None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:36:52.255657 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-bbf6c591-ddbc-488a-b78c-944f6a44f5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:36:52.263370 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1247/2508] 10.222.0.40 () {58 vars in 1016 bytes} [Tue Jul 19 15:36:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:36:52.284158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df9a2a-95f1-412f-9de3-5a3071982141 service nova] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:36:52.297607 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df9a2a-95f1-412f-9de3-5a3071982141 service nova] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:36:52.305338 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4cae32-8bde-4a05-afd3-3c54a2378a2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:36:52.305995 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4cae32-8bde-4a05-afd3-3c54a2378a2e service nova] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:52.306266 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4cae32-8bde-4a05-afd3-3c54a2378a2e service nova] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:52.306541 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4cae32-8bde-4a05-afd3-3c54a2378a2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:52.315446 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4cae32-8bde-4a05-afd3-3c54a2378a2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:36:52.317042 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4cae32-8bde-4a05-afd3-3c54a2378a2e service nova] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:36:52.327770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1262/2509] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:36:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:36:56.576679 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf7369-be49-4be7-83e7-3e8368776393 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:56.577230 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf7369-be49-4be7-83e7-3e8368776393 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:56.577230 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf7369-be49-4be7-83e7-3e8368776393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:56.595460 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-2fbf7369-be49-4be7-83e7-3e8368776393 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:36:56.596644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-2fbf7369-be49-4be7-83e7-3e8368776393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:36:56.605077 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1248/2510] 10.222.0.40 () {58 vars in 1016 bytes} [Tue Jul 19 15:36:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:36:56.630532 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4cae32-8bde-4a05-afd3-3c54a2378a2e service nova] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:36:56.641611 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4cae32-8bde-4a05-afd3-3c54a2378a2e service nova] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:36:56.647303 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66dbf6-7e68-4305-b7e1-a14b90eb3d25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:36:56.647989 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66dbf6-7e68-4305-b7e1-a14b90eb3d25 service nova] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:56.648277 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66dbf6-7e68-4305-b7e1-a14b90eb3d25 service nova] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:56.648559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66dbf6-7e68-4305-b7e1-a14b90eb3d25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:56.657184 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66dbf6-7e68-4305-b7e1-a14b90eb3d25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:36:56.658751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66dbf6-7e68-4305-b7e1-a14b90eb3d25 service nova] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:36:56.668915 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1263/2511] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:36:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:37:00.777455 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e19b2f-f151-40c4-aa1c-235992ea08e7 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:00.778036 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e19b2f-f151-40c4-aa1c-235992ea08e7 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:00.778036 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e19b2f-f151-40c4-aa1c-235992ea08e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:00.797379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-92e19b2f-f151-40c4-aa1c-235992ea08e7 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:37:00.798652 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-92e19b2f-f151-40c4-aa1c-235992ea08e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:00.809672 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1249/2512] 10.222.0.40 () {58 vars in 1016 bytes} [Tue Jul 19 15:37:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:37:00.832742 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66dbf6-7e68-4305-b7e1-a14b90eb3d25 service nova] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:00.845298 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66dbf6-7e68-4305-b7e1-a14b90eb3d25 service nova] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:00.851070 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea50b5-dac0-46f0-86c4-e0c62d005777 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:00.851683 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea50b5-dac0-46f0-86c4-e0c62d005777 service nova] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:00.851972 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea50b5-dac0-46f0-86c4-e0c62d005777 service nova] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:00.852255 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea50b5-dac0-46f0-86c4-e0c62d005777 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:00.862574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea50b5-dac0-46f0-86c4-e0c62d005777 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:00.864189 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea50b5-dac0-46f0-86c4-e0c62d005777 service nova] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:00.875069 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1264/2513] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:37:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:37:10.791894 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=18 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:10.870416 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=53 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:17.140282 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e19b2f-f151-40c4-aa1c-235992ea08e7 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:17.151952 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e19b2f-f151-40c4-aa1c-235992ea08e7 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:17.156614 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a020e4-6257-4af6-b00e-9130879fd06a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:17.157381 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a020e4-6257-4af6-b00e-9130879fd06a service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:17.157761 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a020e4-6257-4af6-b00e-9130879fd06a service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:17.158042 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a020e4-6257-4af6-b00e-9130879fd06a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:17.159930 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-10a020e4-6257-4af6-b00e-9130879fd06a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:17.175393 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a020e4-6257-4af6-b00e-9130879fd06a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:17.176828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a020e4-6257-4af6-b00e-9130879fd06a service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:17.179437 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea50b5-dac0-46f0-86c4-e0c62d005777 service nova] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:17.181619 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-77ea50b5-dac0-46f0-86c4-e0c62d005777 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:17.189007 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1250/2514] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:37:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:37:17.193744 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea50b5-dac0-46f0-86c4-e0c62d005777 service nova] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:17.197316 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4c843-5373-4379-8d70-c6a3dbbf360f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:17.198609 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4c843-5373-4379-8d70-c6a3dbbf360f service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:17.198894 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4c843-5373-4379-8d70-c6a3dbbf360f service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:17.199172 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4c843-5373-4379-8d70-c6a3dbbf360f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:17.201073 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-6ee4c843-5373-4379-8d70-c6a3dbbf360f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:17.216786 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4c843-5373-4379-8d70-c6a3dbbf360f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:17.218299 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4c843-5373-4379-8d70-c6a3dbbf360f service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:17.230008 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1265/2515] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:37:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:37:27.183841 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=6 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:27.224797 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=6 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:35.399263 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a020e4-6257-4af6-b00e-9130879fd06a service neutron] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:35.400945 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-10a020e4-6257-4af6-b00e-9130879fd06a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:35.450630 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4c843-5373-4379-8d70-c6a3dbbf360f service neutron] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:35.452770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-6ee4c843-5373-4379-8d70-c6a3dbbf360f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:35.472287 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4c843-5373-4379-8d70-c6a3dbbf360f service neutron] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:35.476647 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a020e4-6257-4af6-b00e-9130879fd06a service neutron] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:35.477225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f9bfd-5780-4d9e-a23d-269d8d27e39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:35.478226 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f9bfd-5780-4d9e-a23d-269d8d27e39a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:35.478574 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f9bfd-5780-4d9e-a23d-269d8d27e39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:35.478924 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f9bfd-5780-4d9e-a23d-269d8d27e39a admin admin] PATH_INFO: `/v3/users/f443bdddfe274794a35d7b5340229d19` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:35.480245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f9bfd-5780-4d9e-a23d-269d8d27e39a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f443bdddfe274794a35d7b5340229d19)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:35.481668 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f76e7-b4e7-4ce6-9f93-4c3890f67ae3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a27fe78683743c397fe7929e9053c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:35.482315 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f76e7-b4e7-4ce6-9f93-4c3890f67ae3 service placement] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:35.482445 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f9bfd-5780-4d9e-a23d-269d8d27e39a admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:35.482594 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f76e7-b4e7-4ce6-9f93-4c3890f67ae3 service placement] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:35.482864 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f76e7-b4e7-4ce6-9f93-4c3890f67ae3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:35.485301 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-051f76e7-b4e7-4ce6-9f93-4c3890f67ae3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:35.498378 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f76e7-b4e7-4ce6-9f93-4c3890f67ae3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:35.500010 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f76e7-b4e7-4ce6-9f93-4c3890f67ae3 service placement] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:35.510939 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1251/2516] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:37:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:37:35.534910 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-c52f9bfd-5780-4d9e-a23d-269d8d27e39a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f443bdddfe274794a35d7b5340229d19'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:37:35.548360 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-c52f9bfd-5780-4d9e-a23d-269d8d27e39a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f443bdddfe274794a35d7b5340229d19'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:37:35.555284 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-c52f9bfd-5780-4d9e-a23d-269d8d27e39a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f443bdddfe274794a35d7b5340229d19'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:37:35.556031 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-c52f9bfd-5780-4d9e-a23d-269d8d27e39a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f443bdddfe274794a35d7b5340229d19'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:37:35.556664 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-c52f9bfd-5780-4d9e-a23d-269d8d27e39a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f443bdddfe274794a35d7b5340229d19'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:37:35.573541 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1266/2517] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:37:35 2022] DELETE /identity/v3/users/f443bdddfe274794a35d7b5340229d19 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:37:35.746284 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f76e7-b4e7-4ce6-9f93-4c3890f67ae3 service placement] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:35.758913 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f76e7-b4e7-4ce6-9f93-4c3890f67ae3 service placement] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:35.818206 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24adc50b-e32d-44d3-9630-f5fa8e9ec81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:35.819074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adc50b-e32d-44d3-9630-f5fa8e9ec81b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:35.819387 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adc50b-e32d-44d3-9630-f5fa8e9ec81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:35.819731 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adc50b-e32d-44d3-9630-f5fa8e9ec81b admin admin] PATH_INFO: `/v3/projects/bcf10b39357d49bf8a6587d38cce9719` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:35.820854 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24adc50b-e32d-44d3-9630-f5fa8e9ec81b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcf10b39357d49bf8a6587d38cce9719)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:35.822740 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24adc50b-e32d-44d3-9630-f5fa8e9ec81b admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:35.876360 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-24adc50b-e32d-44d3-9630-f5fa8e9ec81b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcf10b39357d49bf8a6587d38cce9719', 'request_id': 'req-24adc50b-e32d-44d3-9630-f5fa8e9ec81b'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:37:35.882493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-24adc50b-e32d-44d3-9630-f5fa8e9ec81b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcf10b39357d49bf8a6587d38cce9719', 'request_id': 'req-24adc50b-e32d-44d3-9630-f5fa8e9ec81b'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:37:35.889995 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-24adc50b-e32d-44d3-9630-f5fa8e9ec81b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcf10b39357d49bf8a6587d38cce9719', 'request_id': 'req-24adc50b-e32d-44d3-9630-f5fa8e9ec81b'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:37:35.901773 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-24adc50b-e32d-44d3-9630-f5fa8e9ec81b admin admin] The token cache is being invalidate because project bcf10b39357d49bf8a6587d38cce9719 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:37:35.902066 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-24adc50b-e32d-44d3-9630-f5fa8e9ec81b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:37:35.902707 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-24adc50b-e32d-44d3-9630-f5fa8e9ec81b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:37:35.904303 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1252/2518] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:37:35 2022] DELETE /identity/v3/projects/bcf10b39357d49bf8a6587d38cce9719 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:37:35.909210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8717f29-fc1e-47e8-8176-50f15538eab2 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:35.909507 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8717f29-fc1e-47e8-8176-50f15538eab2 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:35.909793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8717f29-fc1e-47e8-8176-50f15538eab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:35.929554 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-c8717f29-fc1e-47e8-8176-50f15538eab2 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:37:35.930684 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-c8717f29-fc1e-47e8-8176-50f15538eab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:35.989969 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1267/2519] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:37:35.998646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889a40c-f4e7-45e3-ae36-f8e714549e80 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:35.999050 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889a40c-f4e7-45e3-ae36-f8e714549e80 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:35.999442 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889a40c-f4e7-45e3-ae36-f8e714549e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:36.024541 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-4889a40c-f4e7-45e3-ae36-f8e714549e80 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:37:36.025889 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-4889a40c-f4e7-45e3-ae36-f8e714549e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:36.035497 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1253/2520] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:37:36.039307 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8717f29-fc1e-47e8-8176-50f15538eab2 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:36.050363 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8717f29-fc1e-47e8-8176-50f15538eab2 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:36.056860 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f13e68-1938-495e-abe2-4b77d54561eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:36.058940 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f13e68-1938-495e-abe2-4b77d54561eb admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:36.058940 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f13e68-1938-495e-abe2-4b77d54561eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:36.058940 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f13e68-1938-495e-abe2-4b77d54561eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:36.058940 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f13e68-1938-495e-abe2-4b77d54561eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:37:36.059653 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f13e68-1938-495e-abe2-4b77d54561eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:36.061494 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f13e68-1938-495e-abe2-4b77d54561eb admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:36.077557 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1268/2521] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:37:36.082026 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889a40c-f4e7-45e3-ae36-f8e714549e80 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:36.091572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889a40c-f4e7-45e3-ae36-f8e714549e80 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:36.096700 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4ea02-155d-4c31-a188-036e7f0bf812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:36.097362 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4ea02-155d-4c31-a188-036e7f0bf812 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:36.097672 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4ea02-155d-4c31-a188-036e7f0bf812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:36.097948 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4ea02-155d-4c31-a188-036e7f0bf812 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:36.098638 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4ea02-155d-4c31-a188-036e7f0bf812 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:36.100573 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4ea02-155d-4c31-a188-036e7f0bf812 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:36.111995 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:36.134843 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1254/2522] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:37:36 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:37:36.136019 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f13e68-1938-495e-abe2-4b77d54561eb admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:36.146807 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f13e68-1938-495e-abe2-4b77d54561eb admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:36.205078 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6607983-3b98-43b3-a709-7bf0dfeb7cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:36.205751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6607983-3b98-43b3-a709-7bf0dfeb7cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:36.206033 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6607983-3b98-43b3-a709-7bf0dfeb7cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:36.206308 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6607983-3b98-43b3-a709-7bf0dfeb7cc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:36.207009 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6607983-3b98-43b3-a709-7bf0dfeb7cc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:36.208923 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6607983-3b98-43b3-a709-7bf0dfeb7cc9 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:36.215914 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:36.234568 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1269/2523] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:37:36 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:37:36.235844 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4ea02-155d-4c31-a188-036e7f0bf812 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:36.246510 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4ea02-155d-4c31-a188-036e7f0bf812 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:36.251278 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fd5d5-914a-49ca-abeb-662cd292291a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:36.251956 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fd5d5-914a-49ca-abeb-662cd292291a admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:36.252249 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fd5d5-914a-49ca-abeb-662cd292291a admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:36.252528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fd5d5-914a-49ca-abeb-662cd292291a admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:36.253263 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fd5d5-914a-49ca-abeb-662cd292291a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:36.254863 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fd5d5-914a-49ca-abeb-662cd292291a admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:36.266651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1255/2524] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:37:36.270987 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6607983-3b98-43b3-a709-7bf0dfeb7cc9 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:36.281767 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6607983-3b98-43b3-a709-7bf0dfeb7cc9 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:36.286734 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0402050e-e7d0-4d7c-91ca-5270cecc6a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:36.287466 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402050e-e7d0-4d7c-91ca-5270cecc6a4a admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:36.287757 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402050e-e7d0-4d7c-91ca-5270cecc6a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:36.288044 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402050e-e7d0-4d7c-91ca-5270cecc6a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:36.288795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0402050e-e7d0-4d7c-91ca-5270cecc6a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:36.290400 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0402050e-e7d0-4d7c-91ca-5270cecc6a4a admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:36.303010 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1270/2525] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:37:36.308418 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fd5d5-914a-49ca-abeb-662cd292291a admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:36.319103 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fd5d5-914a-49ca-abeb-662cd292291a admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:36.323872 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16dceab-6cba-4ab1-9e95-5fbe78bf6fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:36.324760 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16dceab-6cba-4ab1-9e95-5fbe78bf6fc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:36.325043 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16dceab-6cba-4ab1-9e95-5fbe78bf6fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:36.325318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16dceab-6cba-4ab1-9e95-5fbe78bf6fc0 admin admin] PATH_INFO: `/v3/projects/7d1e06b95eba47fbb1acb66cdea11694/users/940a6ac249644cce9ea825d4dd4298e5/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:36.342325 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16dceab-6cba-4ab1-9e95-5fbe78bf6fc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d1e06b95eba47fbb1acb66cdea11694, user_id=940a6ac249644cce9ea825d4dd4298e5, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:36.345083 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16dceab-6cba-4ab1-9e95-5fbe78bf6fc0 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:36.356433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe69661-2391-4dd1-aba5-e21c145af9c9 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:36.356736 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe69661-2391-4dd1-aba5-e21c145af9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:36.357126 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe69661-2391-4dd1-aba5-e21c145af9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:36.359970 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1256/2526] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:37:36 2022] PUT /identity/v3/projects/7d1e06b95eba47fbb1acb66cdea11694/users/940a6ac249644cce9ea825d4dd4298e5/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:37:36.372554 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc23209-2e00-40ae-9c02-c2756f09b5ec None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:36.372972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc23209-2e00-40ae-9c02-c2756f09b5ec None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:36.373254 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc23209-2e00-40ae-9c02-c2756f09b5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:36.382931 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-fbe69661-2391-4dd1-aba5-e21c145af9c9 None None] MFA Rules not processed for user `dcd12611b7d144e28fa1358f927c9f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:37:36.385399 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-fbe69661-2391-4dd1-aba5-e21c145af9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:36.402940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-dbc23209-2e00-40ae-9c02-c2756f09b5ec None None] MFA Rules not processed for user `940a6ac249644cce9ea825d4dd4298e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:37:36.404954 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-dbc23209-2e00-40ae-9c02-c2756f09b5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:36.441354 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1271/2527] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:37:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:37:36.469632 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1257/2528] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:37:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:37:36.481552 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe69661-2391-4dd1-aba5-e21c145af9c9 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:36.483541 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-fbe69661-2391-4dd1-aba5-e21c145af9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:36.546345 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe69661-2391-4dd1-aba5-e21c145af9c9 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:36.553350 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc51fb-e691-442f-a2e5-b28ffe2b4ce5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:36.554414 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc51fb-e691-442f-a2e5-b28ffe2b4ce5 service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:36.554734 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc51fb-e691-442f-a2e5-b28ffe2b4ce5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:36.555105 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc51fb-e691-442f-a2e5-b28ffe2b4ce5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:36.564725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc51fb-e691-442f-a2e5-b28ffe2b4ce5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:36.566344 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc51fb-e691-442f-a2e5-b28ffe2b4ce5 service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:36.576458 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1272/2529] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:37:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:37:39.248099 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc23209-2e00-40ae-9c02-c2756f09b5ec None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:39.249674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-dbc23209-2e00-40ae-9c02-c2756f09b5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:39.337885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc23209-2e00-40ae-9c02-c2756f09b5ec None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:39.347165 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61cdcc-f916-4f5d-9622-e796dad1fd1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:39.348286 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61cdcc-f916-4f5d-9622-e796dad1fd1e service nova] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:39.348849 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61cdcc-f916-4f5d-9622-e796dad1fd1e service nova] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:39.349340 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61cdcc-f916-4f5d-9622-e796dad1fd1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:39.352265 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-5f61cdcc-f916-4f5d-9622-e796dad1fd1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:39.369382 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61cdcc-f916-4f5d-9622-e796dad1fd1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:39.372186 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61cdcc-f916-4f5d-9622-e796dad1fd1e service nova] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:39.386872 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1258/2530] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:37:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:37:44.238945 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc51fb-e691-442f-a2e5-b28ffe2b4ce5 service cinder] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:44.240405 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-acbc51fb-e691-442f-a2e5-b28ffe2b4ce5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:44.297070 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc51fb-e691-442f-a2e5-b28ffe2b4ce5 service cinder] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:44.301078 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f744d-d9a5-456a-8a4d-09e31c6e0af7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:44.301763 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f744d-d9a5-456a-8a4d-09e31c6e0af7 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:44.302049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f744d-d9a5-456a-8a4d-09e31c6e0af7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:44.302327 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f744d-d9a5-456a-8a4d-09e31c6e0af7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:44.304133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-995f744d-d9a5-456a-8a4d-09e31c6e0af7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:44.313695 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f744d-d9a5-456a-8a4d-09e31c6e0af7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:44.315100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f744d-d9a5-456a-8a4d-09e31c6e0af7 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:44.322953 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1273/2531] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:37:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:37:46.760936 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61cdcc-f916-4f5d-9622-e796dad1fd1e service nova] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:46.794894 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:46.826412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61cdcc-f916-4f5d-9622-e796dad1fd1e service nova] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:46.831022 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ff472-2606-48d9-8cdb-0c380099982d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:46.831924 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ff472-2606-48d9-8cdb-0c380099982d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:46.832214 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ff472-2606-48d9-8cdb-0c380099982d admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:46.832496 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ff472-2606-48d9-8cdb-0c380099982d admin admin] PATH_INFO: `/v3/users/940a6ac249644cce9ea825d4dd4298e5` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:46.833688 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ff472-2606-48d9-8cdb-0c380099982d admin admin] RBAC: Authorizing `identity:delete_user(user_id=940a6ac249644cce9ea825d4dd4298e5)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:46.835693 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ff472-2606-48d9-8cdb-0c380099982d admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:46.884411 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-609ff472-2606-48d9-8cdb-0c380099982d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '940a6ac249644cce9ea825d4dd4298e5'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:37:46.896419 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-609ff472-2606-48d9-8cdb-0c380099982d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '940a6ac249644cce9ea825d4dd4298e5'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:37:46.903154 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-609ff472-2606-48d9-8cdb-0c380099982d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '940a6ac249644cce9ea825d4dd4298e5'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:37:46.904339 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-609ff472-2606-48d9-8cdb-0c380099982d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '940a6ac249644cce9ea825d4dd4298e5'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:37:46.904949 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-609ff472-2606-48d9-8cdb-0c380099982d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '940a6ac249644cce9ea825d4dd4298e5'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:37:46.917336 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1259/2532] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:37:46 2022] DELETE /identity/v3/users/940a6ac249644cce9ea825d4dd4298e5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:37:46.922575 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc3c45-16c5-4e0f-98da-ca061d2b8b46 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:46.923064 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc3c45-16c5-4e0f-98da-ca061d2b8b46 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:46.923163 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc3c45-16c5-4e0f-98da-ca061d2b8b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:46.940472 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-ddcc3c45-16c5-4e0f-98da-ca061d2b8b46 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:37:46.945671 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-ddcc3c45-16c5-4e0f-98da-ca061d2b8b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:46.965231 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:47.009587 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1274/2533] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:37:47.019710 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ff472-2606-48d9-8cdb-0c380099982d admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:47.021106 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-609ff472-2606-48d9-8cdb-0c380099982d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:47.078439 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ff472-2606-48d9-8cdb-0c380099982d admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:47.082157 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90188e7-4009-414e-b9ae-079181548c0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:47.082807 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90188e7-4009-414e-b9ae-079181548c0a service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:47.083092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90188e7-4009-414e-b9ae-079181548c0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:47.083450 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90188e7-4009-414e-b9ae-079181548c0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:47.093126 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90188e7-4009-414e-b9ae-079181548c0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:47.094539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90188e7-4009-414e-b9ae-079181548c0a service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:47.103872 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1260/2534] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:37:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:37:47.372305 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc3c45-16c5-4e0f-98da-ca061d2b8b46 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:47.373927 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-ddcc3c45-16c5-4e0f-98da-ca061d2b8b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:47.387572 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc3c45-16c5-4e0f-98da-ca061d2b8b46 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:47.393027 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed72aa-2005-4c48-a7c0-d607f8ec1bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:47.394820 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed72aa-2005-4c48-a7c0-d607f8ec1bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:47.395111 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed72aa-2005-4c48-a7c0-d607f8ec1bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:47.395419 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed72aa-2005-4c48-a7c0-d607f8ec1bf2 admin admin] PATH_INFO: `/v3/projects/7d1e06b95eba47fbb1acb66cdea11694` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:47.396880 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed72aa-2005-4c48-a7c0-d607f8ec1bf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d1e06b95eba47fbb1acb66cdea11694)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:47.398929 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed72aa-2005-4c48-a7c0-d607f8ec1bf2 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:47.445862 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-01ed72aa-2005-4c48-a7c0-d607f8ec1bf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d1e06b95eba47fbb1acb66cdea11694', 'request_id': 'req-01ed72aa-2005-4c48-a7c0-d607f8ec1bf2'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:37:47.452612 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-01ed72aa-2005-4c48-a7c0-d607f8ec1bf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d1e06b95eba47fbb1acb66cdea11694', 'request_id': 'req-01ed72aa-2005-4c48-a7c0-d607f8ec1bf2'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:37:47.459666 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-01ed72aa-2005-4c48-a7c0-d607f8ec1bf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d1e06b95eba47fbb1acb66cdea11694', 'request_id': 'req-01ed72aa-2005-4c48-a7c0-d607f8ec1bf2'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:37:47.469959 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-01ed72aa-2005-4c48-a7c0-d607f8ec1bf2 admin admin] The token cache is being invalidate because project 7d1e06b95eba47fbb1acb66cdea11694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:37:47.470257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-01ed72aa-2005-4c48-a7c0-d607f8ec1bf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:37:47.470891 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-01ed72aa-2005-4c48-a7c0-d607f8ec1bf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:37:47.472455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1275/2535] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:37:47 2022] DELETE /identity/v3/projects/7d1e06b95eba47fbb1acb66cdea11694 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:37:57.099736 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=65,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:57.466938 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=41,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:21.932472 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90188e7-4009-414e-b9ae-079181548c0a service neutron] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:21.934499 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-e90188e7-4009-414e-b9ae-079181548c0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:21.990386 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90188e7-4009-414e-b9ae-079181548c0a service neutron] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:22.038301 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58fd22-f938-49a7-a980-06310dac0deb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:22.038990 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58fd22-f938-49a7-a980-06310dac0deb service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:22.039311 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58fd22-f938-49a7-a980-06310dac0deb service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:22.039588 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58fd22-f938-49a7-a980-06310dac0deb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:22.041450 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-0a58fd22-f938-49a7-a980-06310dac0deb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:22.100640 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58fd22-f938-49a7-a980-06310dac0deb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:22.102083 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58fd22-f938-49a7-a980-06310dac0deb service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:22.111206 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1261/2536] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:24.781230 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed72aa-2005-4c48-a7c0-d607f8ec1bf2 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:24.782857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-01ed72aa-2005-4c48-a7c0-d607f8ec1bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:24.906120 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed72aa-2005-4c48-a7c0-d607f8ec1bf2 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:24.913638 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951a18c-93df-49a3-bef8-dfe9e6c0f688 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:24.914505 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951a18c-93df-49a3-bef8-dfe9e6c0f688 service nova] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:24.914889 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951a18c-93df-49a3-bef8-dfe9e6c0f688 service nova] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:24.915425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951a18c-93df-49a3-bef8-dfe9e6c0f688 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:24.917932 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-3951a18c-93df-49a3-bef8-dfe9e6c0f688 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:24.933213 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951a18c-93df-49a3-bef8-dfe9e6c0f688 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:24.934960 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951a18c-93df-49a3-bef8-dfe9e6c0f688 service nova] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:24.951360 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1276/2537] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:27.904200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8c8c6-2a0b-4a17-b889-da301fcc7dfd None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:27.904736 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8c8c6-2a0b-4a17-b889-da301fcc7dfd None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:27.904835 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8c8c6-2a0b-4a17-b889-da301fcc7dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:27.922638 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-70b8c8c6-2a0b-4a17-b889-da301fcc7dfd None None] MFA Rules not processed for user `7143c461c94444558d6ac9f5cddfb264`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:38:27.923859 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-70b8c8c6-2a0b-4a17-b889-da301fcc7dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:27.930809 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1262/2538] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:38:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:38:28.239793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951a18c-93df-49a3-bef8-dfe9e6c0f688 service nova] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:28.241192 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-3951a18c-93df-49a3-bef8-dfe9e6c0f688 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:28.297604 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951a18c-93df-49a3-bef8-dfe9e6c0f688 service nova] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:28.301251 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586125d2-85c9-4856-a0a2-fba8505dfd68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:28.301894 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586125d2-85c9-4856-a0a2-fba8505dfd68 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:28.302180 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586125d2-85c9-4856-a0a2-fba8505dfd68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:28.302458 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586125d2-85c9-4856-a0a2-fba8505dfd68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:28.304273 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-586125d2-85c9-4856-a0a2-fba8505dfd68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:28.314496 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586125d2-85c9-4856-a0a2-fba8505dfd68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:28.315964 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586125d2-85c9-4856-a0a2-fba8505dfd68 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:28.324266 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1277/2539] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:28.634661 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8c8c6-2a0b-4a17-b889-da301fcc7dfd None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:28.636060 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-70b8c8c6-2a0b-4a17-b889-da301fcc7dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:28.705225 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8c8c6-2a0b-4a17-b889-da301fcc7dfd None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:28.710107 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f956c-77d5-4ce1-9318-a0927dc57fe6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a27fe78683743c397fe7929e9053c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:28.710747 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f956c-77d5-4ce1-9318-a0927dc57fe6 service placement] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:28.711028 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f956c-77d5-4ce1-9318-a0927dc57fe6 service placement] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:28.711341 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f956c-77d5-4ce1-9318-a0927dc57fe6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:28.713079 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-bf5f956c-77d5-4ce1-9318-a0927dc57fe6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:28.721365 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:28.725252 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f956c-77d5-4ce1-9318-a0927dc57fe6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:28.727103 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f956c-77d5-4ce1-9318-a0927dc57fe6 service placement] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:28.740239 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1263/2540] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:38.320539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=60 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:38.736474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:39.125588 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586125d2-85c9-4856-a0a2-fba8505dfd68 service neutron] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:39.144068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586125d2-85c9-4856-a0a2-fba8505dfd68 service neutron] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:39.149978 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f36e57-edc5-4411-86e7-f8eeb4e810d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:39.150672 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f36e57-edc5-4411-86e7-f8eeb4e810d1 service nova] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:39.151551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f36e57-edc5-4411-86e7-f8eeb4e810d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:39.151840 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f36e57-edc5-4411-86e7-f8eeb4e810d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:39.153668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-a2f36e57-edc5-4411-86e7-f8eeb4e810d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:39.167271 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f36e57-edc5-4411-86e7-f8eeb4e810d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:39.168858 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f36e57-edc5-4411-86e7-f8eeb4e810d1 service nova] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:39.180149 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1278/2541] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:42.155961 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f956c-77d5-4ce1-9318-a0927dc57fe6 service placement] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:42.178577 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f956c-77d5-4ce1-9318-a0927dc57fe6 service placement] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:42.186591 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711be74-b8ca-4264-b723-2911fd2e6e4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:42.187203 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711be74-b8ca-4264-b723-2911fd2e6e4f service nova] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:42.187447 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711be74-b8ca-4264-b723-2911fd2e6e4f service nova] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:42.187732 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711be74-b8ca-4264-b723-2911fd2e6e4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:42.189586 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-7711be74-b8ca-4264-b723-2911fd2e6e4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:42.204946 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711be74-b8ca-4264-b723-2911fd2e6e4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:42.207607 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711be74-b8ca-4264-b723-2911fd2e6e4f service nova] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:42.229010 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1264/2542] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:49.176157 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=6 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:52.216769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=6 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:54.904636 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c0953-3c0a-4ba5-927b-28c283ce4c26 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:54.906334 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c0953-3c0a-4ba5-927b-28c283ce4c26 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:54.906789 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c0953-3c0a-4ba5-927b-28c283ce4c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:54.927049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-868c0953-3c0a-4ba5-927b-28c283ce4c26 None None] MFA Rules not processed for user `cea1d8409c754ec797d6c694481a3112`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:38:54.928418 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-868c0953-3c0a-4ba5-927b-28c283ce4c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:55.003745 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1279/2543] 10.222.0.44 () {58 vars in 967 bytes} [Tue Jul 19 15:38:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:38:55.068913 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711be74-b8ca-4264-b723-2911fd2e6e4f service nova] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:55.070438 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-7711be74-b8ca-4264-b723-2911fd2e6e4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:55.154046 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711be74-b8ca-4264-b723-2911fd2e6e4f service nova] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:55.158839 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d0337-5223-4201-9f7c-3d87a3315b61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1dceaddb6e414faef0e0448cdf1be8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:55.159518 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d0337-5223-4201-9f7c-3d87a3315b61 service swift] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:55.159802 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d0337-5223-4201-9f7c-3d87a3315b61 service swift] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:55.160081 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d0337-5223-4201-9f7c-3d87a3315b61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:55.170110 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d0337-5223-4201-9f7c-3d87a3315b61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:55.171724 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d0337-5223-4201-9f7c-3d87a3315b61 service swift] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:55.180514 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1265/2544] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jul 19 15:38:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:38:59.273593 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c0953-3c0a-4ba5-927b-28c283ce4c26 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:59.277576 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-868c0953-3c0a-4ba5-927b-28c283ce4c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:59.299305 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c0953-3c0a-4ba5-927b-28c283ce4c26 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:59.305136 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620a32e-a6f1-4383-9b99-7601839eec95 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a27fe78683743c397fe7929e9053c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:59.306129 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620a32e-a6f1-4383-9b99-7601839eec95 service placement] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:59.306652 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620a32e-a6f1-4383-9b99-7601839eec95 service placement] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:59.307150 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620a32e-a6f1-4383-9b99-7601839eec95 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:59.310193 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-d620a32e-a6f1-4383-9b99-7601839eec95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:59.332652 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620a32e-a6f1-4383-9b99-7601839eec95 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:59.335037 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620a32e-a6f1-4383-9b99-7601839eec95 service placement] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:59.354331 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1280/2545] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:39:00.627623 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d0337-5223-4201-9f7c-3d87a3315b61 service swift] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:00.629333 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-a95d0337-5223-4201-9f7c-3d87a3315b61 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:00.641999 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d0337-5223-4201-9f7c-3d87a3315b61 service swift] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:00.645669 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed190e-62cc-45c1-8b23-74f3bd142c95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:00.646319 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed190e-62cc-45c1-8b23-74f3bd142c95 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:00.646603 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed190e-62cc-45c1-8b23-74f3bd142c95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:00.646888 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed190e-62cc-45c1-8b23-74f3bd142c95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:00.648716 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-2aed190e-62cc-45c1-8b23-74f3bd142c95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:00.712912 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed190e-62cc-45c1-8b23-74f3bd142c95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:00.714353 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed190e-62cc-45c1-8b23-74f3bd142c95 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:00.724329 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1266/2546] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:39:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:39:02.896465 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620a32e-a6f1-4383-9b99-7601839eec95 service placement] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:02.897975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-d620a32e-a6f1-4383-9b99-7601839eec95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:02.916060 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620a32e-a6f1-4383-9b99-7601839eec95 service placement] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:02.924760 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753e1c3-3fb0-4ea5-a8d5-30d17f751c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:02.926021 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753e1c3-3fb0-4ea5-a8d5-30d17f751c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:02.926480 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753e1c3-3fb0-4ea5-a8d5-30d17f751c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:02.926961 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753e1c3-3fb0-4ea5-a8d5-30d17f751c85 admin admin] PATH_INFO: `/v3/users/9d30a94851c840f08670c9548c2e2311` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:02.928571 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7753e1c3-3fb0-4ea5-a8d5-30d17f751c85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d30a94851c840f08670c9548c2e2311)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:02.930919 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7753e1c3-3fb0-4ea5-a8d5-30d17f751c85 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:02.990973 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-7753e1c3-3fb0-4ea5-a8d5-30d17f751c85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d30a94851c840f08670c9548c2e2311'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:39:03.008933 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-7753e1c3-3fb0-4ea5-a8d5-30d17f751c85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d30a94851c840f08670c9548c2e2311'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:39:03.018176 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-7753e1c3-3fb0-4ea5-a8d5-30d17f751c85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d30a94851c840f08670c9548c2e2311'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:39:03.019627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-7753e1c3-3fb0-4ea5-a8d5-30d17f751c85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d30a94851c840f08670c9548c2e2311'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:39:03.020399 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-7753e1c3-3fb0-4ea5-a8d5-30d17f751c85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d30a94851c840f08670c9548c2e2311'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:39:03.037064 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1281/2547] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:39:02 2022] DELETE /identity/v3/users/9d30a94851c840f08670c9548c2e2311 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:39:03.236572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed190e-62cc-45c1-8b23-74f3bd142c95 service neutron] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:03.254896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed190e-62cc-45c1-8b23-74f3bd142c95 service neutron] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:03.341781 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44919ec7-0acd-439f-a70a-ba501c272534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:03.344032 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44919ec7-0acd-439f-a70a-ba501c272534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:03.344032 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44919ec7-0acd-439f-a70a-ba501c272534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:03.344032 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44919ec7-0acd-439f-a70a-ba501c272534 admin admin] PATH_INFO: `/v3/projects/c42bd9218985478c94fc866b0b171e77` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:03.348503 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44919ec7-0acd-439f-a70a-ba501c272534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c42bd9218985478c94fc866b0b171e77)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:03.350495 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44919ec7-0acd-439f-a70a-ba501c272534 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:03.389205 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:03.409174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-44919ec7-0acd-439f-a70a-ba501c272534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c42bd9218985478c94fc866b0b171e77', 'request_id': 'req-44919ec7-0acd-439f-a70a-ba501c272534'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:39:03.415688 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-44919ec7-0acd-439f-a70a-ba501c272534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c42bd9218985478c94fc866b0b171e77', 'request_id': 'req-44919ec7-0acd-439f-a70a-ba501c272534'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:39:03.425621 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-44919ec7-0acd-439f-a70a-ba501c272534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c42bd9218985478c94fc866b0b171e77', 'request_id': 'req-44919ec7-0acd-439f-a70a-ba501c272534'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:39:03.441396 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-44919ec7-0acd-439f-a70a-ba501c272534 admin admin] The token cache is being invalidate because project c42bd9218985478c94fc866b0b171e77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:39:03.441719 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-44919ec7-0acd-439f-a70a-ba501c272534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:39:03.442552 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-44919ec7-0acd-439f-a70a-ba501c272534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:39:03.444095 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1267/2548] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:39:03 2022] DELETE /identity/v3/projects/c42bd9218985478c94fc866b0b171e77 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:39:03.449012 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753e1c3-3fb0-4ea5-a8d5-30d17f751c85 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:03.450518 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-7753e1c3-3fb0-4ea5-a8d5-30d17f751c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:03.464564 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753e1c3-3fb0-4ea5-a8d5-30d17f751c85 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:03.536888 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693b223-e217-40e2-8ff5-522324a9a0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:03.539533 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693b223-e217-40e2-8ff5-522324a9a0f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:03.539807 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693b223-e217-40e2-8ff5-522324a9a0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:03.540614 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693b223-e217-40e2-8ff5-522324a9a0f4 admin admin] PATH_INFO: `/v3/users/38ab771ffab449c0af79f6fb4af63e91` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:03.541886 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6693b223-e217-40e2-8ff5-522324a9a0f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38ab771ffab449c0af79f6fb4af63e91)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:03.544472 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6693b223-e217-40e2-8ff5-522324a9a0f4 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:03.549595 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:03.604740 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-6693b223-e217-40e2-8ff5-522324a9a0f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38ab771ffab449c0af79f6fb4af63e91'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:39:03.616948 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-6693b223-e217-40e2-8ff5-522324a9a0f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38ab771ffab449c0af79f6fb4af63e91'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:39:03.624742 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-6693b223-e217-40e2-8ff5-522324a9a0f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38ab771ffab449c0af79f6fb4af63e91'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:39:03.625517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-6693b223-e217-40e2-8ff5-522324a9a0f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38ab771ffab449c0af79f6fb4af63e91'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:39:03.626095 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-6693b223-e217-40e2-8ff5-522324a9a0f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38ab771ffab449c0af79f6fb4af63e91'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:39:03.640875 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1282/2549] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:39:03 2022] DELETE /identity/v3/users/38ab771ffab449c0af79f6fb4af63e91 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:39:03.841191 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44919ec7-0acd-439f-a70a-ba501c272534 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:03.843784 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-44919ec7-0acd-439f-a70a-ba501c272534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:03.864240 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44919ec7-0acd-439f-a70a-ba501c272534 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:03.941288 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91931a4b-d3e9-4b5c-8bc8-4c9dfdd55d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:03.942335 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91931a4b-d3e9-4b5c-8bc8-4c9dfdd55d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:03.943785 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91931a4b-d3e9-4b5c-8bc8-4c9dfdd55d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:03.943964 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91931a4b-d3e9-4b5c-8bc8-4c9dfdd55d52 admin admin] PATH_INFO: `/v3/projects/4ab0d9268178482e80cf1d2dc3ff9410` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:03.946908 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91931a4b-d3e9-4b5c-8bc8-4c9dfdd55d52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ab0d9268178482e80cf1d2dc3ff9410)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:03.949538 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91931a4b-d3e9-4b5c-8bc8-4c9dfdd55d52 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:04.013407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-91931a4b-d3e9-4b5c-8bc8-4c9dfdd55d52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ab0d9268178482e80cf1d2dc3ff9410', 'request_id': 'req-91931a4b-d3e9-4b5c-8bc8-4c9dfdd55d52'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:39:04.020546 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-91931a4b-d3e9-4b5c-8bc8-4c9dfdd55d52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ab0d9268178482e80cf1d2dc3ff9410', 'request_id': 'req-91931a4b-d3e9-4b5c-8bc8-4c9dfdd55d52'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:39:04.030683 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-91931a4b-d3e9-4b5c-8bc8-4c9dfdd55d52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ab0d9268178482e80cf1d2dc3ff9410', 'request_id': 'req-91931a4b-d3e9-4b5c-8bc8-4c9dfdd55d52'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:39:04.042102 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-91931a4b-d3e9-4b5c-8bc8-4c9dfdd55d52 admin admin] The token cache is being invalidate because project 4ab0d9268178482e80cf1d2dc3ff9410 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:39:04.042466 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-91931a4b-d3e9-4b5c-8bc8-4c9dfdd55d52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:39:04.043159 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-91931a4b-d3e9-4b5c-8bc8-4c9dfdd55d52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:39:04.044752 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1268/2550] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:39:03 2022] DELETE /identity/v3/projects/4ab0d9268178482e80cf1d2dc3ff9410 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:39:04.473282 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693b223-e217-40e2-8ff5-522324a9a0f4 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:04.475501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-6693b223-e217-40e2-8ff5-522324a9a0f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:04.504562 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693b223-e217-40e2-8ff5-522324a9a0f4 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:04.576601 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0683b9b-a0a8-47fb-b26c-d097ce8edd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:04.577506 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0683b9b-a0a8-47fb-b26c-d097ce8edd64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:04.577790 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0683b9b-a0a8-47fb-b26c-d097ce8edd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:04.578067 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0683b9b-a0a8-47fb-b26c-d097ce8edd64 admin admin] PATH_INFO: `/v3/users/dcd12611b7d144e28fa1358f927c9f2d` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:04.579287 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0683b9b-a0a8-47fb-b26c-d097ce8edd64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd12611b7d144e28fa1358f927c9f2d)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:04.581192 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0683b9b-a0a8-47fb-b26c-d097ce8edd64 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:04.635310 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-a0683b9b-a0a8-47fb-b26c-d097ce8edd64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd12611b7d144e28fa1358f927c9f2d'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:39:04.648959 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-a0683b9b-a0a8-47fb-b26c-d097ce8edd64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd12611b7d144e28fa1358f927c9f2d'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:39:04.656619 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-a0683b9b-a0a8-47fb-b26c-d097ce8edd64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd12611b7d144e28fa1358f927c9f2d'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:39:04.657445 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-a0683b9b-a0a8-47fb-b26c-d097ce8edd64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd12611b7d144e28fa1358f927c9f2d'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:39:04.658071 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-a0683b9b-a0a8-47fb-b26c-d097ce8edd64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd12611b7d144e28fa1358f927c9f2d'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:39:04.672642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1283/2551] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:39:04 2022] DELETE /identity/v3/users/dcd12611b7d144e28fa1358f927c9f2d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:39:04.849518 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91931a4b-d3e9-4b5c-8bc8-4c9dfdd55d52 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:04.855232 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-91931a4b-d3e9-4b5c-8bc8-4c9dfdd55d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:04.866366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91931a4b-d3e9-4b5c-8bc8-4c9dfdd55d52 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:04.914891 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:04.932744 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027248d7-6e18-4813-9b60-9e6b163b94cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:04.933679 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027248d7-6e18-4813-9b60-9e6b163b94cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:04.933962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027248d7-6e18-4813-9b60-9e6b163b94cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:04.934239 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027248d7-6e18-4813-9b60-9e6b163b94cb admin admin] PATH_INFO: `/v3/projects/9c6b93bc4d064d2cb0d74da656abffe1` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:04.935505 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027248d7-6e18-4813-9b60-9e6b163b94cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c6b93bc4d064d2cb0d74da656abffe1)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:04.937461 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027248d7-6e18-4813-9b60-9e6b163b94cb admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:04.986445 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-027248d7-6e18-4813-9b60-9e6b163b94cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c6b93bc4d064d2cb0d74da656abffe1', 'request_id': 'req-027248d7-6e18-4813-9b60-9e6b163b94cb'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:39:04.992619 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-027248d7-6e18-4813-9b60-9e6b163b94cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c6b93bc4d064d2cb0d74da656abffe1', 'request_id': 'req-027248d7-6e18-4813-9b60-9e6b163b94cb'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:39:05.000737 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-027248d7-6e18-4813-9b60-9e6b163b94cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c6b93bc4d064d2cb0d74da656abffe1', 'request_id': 'req-027248d7-6e18-4813-9b60-9e6b163b94cb'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:39:05.011989 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-027248d7-6e18-4813-9b60-9e6b163b94cb admin admin] The token cache is being invalidate because project 9c6b93bc4d064d2cb0d74da656abffe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:39:05.012274 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-027248d7-6e18-4813-9b60-9e6b163b94cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:39:05.012918 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-027248d7-6e18-4813-9b60-9e6b163b94cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:39:05.014461 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1269/2552] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:39:04 2022] DELETE /identity/v3/projects/9c6b93bc4d064d2cb0d74da656abffe1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:39:05.019752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b3d23-aabc-4304-a287-a6e19430d4cb None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:05.020048 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b3d23-aabc-4304-a287-a6e19430d4cb None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:05.020360 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b3d23-aabc-4304-a287-a6e19430d4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:05.026723 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:05.041449 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-593b3d23-aabc-4304-a287-a6e19430d4cb None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:39:05.042656 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-593b3d23-aabc-4304-a287-a6e19430d4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:05.101164 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1284/2553] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:39:05.109480 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d9db4-6b67-457c-b59b-dd5e4b386369 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:05.109773 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d9db4-6b67-457c-b59b-dd5e4b386369 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:05.110058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d9db4-6b67-457c-b59b-dd5e4b386369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:05.128827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-a52d9db4-6b67-457c-b59b-dd5e4b386369 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:39:05.130063 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-a52d9db4-6b67-457c-b59b-dd5e4b386369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:05.137979 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1270/2554] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:39:05.142471 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b3d23-aabc-4304-a287-a6e19430d4cb None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:05.152142 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b3d23-aabc-4304-a287-a6e19430d4cb None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:05.156719 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56f50a-c721-4744-a534-742e8421b2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:05.157380 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56f50a-c721-4744-a534-742e8421b2eb admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:05.157666 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56f50a-c721-4744-a534-742e8421b2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:05.157946 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56f50a-c721-4744-a534-742e8421b2eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:05.158677 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56f50a-c721-4744-a534-742e8421b2eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:39:05.158992 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56f50a-c721-4744-a534-742e8421b2eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:05.160660 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56f50a-c721-4744-a534-742e8421b2eb admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:05.173475 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1285/2555] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:39:05.177754 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d9db4-6b67-457c-b59b-dd5e4b386369 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:05.187972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d9db4-6b67-457c-b59b-dd5e4b386369 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:05.192651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e21ce-bb81-4bd3-afb0-591930b2fd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:05.193296 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e21ce-bb81-4bd3-afb0-591930b2fd5a admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:05.193577 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e21ce-bb81-4bd3-afb0-591930b2fd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:05.193853 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e21ce-bb81-4bd3-afb0-591930b2fd5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:05.194543 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e21ce-bb81-4bd3-afb0-591930b2fd5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:05.196810 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e21ce-bb81-4bd3-afb0-591930b2fd5a admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:05.222557 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1271/2556] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:39:05 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:39:05.227023 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56f50a-c721-4744-a534-742e8421b2eb admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:05.237583 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56f50a-c721-4744-a534-742e8421b2eb admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:05.292953 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ecfba8-917f-4433-a128-ae056606c150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:05.293650 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ecfba8-917f-4433-a128-ae056606c150 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:05.293966 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ecfba8-917f-4433-a128-ae056606c150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:05.294251 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ecfba8-917f-4433-a128-ae056606c150 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:05.294942 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ecfba8-917f-4433-a128-ae056606c150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:05.296899 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ecfba8-917f-4433-a128-ae056606c150 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:05.317072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1286/2557] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:39:05 2022] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:39:05.321369 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e21ce-bb81-4bd3-afb0-591930b2fd5a admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:05.331705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e21ce-bb81-4bd3-afb0-591930b2fd5a admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:05.336246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382201e-5249-44d9-abfa-7c9d47d4b87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:05.336955 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382201e-5249-44d9-abfa-7c9d47d4b87b admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:05.337241 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382201e-5249-44d9-abfa-7c9d47d4b87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:05.337524 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382201e-5249-44d9-abfa-7c9d47d4b87b admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:05.338246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382201e-5249-44d9-abfa-7c9d47d4b87b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:05.339874 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382201e-5249-44d9-abfa-7c9d47d4b87b admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:05.350513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1272/2558] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:39:05.355395 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ecfba8-917f-4433-a128-ae056606c150 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:05.365790 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ecfba8-917f-4433-a128-ae056606c150 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:05.371019 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611dadfb-9df0-4be8-b8f8-825f8e5220b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:05.371708 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dadfb-9df0-4be8-b8f8-825f8e5220b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:05.371996 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dadfb-9df0-4be8-b8f8-825f8e5220b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:05.372276 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dadfb-9df0-4be8-b8f8-825f8e5220b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:05.373007 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611dadfb-9df0-4be8-b8f8-825f8e5220b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:05.374592 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611dadfb-9df0-4be8-b8f8-825f8e5220b1 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:05.384625 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1287/2559] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:39:05.388735 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382201e-5249-44d9-abfa-7c9d47d4b87b admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:05.399128 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382201e-5249-44d9-abfa-7c9d47d4b87b admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:05.404359 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36590bcc-5dd8-4402-beae-d4be379f2334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:05.405335 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36590bcc-5dd8-4402-beae-d4be379f2334 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:05.405623 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36590bcc-5dd8-4402-beae-d4be379f2334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:05.405902 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36590bcc-5dd8-4402-beae-d4be379f2334 admin admin] PATH_INFO: `/v3/projects/07c2df2ef71a4fe6a37b01cb4d6396a3/users/1672e1eef6bd4caaad2834206a62265b/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:05.422873 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36590bcc-5dd8-4402-beae-d4be379f2334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07c2df2ef71a4fe6a37b01cb4d6396a3, user_id=1672e1eef6bd4caaad2834206a62265b, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:05.425320 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36590bcc-5dd8-4402-beae-d4be379f2334 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:05.437978 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1273/2560] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:39:05 2022] PUT /identity/v3/projects/07c2df2ef71a4fe6a37b01cb4d6396a3/users/1672e1eef6bd4caaad2834206a62265b/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:39:05.443144 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5689e-e7fd-40d1-b270-36a3ec39a0b7 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:05.443549 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5689e-e7fd-40d1-b270-36a3ec39a0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:05.443913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5689e-e7fd-40d1-b270-36a3ec39a0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:05.461597 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-05d5689e-e7fd-40d1-b270-36a3ec39a0b7 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:39:05.463363 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-05d5689e-e7fd-40d1-b270-36a3ec39a0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:05.522615 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1288/2561] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:39:05.535832 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36590bcc-5dd8-4402-beae-d4be379f2334 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:05.537550 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-36590bcc-5dd8-4402-beae-d4be379f2334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:05.595868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36590bcc-5dd8-4402-beae-d4be379f2334 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:05.600622 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061912de-b728-4bd6-9a08-fb085dfe8b5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:05.601282 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061912de-b728-4bd6-9a08-fb085dfe8b5a service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:05.601574 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061912de-b728-4bd6-9a08-fb085dfe8b5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:05.601854 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061912de-b728-4bd6-9a08-fb085dfe8b5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:05.612304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061912de-b728-4bd6-9a08-fb085dfe8b5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:05.613767 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061912de-b728-4bd6-9a08-fb085dfe8b5a service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:05.623350 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1274/2562] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:39:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:39:09.798625 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbeb03-ca05-4ffc-98df-3bdc7e1fe0f2 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:09.799262 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbeb03-ca05-4ffc-98df-3bdc7e1fe0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:09.799679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbeb03-ca05-4ffc-98df-3bdc7e1fe0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:09.832105 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:09.849139 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-d2bbeb03-ca05-4ffc-98df-3bdc7e1fe0f2 None None] MFA Rules not processed for user `1672e1eef6bd4caaad2834206a62265b`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:39:09.856067 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-d2bbeb03-ca05-4ffc-98df-3bdc7e1fe0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:09.939557 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1289/2563] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:39:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:39:09.956805 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061912de-b728-4bd6-9a08-fb085dfe8b5a service neutron] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:09.958462 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-061912de-b728-4bd6-9a08-fb085dfe8b5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:09.976757 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:10.058739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061912de-b728-4bd6-9a08-fb085dfe8b5a service neutron] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:10.074012 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bda9e-0d4f-4759-acb5-94a5789e6bd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:10.075126 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bda9e-0d4f-4759-acb5-94a5789e6bd6 service nova] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:10.075126 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bda9e-0d4f-4759-acb5-94a5789e6bd6 service nova] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:10.075570 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bda9e-0d4f-4759-acb5-94a5789e6bd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:10.090070 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441bda9e-0d4f-4759-acb5-94a5789e6bd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:10.091856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441bda9e-0d4f-4759-acb5-94a5789e6bd6 service nova] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:10.102039 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1275/2564] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:39:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:39:11.513690 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80236294-5987-4909-9c1e-e6989752189e None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:11.514213 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80236294-5987-4909-9c1e-e6989752189e None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:11.514329 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80236294-5987-4909-9c1e-e6989752189e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:11.533352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-80236294-5987-4909-9c1e-e6989752189e None None] MFA Rules not processed for user `1672e1eef6bd4caaad2834206a62265b`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:39:11.534565 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-80236294-5987-4909-9c1e-e6989752189e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:11.542103 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1290/2565] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:39:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:39:11.862320 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bda9e-0d4f-4759-acb5-94a5789e6bd6 service nova] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:11.863979 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-441bda9e-0d4f-4759-acb5-94a5789e6bd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:11.877724 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bda9e-0d4f-4759-acb5-94a5789e6bd6 service nova] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:11.881427 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711f547-5917-43cc-9a7b-d144b8f752d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:11.882085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711f547-5917-43cc-9a7b-d144b8f752d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:11.882376 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711f547-5917-43cc-9a7b-d144b8f752d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:11.882661 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711f547-5917-43cc-9a7b-d144b8f752d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:11.885727 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-e711f547-5917-43cc-9a7b-d144b8f752d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:11.896718 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711f547-5917-43cc-9a7b-d144b8f752d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:11.898145 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711f547-5917-43cc-9a7b-d144b8f752d6 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:11.917201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1276/2566] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:39:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:39:21.526975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=31 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:21.903183 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=34 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:37.508922 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef0551-975f-496f-b068-31ab6eaf3488 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:37.509579 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef0551-975f-496f-b068-31ab6eaf3488 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:37.509579 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef0551-975f-496f-b068-31ab6eaf3488 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:37.510907 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1291/2567] 10.222.0.44 () {54 vars in 921 bytes} [Tue Jul 19 15:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:39:37.517622 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af2045-7af2-41f7-87a0-fe4e19c0bdb4 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:37.518173 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af2045-7af2-41f7-87a0-fe4e19c0bdb4 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:37.518173 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af2045-7af2-41f7-87a0-fe4e19c0bdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:37.536360 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-21af2045-7af2-41f7-87a0-fe4e19c0bdb4 None None] MFA Rules not processed for user `c89e7fbcc22c478c98d74b802f4bf8f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:39:37.537589 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-21af2045-7af2-41f7-87a0-fe4e19c0bdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:37.544930 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1277/2568] 10.222.0.44 () {58 vars in 1018 bytes} [Tue Jul 19 15:39:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:39:37.557943 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef0551-975f-496f-b068-31ab6eaf3488 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:37.570644 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef0551-975f-496f-b068-31ab6eaf3488 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:37.574368 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa66e9-82a0-4972-868d-fb7e92cfbcf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:37.575007 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa66e9-82a0-4972-868d-fb7e92cfbcf9 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:37.575315 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa66e9-82a0-4972-868d-fb7e92cfbcf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:37.575606 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa66e9-82a0-4972-868d-fb7e92cfbcf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:37.583359 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa66e9-82a0-4972-868d-fb7e92cfbcf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:37.584777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa66e9-82a0-4972-868d-fb7e92cfbcf9 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:37.593166 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1292/2569] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:39:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:39:37.688146 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81ac60-03f5-4d0c-96bf-7598c92ae813 None None] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:37.688536 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81ac60-03f5-4d0c-96bf-7598c92ae813 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:37.688894 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81ac60-03f5-4d0c-96bf-7598c92ae813 None None] PATH_INFO: `/` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:37.690337 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1278/2570] 10.222.0.44 () {54 vars in 921 bytes} [Tue Jul 19 15:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:39:37.696232 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b35dd-df78-43ab-a68d-ef1235d94db6 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:37.696519 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b35dd-df78-43ab-a68d-ef1235d94db6 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:37.696795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b35dd-df78-43ab-a68d-ef1235d94db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:37.714768 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-d25b35dd-df78-43ab-a68d-ef1235d94db6 None None] MFA Rules not processed for user `fef0511f56144ca9945b2dddfa2601a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:39:37.715990 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-d25b35dd-df78-43ab-a68d-ef1235d94db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:37.725773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1293/2571] 10.222.0.44 () {58 vars in 1018 bytes} [Tue Jul 19 15:39:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:39:37.737232 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81ac60-03f5-4d0c-96bf-7598c92ae813 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:37.748410 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81ac60-03f5-4d0c-96bf-7598c92ae813 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:37.752613 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6fe1f-240d-4bab-8d44-2c16dc074cee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:37.752757 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6fe1f-240d-4bab-8d44-2c16dc074cee service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:37.753045 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6fe1f-240d-4bab-8d44-2c16dc074cee service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:37.753326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6fe1f-240d-4bab-8d44-2c16dc074cee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:37.763861 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b6fe1f-240d-4bab-8d44-2c16dc074cee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:37.765576 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b6fe1f-240d-4bab-8d44-2c16dc074cee service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:37.776755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1279/2572] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:39:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:39:47.709341 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=9 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:47.771655 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=9 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:40:20.989047 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b35dd-df78-43ab-a68d-ef1235d94db6 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:40:21.008670 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b35dd-df78-43ab-a68d-ef1235d94db6 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:40:21.012302 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd847493-9dce-4b0f-8f0e-b1cebf0fd102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:40:21.012953 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd847493-9dce-4b0f-8f0e-b1cebf0fd102 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:40:21.013240 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd847493-9dce-4b0f-8f0e-b1cebf0fd102 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:40:21.013518 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd847493-9dce-4b0f-8f0e-b1cebf0fd102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:40:21.015577 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-dd847493-9dce-4b0f-8f0e-b1cebf0fd102 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:40:21.077981 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd847493-9dce-4b0f-8f0e-b1cebf0fd102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:40:21.079447 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd847493-9dce-4b0f-8f0e-b1cebf0fd102 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:40:21.099032 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1294/2573] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:40:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:40:24.213682 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6fe1f-240d-4bab-8d44-2c16dc074cee service neutron] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:40:24.215172 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-93b6fe1f-240d-4bab-8d44-2c16dc074cee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:40:24.259260 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6fe1f-240d-4bab-8d44-2c16dc074cee service neutron] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:40:24.264698 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5637e-282c-4fb3-ae9d-5d76596b79ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:40:24.265674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5637e-282c-4fb3-ae9d-5d76596b79ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:40:24.265967 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5637e-282c-4fb3-ae9d-5d76596b79ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:40:24.266248 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5637e-282c-4fb3-ae9d-5d76596b79ba admin admin] PATH_INFO: `/v3/users/7143c461c94444558d6ac9f5cddfb264` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:40:24.267547 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5637e-282c-4fb3-ae9d-5d76596b79ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=7143c461c94444558d6ac9f5cddfb264)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:40:24.269503 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5637e-282c-4fb3-ae9d-5d76596b79ba admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:40:24.320344 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-1ec5637e-282c-4fb3-ae9d-5d76596b79ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7143c461c94444558d6ac9f5cddfb264'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:40:24.338933 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-1ec5637e-282c-4fb3-ae9d-5d76596b79ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7143c461c94444558d6ac9f5cddfb264'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:40:24.345711 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-1ec5637e-282c-4fb3-ae9d-5d76596b79ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7143c461c94444558d6ac9f5cddfb264'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:40:24.346448 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-1ec5637e-282c-4fb3-ae9d-5d76596b79ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7143c461c94444558d6ac9f5cddfb264'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:40:24.347059 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-1ec5637e-282c-4fb3-ae9d-5d76596b79ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7143c461c94444558d6ac9f5cddfb264'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:40:24.360319 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1280/2574] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:40:24 2022] DELETE /identity/v3/users/7143c461c94444558d6ac9f5cddfb264 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:40:24.548201 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd847493-9dce-4b0f-8f0e-b1cebf0fd102 service neutron] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:40:24.559797 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd847493-9dce-4b0f-8f0e-b1cebf0fd102 service neutron] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:40:24.619695 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fef17-72d1-426c-b1af-bce7ddcce205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:40:24.620494 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fef17-72d1-426c-b1af-bce7ddcce205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:40:24.620783 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fef17-72d1-426c-b1af-bce7ddcce205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:40:24.621066 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fef17-72d1-426c-b1af-bce7ddcce205 admin admin] PATH_INFO: `/v3/projects/32c8e69e0fea46958a7eeb79b91f740a` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:40:24.622255 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fef17-72d1-426c-b1af-bce7ddcce205 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32c8e69e0fea46958a7eeb79b91f740a)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:40:24.624226 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fef17-72d1-426c-b1af-bce7ddcce205 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:40:24.670809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-b41fef17-72d1-426c-b1af-bce7ddcce205 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32c8e69e0fea46958a7eeb79b91f740a', 'request_id': 'req-b41fef17-72d1-426c-b1af-bce7ddcce205'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:40:24.676944 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-b41fef17-72d1-426c-b1af-bce7ddcce205 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32c8e69e0fea46958a7eeb79b91f740a', 'request_id': 'req-b41fef17-72d1-426c-b1af-bce7ddcce205'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:40:24.683723 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-b41fef17-72d1-426c-b1af-bce7ddcce205 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32c8e69e0fea46958a7eeb79b91f740a', 'request_id': 'req-b41fef17-72d1-426c-b1af-bce7ddcce205'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:40:24.694180 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-b41fef17-72d1-426c-b1af-bce7ddcce205 admin admin] The token cache is being invalidate because project 32c8e69e0fea46958a7eeb79b91f740a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:40:24.694471 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-b41fef17-72d1-426c-b1af-bce7ddcce205 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:40:24.695724 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-b41fef17-72d1-426c-b1af-bce7ddcce205 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:40:24.697269 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1295/2575] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:40:24 2022] DELETE /identity/v3/projects/32c8e69e0fea46958a7eeb79b91f740a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:40:24.702236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02323136-17f4-4935-92eb-5bc80fd3b105 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:40:24.702534 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02323136-17f4-4935-92eb-5bc80fd3b105 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:40:24.702815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02323136-17f4-4935-92eb-5bc80fd3b105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:40:24.758610 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-02323136-17f4-4935-92eb-5bc80fd3b105 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:40:24.759782 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-02323136-17f4-4935-92eb-5bc80fd3b105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:40:24.818001 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1281/2576] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:40:24.826810 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1f88b-2af6-4447-838e-7e22ac9d00b1 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:40:24.827104 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1f88b-2af6-4447-838e-7e22ac9d00b1 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:40:24.827408 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1f88b-2af6-4447-838e-7e22ac9d00b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:40:24.846199 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-abf1f88b-2af6-4447-838e-7e22ac9d00b1 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:40:24.847414 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-abf1f88b-2af6-4447-838e-7e22ac9d00b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:40:24.855357 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1296/2577] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:40:24.859594 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02323136-17f4-4935-92eb-5bc80fd3b105 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:40:24.869783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02323136-17f4-4935-92eb-5bc80fd3b105 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:40:24.874435 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba844e9-4956-41db-a44b-03c96ce5a799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:40:24.875090 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba844e9-4956-41db-a44b-03c96ce5a799 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:40:24.875402 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba844e9-4956-41db-a44b-03c96ce5a799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:40:24.875682 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba844e9-4956-41db-a44b-03c96ce5a799 admin admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:40:24.876579 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba844e9-4956-41db-a44b-03c96ce5a799 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:40:24.876887 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba844e9-4956-41db-a44b-03c96ce5a799 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:40:24.878479 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba844e9-4956-41db-a44b-03c96ce5a799 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:40:24.890940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1282/2578] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:40:24.895335 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1f88b-2af6-4447-838e-7e22ac9d00b1 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:40:24.899871 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:40:24.906248 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1f88b-2af6-4447-838e-7e22ac9d00b1 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:40:24.912097 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd7a59-37e3-447a-b339-6642dcc1f4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:40:24.912759 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd7a59-37e3-447a-b339-6642dcc1f4dc admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:40:24.913049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd7a59-37e3-447a-b339-6642dcc1f4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:40:24.913331 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd7a59-37e3-447a-b339-6642dcc1f4dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:40:24.914046 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd7a59-37e3-447a-b339-6642dcc1f4dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:40:24.915990 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd7a59-37e3-447a-b339-6642dcc1f4dc admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:40:24.941565 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1297/2579] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:40:24 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:40:24.946743 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba844e9-4956-41db-a44b-03c96ce5a799 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:40:24.953359 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:40:24.957263 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba844e9-4956-41db-a44b-03c96ce5a799 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:40:25.013859 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0790c-c499-4eac-9d0b-71d8d21715ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:40:25.014712 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0790c-c499-4eac-9d0b-71d8d21715ef admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:40:25.014996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0790c-c499-4eac-9d0b-71d8d21715ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:40:25.015299 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0790c-c499-4eac-9d0b-71d8d21715ef admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:40:25.016005 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b0790c-c499-4eac-9d0b-71d8d21715ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:40:25.017937 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b0790c-c499-4eac-9d0b-71d8d21715ef admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:40:25.044626 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1283/2580] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:40:24 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:40:25.048929 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd7a59-37e3-447a-b339-6642dcc1f4dc admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:40:25.059800 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd7a59-37e3-447a-b339-6642dcc1f4dc admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:40:25.064826 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb6dd2-be37-471e-b5d0-de5df8d2c057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:40:25.065488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb6dd2-be37-471e-b5d0-de5df8d2c057 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:40:25.065775 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb6dd2-be37-471e-b5d0-de5df8d2c057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:40:25.066052 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb6dd2-be37-471e-b5d0-de5df8d2c057 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:40:25.066782 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb6dd2-be37-471e-b5d0-de5df8d2c057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:40:25.068389 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb6dd2-be37-471e-b5d0-de5df8d2c057 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:40:25.079365 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1298/2581] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:40:25.083596 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0790c-c499-4eac-9d0b-71d8d21715ef admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:40:25.094388 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0790c-c499-4eac-9d0b-71d8d21715ef admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:40:25.099059 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35feb611-d3c0-4336-a507-f707430f870c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:40:25.099746 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35feb611-d3c0-4336-a507-f707430f870c admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:40:25.100060 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35feb611-d3c0-4336-a507-f707430f870c admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:40:25.100347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35feb611-d3c0-4336-a507-f707430f870c admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:40:25.101061 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35feb611-d3c0-4336-a507-f707430f870c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:40:25.102638 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35feb611-d3c0-4336-a507-f707430f870c admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:40:25.112540 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1284/2582] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:40:25.117261 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb6dd2-be37-471e-b5d0-de5df8d2c057 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:40:25.127021 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb6dd2-be37-471e-b5d0-de5df8d2c057 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:40:25.135740 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f69329-9ea3-4f9b-b9ac-53bf80cdced8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:40:25.137000 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f69329-9ea3-4f9b-b9ac-53bf80cdced8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:40:25.137428 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f69329-9ea3-4f9b-b9ac-53bf80cdced8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:40:25.137624 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f69329-9ea3-4f9b-b9ac-53bf80cdced8 admin admin] PATH_INFO: `/v3/projects/0ed941ae19dc4183af535500c26cfee4/users/7f462366c9564bb6ac7d01b820d64d37/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:40:25.152460 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f69329-9ea3-4f9b-b9ac-53bf80cdced8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ed941ae19dc4183af535500c26cfee4, user_id=7f462366c9564bb6ac7d01b820d64d37, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:40:25.155135 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f69329-9ea3-4f9b-b9ac-53bf80cdced8 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:40:25.168583 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1299/2583] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:40:25 2022] PUT /identity/v3/projects/0ed941ae19dc4183af535500c26cfee4/users/7f462366c9564bb6ac7d01b820d64d37/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:40:25.173872 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b045af3-faa6-40d3-aa6c-109902f0ddb8 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:40:25.174166 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b045af3-faa6-40d3-aa6c-109902f0ddb8 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:40:25.174445 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b045af3-faa6-40d3-aa6c-109902f0ddb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:40:25.192499 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-5b045af3-faa6-40d3-aa6c-109902f0ddb8 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:40:25.193711 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-5b045af3-faa6-40d3-aa6c-109902f0ddb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:40:25.252407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1285/2584] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:40:25.262047 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f69329-9ea3-4f9b-b9ac-53bf80cdced8 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:40:25.263788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-20f69329-9ea3-4f9b-b9ac-53bf80cdced8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:40:25.351938 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f69329-9ea3-4f9b-b9ac-53bf80cdced8 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:40:25.355682 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6137c47-54ac-4b16-a832-889a7806c4be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:40:25.356333 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6137c47-54ac-4b16-a832-889a7806c4be service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:40:25.356624 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6137c47-54ac-4b16-a832-889a7806c4be service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:40:25.356906 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6137c47-54ac-4b16-a832-889a7806c4be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:40:25.366055 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6137c47-54ac-4b16-a832-889a7806c4be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:40:25.368225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6137c47-54ac-4b16-a832-889a7806c4be service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:40:25.377985 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1300/2585] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:40:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:40:29.146919 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8984b-9c9b-4761-a488-f6cb6fafac65 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:40:29.147513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8984b-9c9b-4761-a488-f6cb6fafac65 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:40:29.147513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8984b-9c9b-4761-a488-f6cb6fafac65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:40:29.177981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-15d8984b-9c9b-4761-a488-f6cb6fafac65 None None] MFA Rules not processed for user `7f462366c9564bb6ac7d01b820d64d37`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:40:29.179247 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-15d8984b-9c9b-4761-a488-f6cb6fafac65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:40:29.250352 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1286/2586] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:40:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:40:29.265528 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6137c47-54ac-4b16-a832-889a7806c4be service neutron] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:40:29.266993 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-d6137c47-54ac-4b16-a832-889a7806c4be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:40:29.353100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:40:29.385712 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6137c47-54ac-4b16-a832-889a7806c4be service neutron] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:40:29.391984 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83c0f0-2b3c-4c97-bcd7-15a01929274a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:40:29.392651 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83c0f0-2b3c-4c97-bcd7-15a01929274a service nova] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:40:29.392944 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83c0f0-2b3c-4c97-bcd7-15a01929274a service nova] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:40:29.393219 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83c0f0-2b3c-4c97-bcd7-15a01929274a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:40:29.401847 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83c0f0-2b3c-4c97-bcd7-15a01929274a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:40:29.403466 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83c0f0-2b3c-4c97-bcd7-15a01929274a service nova] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:40:29.412934 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1301/2587] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:40:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:40:30.699888 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1c280-fcd8-4372-88d5-a5e735f0e56f None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:40:30.700431 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1c280-fcd8-4372-88d5-a5e735f0e56f None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:40:30.700592 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1c280-fcd8-4372-88d5-a5e735f0e56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:40:30.720134 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-6de1c280-fcd8-4372-88d5-a5e735f0e56f None None] MFA Rules not processed for user `7f462366c9564bb6ac7d01b820d64d37`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:40:30.721448 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-6de1c280-fcd8-4372-88d5-a5e735f0e56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:40:30.728532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1287/2588] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:40:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:40:31.952291 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83c0f0-2b3c-4c97-bcd7-15a01929274a service nova] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:40:31.953833 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-1e83c0f0-2b3c-4c97-bcd7-15a01929274a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:40:32.079154 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83c0f0-2b3c-4c97-bcd7-15a01929274a service nova] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:40:32.084585 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d28c56-2a36-428c-a0eb-888ef17c0c49 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a27fe78683743c397fe7929e9053c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:40:32.085933 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d28c56-2a36-428c-a0eb-888ef17c0c49 service placement] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:40:32.086101 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d28c56-2a36-428c-a0eb-888ef17c0c49 service placement] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:40:32.086378 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d28c56-2a36-428c-a0eb-888ef17c0c49 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:40:32.088230 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-60d28c56-2a36-428c-a0eb-888ef17c0c49 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:40:32.106461 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d28c56-2a36-428c-a0eb-888ef17c0c49 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:40:32.108135 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d28c56-2a36-428c-a0eb-888ef17c0c49 service placement] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:40:32.119269 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1302/2589] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:40:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:40:40.714115 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=94,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:40:42.114458 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=51 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:41:17.877146 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f3fdb-0b04-4d6a-a2b6-e3a375fa494e None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:17.878911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f3fdb-0b04-4d6a-a2b6-e3a375fa494e None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:17.878911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f3fdb-0b04-4d6a-a2b6-e3a375fa494e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:17.907606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-671f3fdb-0b04-4d6a-a2b6-e3a375fa494e None None] MFA Rules not processed for user `cea1d8409c754ec797d6c694481a3112`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:41:17.908809 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-671f3fdb-0b04-4d6a-a2b6-e3a375fa494e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:17.968111 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1288/2590] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jul 19 15:41:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:41:18.018151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d28c56-2a36-428c-a0eb-888ef17c0c49 service placement] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:41:18.019632 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-60d28c56-2a36-428c-a0eb-888ef17c0c49 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:18.092737 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d28c56-2a36-428c-a0eb-888ef17c0c49 service placement] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:41:18.097773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361965c3-69c3-4392-a0fe-e6d81a4c7b8f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1dceaddb6e414faef0e0448cdf1be8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:41:18.098440 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361965c3-69c3-4392-a0fe-e6d81a4c7b8f service swift] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:18.098718 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361965c3-69c3-4392-a0fe-e6d81a4c7b8f service swift] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:18.098998 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361965c3-69c3-4392-a0fe-e6d81a4c7b8f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:18.107680 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361965c3-69c3-4392-a0fe-e6d81a4c7b8f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:41:18.109255 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361965c3-69c3-4392-a0fe-e6d81a4c7b8f service swift] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:41:18.118423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1303/2591] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jul 19 15:41:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:41:27.958710 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=29 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:41:28.114522 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=32 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:41:32.259839 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f3fdb-0b04-4d6a-a2b6-e3a375fa494e None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:41:32.270445 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f3fdb-0b04-4d6a-a2b6-e3a375fa494e None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:41:32.274288 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c163a-8430-4cdb-bf2b-2f82acc53a9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:41:32.274948 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c163a-8430-4cdb-bf2b-2f82acc53a9e service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:32.275260 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c163a-8430-4cdb-bf2b-2f82acc53a9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:32.275536 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c163a-8430-4cdb-bf2b-2f82acc53a9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:32.277347 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-ff0c163a-8430-4cdb-bf2b-2f82acc53a9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:32.343825 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c163a-8430-4cdb-bf2b-2f82acc53a9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:41:32.345281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c163a-8430-4cdb-bf2b-2f82acc53a9e service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:41:32.355121 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1289/2592] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:41:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:41:33.377121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0557a-a6a0-4f26-a80f-b8905c4c95b7 None None] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:33.377884 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0557a-a6a0-4f26-a80f-b8905c4c95b7 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:33.378518 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0557a-a6a0-4f26-a80f-b8905c4c95b7 None None] PATH_INFO: `/` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:33.383355 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1304/2593] 10.222.0.44 () {54 vars in 921 bytes} [Tue Jul 19 15:41:33 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:41:33.391990 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640ebd1-1d44-41fb-9b21-97719dd1a08a None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:33.392641 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640ebd1-1d44-41fb-9b21-97719dd1a08a None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:33.392641 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640ebd1-1d44-41fb-9b21-97719dd1a08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:33.422435 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-f640ebd1-1d44-41fb-9b21-97719dd1a08a None None] MFA Rules not processed for user `fef0511f56144ca9945b2dddfa2601a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:41:33.424460 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-f640ebd1-1d44-41fb-9b21-97719dd1a08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:33.445666 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1290/2594] 10.222.0.44 () {58 vars in 1018 bytes} [Tue Jul 19 15:41:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:41:33.461043 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0557a-a6a0-4f26-a80f-b8905c4c95b7 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:41:33.465792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-d1a0557a-a6a0-4f26-a80f-b8905c4c95b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:33.613398 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0557a-a6a0-4f26-a80f-b8905c4c95b7 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:41:33.617735 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc86f94-e399-4e99-a5ae-bed6fc971acf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e66abbda1744a71b4d26677dcef76be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:41:33.618517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc86f94-e399-4e99-a5ae-bed6fc971acf service glance] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:33.618871 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc86f94-e399-4e99-a5ae-bed6fc971acf service glance] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:33.619242 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc86f94-e399-4e99-a5ae-bed6fc971acf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:33.637328 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc86f94-e399-4e99-a5ae-bed6fc971acf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:41:33.641767 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc86f94-e399-4e99-a5ae-bed6fc971acf service glance] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:41:33.667551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1305/2595] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:41:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:41:37.152765 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995e430-e991-40f0-bb4e-b3f31bd97bc3 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:37.153316 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995e430-e991-40f0-bb4e-b3f31bd97bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:37.153316 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995e430-e991-40f0-bb4e-b3f31bd97bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:37.173328 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-4995e430-e991-40f0-bb4e-b3f31bd97bc3 None None] MFA Rules not processed for user `cea1d8409c754ec797d6c694481a3112`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:41:37.174513 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-4995e430-e991-40f0-bb4e-b3f31bd97bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:37.182398 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1291/2596] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jul 19 15:41:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:41:37.197234 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc86f94-e399-4e99-a5ae-bed6fc971acf service glance] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:41:37.225459 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc86f94-e399-4e99-a5ae-bed6fc971acf service glance] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:41:37.231209 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a574bef-f860-4a7b-a5c0-92fa82a32e96 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1dceaddb6e414faef0e0448cdf1be8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:41:37.231934 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a574bef-f860-4a7b-a5c0-92fa82a32e96 service swift] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:37.232216 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a574bef-f860-4a7b-a5c0-92fa82a32e96 service swift] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:37.232493 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a574bef-f860-4a7b-a5c0-92fa82a32e96 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:37.241557 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a574bef-f860-4a7b-a5c0-92fa82a32e96 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:41:37.243175 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a574bef-f860-4a7b-a5c0-92fa82a32e96 service swift] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:41:37.251955 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1306/2597] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jul 19 15:41:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 15:41:37.807431 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995e430-e991-40f0-bb4e-b3f31bd97bc3 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:41:37.829311 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995e430-e991-40f0-bb4e-b3f31bd97bc3 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:41:37.842563 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30f000-a4c7-457c-a2b6-7176a4e93dac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:41:37.843913 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30f000-a4c7-457c-a2b6-7176a4e93dac service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:37.844902 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30f000-a4c7-457c-a2b6-7176a4e93dac service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:37.845509 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30f000-a4c7-457c-a2b6-7176a4e93dac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:37.848699 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-8e30f000-a4c7-457c-a2b6-7176a4e93dac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:37.880851 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30f000-a4c7-457c-a2b6-7176a4e93dac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:41:37.883784 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30f000-a4c7-457c-a2b6-7176a4e93dac service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:41:37.903628 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1292/2598] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:41:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:41:47.248558 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=32 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:41:47.894975 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=40 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:41:48.034673 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a574bef-f860-4a7b-a5c0-92fa82a32e96 service swift] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:41:48.036319 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-6a574bef-f860-4a7b-a5c0-92fa82a32e96 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:48.052647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a574bef-f860-4a7b-a5c0-92fa82a32e96 service swift] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:41:48.058387 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09f571-a899-4f56-9b8a-08deb9f386c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:41:48.059653 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09f571-a899-4f56-9b8a-08deb9f386c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:48.060426 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09f571-a899-4f56-9b8a-08deb9f386c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:48.060695 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09f571-a899-4f56-9b8a-08deb9f386c9 admin admin] PATH_INFO: `/v3/users/87f06c66b2434fb38c70b82cccd88e42` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:48.063478 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09f571-a899-4f56-9b8a-08deb9f386c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87f06c66b2434fb38c70b82cccd88e42)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:41:48.074058 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09f571-a899-4f56-9b8a-08deb9f386c9 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:41:48.140722 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-cd09f571-a899-4f56-9b8a-08deb9f386c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87f06c66b2434fb38c70b82cccd88e42'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:41:48.160069 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-cd09f571-a899-4f56-9b8a-08deb9f386c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87f06c66b2434fb38c70b82cccd88e42'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:41:48.170199 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-cd09f571-a899-4f56-9b8a-08deb9f386c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87f06c66b2434fb38c70b82cccd88e42'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:41:48.171011 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-cd09f571-a899-4f56-9b8a-08deb9f386c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87f06c66b2434fb38c70b82cccd88e42'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:41:48.171669 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-cd09f571-a899-4f56-9b8a-08deb9f386c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87f06c66b2434fb38c70b82cccd88e42'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:41:48.187506 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1307/2599] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:41:48 2022] DELETE /identity/v3/users/87f06c66b2434fb38c70b82cccd88e42 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:41:48.386258 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30f000-a4c7-457c-a2b6-7176a4e93dac service neutron] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:41:48.398211 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30f000-a4c7-457c-a2b6-7176a4e93dac service neutron] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:41:48.462988 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bc1ab-3095-41eb-9936-037d236afcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:41:48.463903 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bc1ab-3095-41eb-9936-037d236afcb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:48.464185 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bc1ab-3095-41eb-9936-037d236afcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:48.464463 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bc1ab-3095-41eb-9936-037d236afcb2 admin admin] PATH_INFO: `/v3/projects/6aff9e6382374d38b212f1f7d0890ef7` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:48.465740 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58bc1ab-3095-41eb-9936-037d236afcb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aff9e6382374d38b212f1f7d0890ef7)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:41:48.467758 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58bc1ab-3095-41eb-9936-037d236afcb2 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:41:48.537688 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-e58bc1ab-3095-41eb-9936-037d236afcb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aff9e6382374d38b212f1f7d0890ef7', 'request_id': 'req-e58bc1ab-3095-41eb-9936-037d236afcb2'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:41:48.549420 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-e58bc1ab-3095-41eb-9936-037d236afcb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aff9e6382374d38b212f1f7d0890ef7', 'request_id': 'req-e58bc1ab-3095-41eb-9936-037d236afcb2'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:41:48.562115 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-e58bc1ab-3095-41eb-9936-037d236afcb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aff9e6382374d38b212f1f7d0890ef7', 'request_id': 'req-e58bc1ab-3095-41eb-9936-037d236afcb2'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:41:48.582841 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-e58bc1ab-3095-41eb-9936-037d236afcb2 admin admin] The token cache is being invalidate because project 6aff9e6382374d38b212f1f7d0890ef7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:41:48.583442 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-e58bc1ab-3095-41eb-9936-037d236afcb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:41:48.586208 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-e58bc1ab-3095-41eb-9936-037d236afcb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:41:48.589113 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1293/2600] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:41:48 2022] DELETE /identity/v3/projects/6aff9e6382374d38b212f1f7d0890ef7 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:41:48.593881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09f571-a899-4f56-9b8a-08deb9f386c9 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:41:48.595819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-cd09f571-a899-4f56-9b8a-08deb9f386c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:48.610929 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09f571-a899-4f56-9b8a-08deb9f386c9 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:41:48.674998 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb818e-9a33-4065-ba06-5cca238f89ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:41:48.675823 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb818e-9a33-4065-ba06-5cca238f89ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:48.676108 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb818e-9a33-4065-ba06-5cca238f89ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:48.676386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb818e-9a33-4065-ba06-5cca238f89ce admin admin] PATH_INFO: `/v3/users/646f517fbf834b95a39301314866367c` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:48.677595 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb818e-9a33-4065-ba06-5cca238f89ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=646f517fbf834b95a39301314866367c)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:41:48.679577 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb818e-9a33-4065-ba06-5cca238f89ce admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:41:48.728140 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ffdb818e-9a33-4065-ba06-5cca238f89ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '646f517fbf834b95a39301314866367c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:41:48.739945 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ffdb818e-9a33-4065-ba06-5cca238f89ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '646f517fbf834b95a39301314866367c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:41:48.747438 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ffdb818e-9a33-4065-ba06-5cca238f89ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '646f517fbf834b95a39301314866367c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:41:48.748190 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ffdb818e-9a33-4065-ba06-5cca238f89ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '646f517fbf834b95a39301314866367c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:41:48.748805 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ffdb818e-9a33-4065-ba06-5cca238f89ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '646f517fbf834b95a39301314866367c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:41:48.750486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:41:48.766578 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1308/2601] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:41:48 2022] DELETE /identity/v3/users/646f517fbf834b95a39301314866367c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:41:48.940821 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bc1ab-3095-41eb-9936-037d236afcb2 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:41:48.942308 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-e58bc1ab-3095-41eb-9936-037d236afcb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:48.956114 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bc1ab-3095-41eb-9936-037d236afcb2 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:41:49.021066 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5cf54-67ab-4e40-abf8-3a99ad2622b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:41:49.021986 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5cf54-67ab-4e40-abf8-3a99ad2622b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:49.022268 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5cf54-67ab-4e40-abf8-3a99ad2622b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:49.022547 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5cf54-67ab-4e40-abf8-3a99ad2622b8 admin admin] PATH_INFO: `/v3/projects/9cdcc5f4a06a49e9a03dc0cacb5b1c7c` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:49.023773 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5cf54-67ab-4e40-abf8-3a99ad2622b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cdcc5f4a06a49e9a03dc0cacb5b1c7c)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:41:49.025661 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5cf54-67ab-4e40-abf8-3a99ad2622b8 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:41:49.061882 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:41:49.075945 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-97d5cf54-67ab-4e40-abf8-3a99ad2622b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cdcc5f4a06a49e9a03dc0cacb5b1c7c', 'request_id': 'req-97d5cf54-67ab-4e40-abf8-3a99ad2622b8'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:41:49.082231 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-97d5cf54-67ab-4e40-abf8-3a99ad2622b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cdcc5f4a06a49e9a03dc0cacb5b1c7c', 'request_id': 'req-97d5cf54-67ab-4e40-abf8-3a99ad2622b8'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:41:49.090032 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-97d5cf54-67ab-4e40-abf8-3a99ad2622b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cdcc5f4a06a49e9a03dc0cacb5b1c7c', 'request_id': 'req-97d5cf54-67ab-4e40-abf8-3a99ad2622b8'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:41:49.101428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-97d5cf54-67ab-4e40-abf8-3a99ad2622b8 admin admin] The token cache is being invalidate because project 9cdcc5f4a06a49e9a03dc0cacb5b1c7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:41:49.101746 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-97d5cf54-67ab-4e40-abf8-3a99ad2622b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:41:49.102526 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-97d5cf54-67ab-4e40-abf8-3a99ad2622b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:41:49.104061 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1294/2602] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:41:48 2022] DELETE /identity/v3/projects/9cdcc5f4a06a49e9a03dc0cacb5b1c7c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:41:58.418442 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ac79e-af9e-4c9e-921d-7f679af8e56f None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:58.419069 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ac79e-af9e-4c9e-921d-7f679af8e56f None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:58.419069 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ac79e-af9e-4c9e-921d-7f679af8e56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:58.437046 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-a73ac79e-af9e-4c9e-921d-7f679af8e56f None None] MFA Rules not processed for user `cea1d8409c754ec797d6c694481a3112`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:41:58.438250 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-a73ac79e-af9e-4c9e-921d-7f679af8e56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:58.501663 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1309/2603] 10.222.0.44 () {58 vars in 967 bytes} [Tue Jul 19 15:41:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:41:58.514431 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5cf54-67ab-4e40-abf8-3a99ad2622b8 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:41:58.515964 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-97d5cf54-67ab-4e40-abf8-3a99ad2622b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:58.589367 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5cf54-67ab-4e40-abf8-3a99ad2622b8 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:41:58.594366 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9410f-5401-4e0c-9c3a-341fc6449f75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1dceaddb6e414faef0e0448cdf1be8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:41:58.595021 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9410f-5401-4e0c-9c3a-341fc6449f75 service swift] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:58.595339 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9410f-5401-4e0c-9c3a-341fc6449f75 service swift] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:58.595624 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9410f-5401-4e0c-9c3a-341fc6449f75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:58.604973 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9410f-5401-4e0c-9c3a-341fc6449f75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:41:58.606633 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9410f-5401-4e0c-9c3a-341fc6449f75 service swift] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:41:58.615161 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1295/2604] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jul 19 15:41:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:42:08.493831 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=27 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:42:08.611839 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=44,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:42:18.312690 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751ec2b-eaf4-4f45-a8ec-20b015d8370c None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:42:18.313258 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751ec2b-eaf4-4f45-a8ec-20b015d8370c None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:42:18.313258 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751ec2b-eaf4-4f45-a8ec-20b015d8370c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:42:18.331197 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-7751ec2b-eaf4-4f45-a8ec-20b015d8370c None None] MFA Rules not processed for user `7f462366c9564bb6ac7d01b820d64d37`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:42:18.332470 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-7751ec2b-eaf4-4f45-a8ec-20b015d8370c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:42:18.388629 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1310/2605] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:42:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:42:18.424134 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9410f-5401-4e0c-9c3a-341fc6449f75 service swift] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:42:18.425559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-19e9410f-5401-4e0c-9c3a-341fc6449f75 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:42:18.482003 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9410f-5401-4e0c-9c3a-341fc6449f75 service swift] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:42:18.485728 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09ec31-543f-4f46-a3c7-e56e226a1f70 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e66abbda1744a71b4d26677dcef76be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:42:18.486379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09ec31-543f-4f46-a3c7-e56e226a1f70 service glance] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:42:18.486667 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09ec31-543f-4f46-a3c7-e56e226a1f70 service glance] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:42:18.486950 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09ec31-543f-4f46-a3c7-e56e226a1f70 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:42:18.488768 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-fd09ec31-543f-4f46-a3c7-e56e226a1f70 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:42:18.562156 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09ec31-543f-4f46-a3c7-e56e226a1f70 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:42:18.563627 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09ec31-543f-4f46-a3c7-e56e226a1f70 service glance] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:42:18.575237 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1296/2606] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:42:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:42:19.168085 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751ec2b-eaf4-4f45-a8ec-20b015d8370c None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:42:19.169504 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-7751ec2b-eaf4-4f45-a8ec-20b015d8370c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:42:19.228868 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751ec2b-eaf4-4f45-a8ec-20b015d8370c None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:42:19.232425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b3ab2-c52a-4d9d-a681-d1a60e42c022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:42:19.233075 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b3ab2-c52a-4d9d-a681-d1a60e42c022 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:42:19.233351 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b3ab2-c52a-4d9d-a681-d1a60e42c022 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:42:19.233617 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b3ab2-c52a-4d9d-a681-d1a60e42c022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:42:19.235412 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-339b3ab2-c52a-4d9d-a681-d1a60e42c022 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:42:19.249178 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b3ab2-c52a-4d9d-a681-d1a60e42c022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:42:19.250583 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b3ab2-c52a-4d9d-a681-d1a60e42c022 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:42:19.262931 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1311/2607] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:42:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:42:28.569780 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=54 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:42:29.258163 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=51 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:43:03.936304 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929f4d8-a6f8-408f-8305-4d153deda201 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:03.936969 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929f4d8-a6f8-408f-8305-4d153deda201 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:03.936969 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929f4d8-a6f8-408f-8305-4d153deda201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:03.956494 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-a929f4d8-a6f8-408f-8305-4d153deda201 None None] MFA Rules not processed for user `1672e1eef6bd4caaad2834206a62265b`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:43:03.957724 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-a929f4d8-a6f8-408f-8305-4d153deda201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:43:04.017243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1297/2608] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:43:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:43:06.709602 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b3ab2-c52a-4d9d-a681-d1a60e42c022 service neutron] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:43:06.712004 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-339b3ab2-c52a-4d9d-a681-d1a60e42c022 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:43:06.724173 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b3ab2-c52a-4d9d-a681-d1a60e42c022 service neutron] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:43:06.727894 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fc4e7-27c9-4148-bdb5-c02bd3439061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:43:06.728547 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fc4e7-27c9-4148-bdb5-c02bd3439061 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:06.729374 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fc4e7-27c9-4148-bdb5-c02bd3439061 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:06.729667 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fc4e7-27c9-4148-bdb5-c02bd3439061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:06.731537 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-bb9fc4e7-27c9-4148-bdb5-c02bd3439061 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:43:06.742235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fc4e7-27c9-4148-bdb5-c02bd3439061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:43:06.743722 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fc4e7-27c9-4148-bdb5-c02bd3439061 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:43:06.753273 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1312/2609] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:43:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:43:14.010113 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=25 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:43:16.749190 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=6 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:43:50.249948 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929f4d8-a6f8-408f-8305-4d153deda201 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:43:50.251751 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-a929f4d8-a6f8-408f-8305-4d153deda201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:43:50.269771 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929f4d8-a6f8-408f-8305-4d153deda201 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:43:50.276188 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b903b-03c3-4337-82f4-a2e22183c605 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:43:50.276432 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b903b-03c3-4337-82f4-a2e22183c605 service nova] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:50.277107 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b903b-03c3-4337-82f4-a2e22183c605 service nova] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:50.277408 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b903b-03c3-4337-82f4-a2e22183c605 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:50.279657 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-eb1b903b-03c3-4337-82f4-a2e22183c605 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:43:50.293297 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b903b-03c3-4337-82f4-a2e22183c605 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:43:50.294935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b903b-03c3-4337-82f4-a2e22183c605 service nova] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:43:50.306725 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1298/2610] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:43:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:43:58.881614 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb08cd-e5f5-4032-a38f-bf0597893ba9 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:58.882151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb08cd-e5f5-4032-a38f-bf0597893ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:58.882151 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb08cd-e5f5-4032-a38f-bf0597893ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:58.900593 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-a9bb08cd-e5f5-4032-a38f-bf0597893ba9 None None] MFA Rules not processed for user `7f462366c9564bb6ac7d01b820d64d37`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:43:58.901788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-a9bb08cd-e5f5-4032-a38f-bf0597893ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:43:58.909254 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1313/2611] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:43:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:43:59.212105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b903b-03c3-4337-82f4-a2e22183c605 service nova] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:43:59.221305 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b903b-03c3-4337-82f4-a2e22183c605 service nova] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:43:59.224900 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af25ae9-2d66-4b78-8c60-64a7eef297b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:43:59.225534 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af25ae9-2d66-4b78-8c60-64a7eef297b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:59.225819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af25ae9-2d66-4b78-8c60-64a7eef297b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:59.226097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af25ae9-2d66-4b78-8c60-64a7eef297b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:59.227878 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-2af25ae9-2d66-4b78-8c60-64a7eef297b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:43:59.237559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af25ae9-2d66-4b78-8c60-64a7eef297b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:43:59.239040 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af25ae9-2d66-4b78-8c60-64a7eef297b6 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:43:59.247160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1299/2612] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:43:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:43:59.594293 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb08cd-e5f5-4032-a38f-bf0597893ba9 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:43:59.595846 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-a9bb08cd-e5f5-4032-a38f-bf0597893ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:43:59.669191 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb08cd-e5f5-4032-a38f-bf0597893ba9 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:43:59.674268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58292f-5b78-4b7e-8621-a2627f1169fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a27fe78683743c397fe7929e9053c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:43:59.674928 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58292f-5b78-4b7e-8621-a2627f1169fb service placement] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:59.675237 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58292f-5b78-4b7e-8621-a2627f1169fb service placement] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:59.675527 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58292f-5b78-4b7e-8621-a2627f1169fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:59.677332 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-ee58292f-5b78-4b7e-8621-a2627f1169fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:43:59.689054 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58292f-5b78-4b7e-8621-a2627f1169fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:43:59.690615 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58292f-5b78-4b7e-8621-a2627f1169fb service placement] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:43:59.700495 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1314/2613] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:43:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:44:06.670268 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af25ae9-2d66-4b78-8c60-64a7eef297b6 service neutron] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:44:06.672931 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-2af25ae9-2d66-4b78-8c60-64a7eef297b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:44:06.694402 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af25ae9-2d66-4b78-8c60-64a7eef297b6 service neutron] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:44:06.705669 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca11bc-681b-4c7a-97e3-075c3faaebbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:44:06.705669 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca11bc-681b-4c7a-97e3-075c3faaebbf service nova] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:06.705669 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca11bc-681b-4c7a-97e3-075c3faaebbf service nova] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:06.705669 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca11bc-681b-4c7a-97e3-075c3faaebbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:06.709795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-7cca11bc-681b-4c7a-97e3-075c3faaebbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:44:06.723319 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca11bc-681b-4c7a-97e3-075c3faaebbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:44:06.725000 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca11bc-681b-4c7a-97e3-075c3faaebbf service nova] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:44:06.741667 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1300/2614] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:44:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:44:09.696446 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=35 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:44:10.564543 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58292f-5b78-4b7e-8621-a2627f1169fb service placement] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:44:10.582109 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58292f-5b78-4b7e-8621-a2627f1169fb service placement] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:44:10.588616 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008729a-3cb3-4924-b844-e27aa22821b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:44:10.589427 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008729a-3cb3-4924-b844-e27aa22821b1 service nova] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:10.589721 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008729a-3cb3-4924-b844-e27aa22821b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:10.590004 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008729a-3cb3-4924-b844-e27aa22821b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:10.592606 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-9008729a-3cb3-4924-b844-e27aa22821b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:44:10.607631 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008729a-3cb3-4924-b844-e27aa22821b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:44:10.609254 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008729a-3cb3-4924-b844-e27aa22821b1 service nova] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:44:10.621506 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1315/2615] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:44:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:44:16.732207 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=18 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:44:20.616909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=6 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:44:31.580882 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca11bc-681b-4c7a-97e3-075c3faaebbf service nova] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:44:31.597148 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca11bc-681b-4c7a-97e3-075c3faaebbf service nova] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:44:31.602805 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca08604-65d2-4394-8239-86ec64a27e9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:44:31.603501 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca08604-65d2-4394-8239-86ec64a27e9f service nova] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:31.603791 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca08604-65d2-4394-8239-86ec64a27e9f service nova] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:31.604072 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca08604-65d2-4394-8239-86ec64a27e9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:31.605890 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-eca08604-65d2-4394-8239-86ec64a27e9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:44:31.616680 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca08604-65d2-4394-8239-86ec64a27e9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:44:31.618259 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca08604-65d2-4394-8239-86ec64a27e9f service nova] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:44:31.627877 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1301/2616] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:44:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:44:41.623118 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=6 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:44:52.273517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627f24a-4200-448a-ac38-c38abf3a955d None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:52.274027 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627f24a-4200-448a-ac38-c38abf3a955d None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:52.274146 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627f24a-4200-448a-ac38-c38abf3a955d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:52.322104 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-8627f24a-4200-448a-ac38-c38abf3a955d None None] MFA Rules not processed for user `cea1d8409c754ec797d6c694481a3112`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:44:52.323627 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-8627f24a-4200-448a-ac38-c38abf3a955d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:44:52.341164 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1316/2617] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jul 19 15:44:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:44:52.397120 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca08604-65d2-4394-8239-86ec64a27e9f service nova] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:44:52.418122 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca08604-65d2-4394-8239-86ec64a27e9f service nova] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:44:52.423196 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29078541-8287-4655-97c2-3d1fe94e50ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1dceaddb6e414faef0e0448cdf1be8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:44:52.423869 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29078541-8287-4655-97c2-3d1fe94e50ff service swift] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:52.424159 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29078541-8287-4655-97c2-3d1fe94e50ff service swift] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:52.424441 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29078541-8287-4655-97c2-3d1fe94e50ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:52.433296 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29078541-8287-4655-97c2-3d1fe94e50ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:44:52.434803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29078541-8287-4655-97c2-3d1fe94e50ff service swift] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:44:52.443666 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1302/2618] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jul 19 15:44:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:45:02.338086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=18 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:02.440508 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=10 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:06.871083 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627f24a-4200-448a-ac38-c38abf3a955d None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:06.881361 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627f24a-4200-448a-ac38-c38abf3a955d None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:06.884987 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105445d-e402-4052-b0d4-d843bc228183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:06.885621 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105445d-e402-4052-b0d4-d843bc228183 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:06.885905 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105445d-e402-4052-b0d4-d843bc228183 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:06.886179 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105445d-e402-4052-b0d4-d843bc228183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:06.888004 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-3105445d-e402-4052-b0d4-d843bc228183 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:06.901979 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105445d-e402-4052-b0d4-d843bc228183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:06.903496 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105445d-e402-4052-b0d4-d843bc228183 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:06.913217 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1317/2619] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:07.006025 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29078541-8287-4655-97c2-3d1fe94e50ff service swift] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:07.016544 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29078541-8287-4655-97c2-3d1fe94e50ff service swift] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:07.020378 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb769c4-2848-402d-9989-6bfa7531e45a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:07.021071 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb769c4-2848-402d-9989-6bfa7531e45a service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:07.021673 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb769c4-2848-402d-9989-6bfa7531e45a service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:07.022118 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb769c4-2848-402d-9989-6bfa7531e45a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:07.023911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-9cb769c4-2848-402d-9989-6bfa7531e45a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:07.037666 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb769c4-2848-402d-9989-6bfa7531e45a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:07.039082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb769c4-2848-402d-9989-6bfa7531e45a service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:07.050890 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1303/2620] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:08.770251 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a300c-474c-4e06-8b45-49092eef0f57 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:08.770744 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a300c-474c-4e06-8b45-49092eef0f57 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:08.770858 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a300c-474c-4e06-8b45-49092eef0f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:08.789003 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-c74a300c-474c-4e06-8b45-49092eef0f57 None None] MFA Rules not processed for user `cea1d8409c754ec797d6c694481a3112`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:08.790217 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-c74a300c-474c-4e06-8b45-49092eef0f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:08.802665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1318/2621] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jul 19 15:45:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:08.815176 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb769c4-2848-402d-9989-6bfa7531e45a service neutron] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:08.826827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb769c4-2848-402d-9989-6bfa7531e45a service neutron] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:08.832410 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898e1a5-57af-4c81-9154-775c865b77d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1dceaddb6e414faef0e0448cdf1be8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:08.833055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898e1a5-57af-4c81-9154-775c865b77d4 service swift] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:08.833342 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898e1a5-57af-4c81-9154-775c865b77d4 service swift] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:08.833628 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898e1a5-57af-4c81-9154-775c865b77d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:08.842476 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898e1a5-57af-4c81-9154-775c865b77d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:08.844108 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898e1a5-57af-4c81-9154-775c865b77d4 service swift] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:08.852553 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1304/2622] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jul 19 15:45:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:45:18.783760 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=9 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:18.849132 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=12 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:28.998361 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a300c-474c-4e06-8b45-49092eef0f57 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:28.999820 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-c74a300c-474c-4e06-8b45-49092eef0f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:29.077677 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a300c-474c-4e06-8b45-49092eef0f57 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:29.082027 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411915b-a726-4388-9a3e-5e6bf7077a14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:29.082676 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411915b-a726-4388-9a3e-5e6bf7077a14 service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:29.082967 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411915b-a726-4388-9a3e-5e6bf7077a14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:29.083273 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411915b-a726-4388-9a3e-5e6bf7077a14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:29.085083 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-a411915b-a726-4388-9a3e-5e6bf7077a14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:29.096606 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a411915b-a726-4388-9a3e-5e6bf7077a14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:29.098024 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a411915b-a726-4388-9a3e-5e6bf7077a14 service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:29.106851 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1319/2623] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:45:29.217293 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d3be4-c54f-4afb-b27a-e39e8645a222 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:29.217842 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d3be4-c54f-4afb-b27a-e39e8645a222 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:29.217842 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d3be4-c54f-4afb-b27a-e39e8645a222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:29.242462 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-c39d3be4-c54f-4afb-b27a-e39e8645a222 None None] MFA Rules not processed for user `cea1d8409c754ec797d6c694481a3112`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:29.245020 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-c39d3be4-c54f-4afb-b27a-e39e8645a222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:29.255342 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1305/2624] 10.222.0.44 () {58 vars in 967 bytes} [Tue Jul 19 15:45:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:29.268181 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411915b-a726-4388-9a3e-5e6bf7077a14 service cinder] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:29.279939 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411915b-a726-4388-9a3e-5e6bf7077a14 service cinder] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:29.285511 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162edda-94b5-4e41-a08a-a3359c2b153b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1dceaddb6e414faef0e0448cdf1be8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:29.286209 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162edda-94b5-4e41-a08a-a3359c2b153b service swift] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:29.286495 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162edda-94b5-4e41-a08a-a3359c2b153b service swift] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:29.286775 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162edda-94b5-4e41-a08a-a3359c2b153b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:29.295318 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162edda-94b5-4e41-a08a-a3359c2b153b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:29.296904 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162edda-94b5-4e41-a08a-a3359c2b153b service swift] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:29.306903 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1320/2625] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jul 19 15:45:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:45:34.805184 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d3be4-c54f-4afb-b27a-e39e8645a222 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:45:34.807300 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-c39d3be4-c54f-4afb-b27a-e39e8645a222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:34.824618 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d3be4-c54f-4afb-b27a-e39e8645a222 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:45:34.829624 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262dc4e-28c7-44ce-9489-401ca1e75c79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a27fe78683743c397fe7929e9053c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:45:34.830279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262dc4e-28c7-44ce-9489-401ca1e75c79 service placement] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:34.830565 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262dc4e-28c7-44ce-9489-401ca1e75c79 service placement] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:34.830844 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262dc4e-28c7-44ce-9489-401ca1e75c79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:34.832966 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-0262dc4e-28c7-44ce-9489-401ca1e75c79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:34.846251 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262dc4e-28c7-44ce-9489-401ca1e75c79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:45:34.847937 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262dc4e-28c7-44ce-9489-401ca1e75c79 service placement] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:45:34.859334 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1306/2626] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:45:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:45:38.352207 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319633a3-e6ef-425d-80ce-b0af88de7e94 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:45:38.352759 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319633a3-e6ef-425d-80ce-b0af88de7e94 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:45:38.352860 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319633a3-e6ef-425d-80ce-b0af88de7e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:45:38.372117 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-319633a3-e6ef-425d-80ce-b0af88de7e94 None None] MFA Rules not processed for user `7f462366c9564bb6ac7d01b820d64d37`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:45:38.373327 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-319633a3-e6ef-425d-80ce-b0af88de7e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:45:38.380876 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1321/2627] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:45:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:45:44.855123 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=9 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:48.366706 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=44 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:33.564147 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262dc4e-28c7-44ce-9489-401ca1e75c79 service placement] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:33.574771 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262dc4e-28c7-44ce-9489-401ca1e75c79 service placement] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:33.578464 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1b381-fcfb-4e0e-aadf-5530d076aa20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:33.579118 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1b381-fcfb-4e0e-aadf-5530d076aa20 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:33.579443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1b381-fcfb-4e0e-aadf-5530d076aa20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:33.579720 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1b381-fcfb-4e0e-aadf-5530d076aa20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:33.581651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-cde1b381-fcfb-4e0e-aadf-5530d076aa20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:33.653834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1b381-fcfb-4e0e-aadf-5530d076aa20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:33.655321 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1b381-fcfb-4e0e-aadf-5530d076aa20 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:33.665572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1307/2628] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:36.696026 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319633a3-e6ef-425d-80ce-b0af88de7e94 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:36.712197 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319633a3-e6ef-425d-80ce-b0af88de7e94 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:36.717777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114729a-5dc4-4c63-8dc2-8e69fb94c47b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a27fe78683743c397fe7929e9053c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:36.718739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114729a-5dc4-4c63-8dc2-8e69fb94c47b service placement] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:36.719039 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114729a-5dc4-4c63-8dc2-8e69fb94c47b service placement] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:36.719386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114729a-5dc4-4c63-8dc2-8e69fb94c47b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:36.721345 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-1114729a-5dc4-4c63-8dc2-8e69fb94c47b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:36.735444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114729a-5dc4-4c63-8dc2-8e69fb94c47b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:36.737188 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114729a-5dc4-4c63-8dc2-8e69fb94c47b service placement] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:36.749818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1322/2629] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:36.804424 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1b381-fcfb-4e0e-aadf-5530d076aa20 service neutron] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:36.806768 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-cde1b381-fcfb-4e0e-aadf-5530d076aa20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:36.819372 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1b381-fcfb-4e0e-aadf-5530d076aa20 service neutron] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:36.824601 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166671bd-da8c-49a6-9c9b-6019cdb5a7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:36.825477 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166671bd-da8c-49a6-9c9b-6019cdb5a7d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:36.825791 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166671bd-da8c-49a6-9c9b-6019cdb5a7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:36.826070 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166671bd-da8c-49a6-9c9b-6019cdb5a7d5 admin admin] PATH_INFO: `/v3/users/1672e1eef6bd4caaad2834206a62265b` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:36.827292 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166671bd-da8c-49a6-9c9b-6019cdb5a7d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1672e1eef6bd4caaad2834206a62265b)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:36.829213 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166671bd-da8c-49a6-9c9b-6019cdb5a7d5 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:36.877197 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-166671bd-da8c-49a6-9c9b-6019cdb5a7d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1672e1eef6bd4caaad2834206a62265b'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:36.891447 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-166671bd-da8c-49a6-9c9b-6019cdb5a7d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1672e1eef6bd4caaad2834206a62265b'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:36.898206 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-166671bd-da8c-49a6-9c9b-6019cdb5a7d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1672e1eef6bd4caaad2834206a62265b'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:36.898938 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-166671bd-da8c-49a6-9c9b-6019cdb5a7d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1672e1eef6bd4caaad2834206a62265b'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:36.899566 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-166671bd-da8c-49a6-9c9b-6019cdb5a7d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1672e1eef6bd4caaad2834206a62265b'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:36.918595 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1308/2630] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:46:36 2022] DELETE /identity/v3/users/1672e1eef6bd4caaad2834206a62265b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:37.106793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114729a-5dc4-4c63-8dc2-8e69fb94c47b service placement] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:37.117634 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114729a-5dc4-4c63-8dc2-8e69fb94c47b service placement] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:37.178371 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450eb467-dd5f-46d3-a513-dcd0a200e69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:37.179150 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450eb467-dd5f-46d3-a513-dcd0a200e69d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:37.179470 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450eb467-dd5f-46d3-a513-dcd0a200e69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:37.179754 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450eb467-dd5f-46d3-a513-dcd0a200e69d admin admin] PATH_INFO: `/v3/projects/07c2df2ef71a4fe6a37b01cb4d6396a3` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:37.181180 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450eb467-dd5f-46d3-a513-dcd0a200e69d admin admin] RBAC: Authorizing `identity:delete_project(project_id=07c2df2ef71a4fe6a37b01cb4d6396a3)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:37.182865 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450eb467-dd5f-46d3-a513-dcd0a200e69d admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:37.229216 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-450eb467-dd5f-46d3-a513-dcd0a200e69d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07c2df2ef71a4fe6a37b01cb4d6396a3', 'request_id': 'req-450eb467-dd5f-46d3-a513-dcd0a200e69d'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:37.235433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-450eb467-dd5f-46d3-a513-dcd0a200e69d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07c2df2ef71a4fe6a37b01cb4d6396a3', 'request_id': 'req-450eb467-dd5f-46d3-a513-dcd0a200e69d'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:37.243495 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-450eb467-dd5f-46d3-a513-dcd0a200e69d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07c2df2ef71a4fe6a37b01cb4d6396a3', 'request_id': 'req-450eb467-dd5f-46d3-a513-dcd0a200e69d'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:37.254416 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-450eb467-dd5f-46d3-a513-dcd0a200e69d admin admin] The token cache is being invalidate because project 07c2df2ef71a4fe6a37b01cb4d6396a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:46:37.254712 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-450eb467-dd5f-46d3-a513-dcd0a200e69d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:37.255492 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-450eb467-dd5f-46d3-a513-dcd0a200e69d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:37.257064 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1323/2631] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:46:37 2022] DELETE /identity/v3/projects/07c2df2ef71a4fe6a37b01cb4d6396a3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:37.262568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65b799-76c2-4388-9ba6-b766108ac662 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:37.262860 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65b799-76c2-4388-9ba6-b766108ac662 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:37.263192 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65b799-76c2-4388-9ba6-b766108ac662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:37.282151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-8c65b799-76c2-4388-9ba6-b766108ac662 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:37.283469 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-8c65b799-76c2-4388-9ba6-b766108ac662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:37.346225 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1309/2632] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:46:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:37.354467 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb227392-db05-4364-a5bf-f84206b18968 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:37.354760 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb227392-db05-4364-a5bf-f84206b18968 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:37.355045 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb227392-db05-4364-a5bf-f84206b18968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:37.374455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-bb227392-db05-4364-a5bf-f84206b18968 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:37.376070 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-bb227392-db05-4364-a5bf-f84206b18968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:37.384999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1324/2633] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:46:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:37.389934 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65b799-76c2-4388-9ba6-b766108ac662 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:37.400352 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65b799-76c2-4388-9ba6-b766108ac662 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:37.405601 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54782992-71a3-4ead-a2f0-1353a6681f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:37.406269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54782992-71a3-4ead-a2f0-1353a6681f7d admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:37.406549 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54782992-71a3-4ead-a2f0-1353a6681f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:37.406825 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54782992-71a3-4ead-a2f0-1353a6681f7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:37.407588 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54782992-71a3-4ead-a2f0-1353a6681f7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:46:37.407897 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54782992-71a3-4ead-a2f0-1353a6681f7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:37.409483 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54782992-71a3-4ead-a2f0-1353a6681f7d admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:37.411318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:37.431050 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1310/2634] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:46:37.435867 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb227392-db05-4364-a5bf-f84206b18968 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:37.450506 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb227392-db05-4364-a5bf-f84206b18968 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:37.455922 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d3edd-637f-4962-859a-a544116d0a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:37.456604 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d3edd-637f-4962-859a-a544116d0a81 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:37.456886 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d3edd-637f-4962-859a-a544116d0a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:37.457164 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d3edd-637f-4962-859a-a544116d0a81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:37.457896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d3edd-637f-4962-859a-a544116d0a81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:37.459862 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d3edd-637f-4962-859a-a544116d0a81 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:37.498576 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1325/2635] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:46:37 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:46:37.503886 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54782992-71a3-4ead-a2f0-1353a6681f7d admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:37.515698 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54782992-71a3-4ead-a2f0-1353a6681f7d admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:37.574998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07b9ec-d59e-4c67-a854-c603d7ad2f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:37.575712 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07b9ec-d59e-4c67-a854-c603d7ad2f0f admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:37.576001 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07b9ec-d59e-4c67-a854-c603d7ad2f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:37.576285 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07b9ec-d59e-4c67-a854-c603d7ad2f0f admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:37.577110 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07b9ec-d59e-4c67-a854-c603d7ad2f0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:37.578889 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07b9ec-d59e-4c67-a854-c603d7ad2f0f admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:37.599474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1311/2636] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:46:37 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:46:37.604091 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d3edd-637f-4962-859a-a544116d0a81 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:37.614749 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d3edd-637f-4962-859a-a544116d0a81 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:37.619522 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafdb8c-128c-4a9f-810c-121e039c4523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:37.620699 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafdb8c-128c-4a9f-810c-121e039c4523 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:37.620986 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafdb8c-128c-4a9f-810c-121e039c4523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:37.621263 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafdb8c-128c-4a9f-810c-121e039c4523 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:37.621993 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fafdb8c-128c-4a9f-810c-121e039c4523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:37.623738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fafdb8c-128c-4a9f-810c-121e039c4523 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:37.634159 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1326/2637] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:46:37.641868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07b9ec-d59e-4c67-a854-c603d7ad2f0f admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:37.652148 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07b9ec-d59e-4c67-a854-c603d7ad2f0f admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:37.656853 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9abca6-7726-4c2c-8292-bd282d2d0ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:37.657546 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9abca6-7726-4c2c-8292-bd282d2d0ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:37.657834 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9abca6-7726-4c2c-8292-bd282d2d0ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:37.658109 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9abca6-7726-4c2c-8292-bd282d2d0ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:37.658842 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9abca6-7726-4c2c-8292-bd282d2d0ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:37.660474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9abca6-7726-4c2c-8292-bd282d2d0ec7 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:37.670837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1312/2638] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:46:37.675370 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafdb8c-128c-4a9f-810c-121e039c4523 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:37.686023 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafdb8c-128c-4a9f-810c-121e039c4523 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:37.690576 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41597e1b-4ac9-4bc6-a1eb-43aa46ba23bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:37.691503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41597e1b-4ac9-4bc6-a1eb-43aa46ba23bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:37.691794 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41597e1b-4ac9-4bc6-a1eb-43aa46ba23bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:37.692073 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41597e1b-4ac9-4bc6-a1eb-43aa46ba23bb admin admin] PATH_INFO: `/v3/projects/21d7c8c29ac042feb90f4e0e36353327/users/9fc6d2cd59444724a33de0f156be18c8/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:37.707597 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41597e1b-4ac9-4bc6-a1eb-43aa46ba23bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=21d7c8c29ac042feb90f4e0e36353327, user_id=9fc6d2cd59444724a33de0f156be18c8, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:37.710278 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41597e1b-4ac9-4bc6-a1eb-43aa46ba23bb admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:37.723473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1327/2639] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:46:37 2022] PUT /identity/v3/projects/21d7c8c29ac042feb90f4e0e36353327/users/9fc6d2cd59444724a33de0f156be18c8/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:37.733808 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a02f11-c9bb-4598-ae9b-dcb3fc8d94e9 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:37.734100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a02f11-c9bb-4598-ae9b-dcb3fc8d94e9 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:37.734395 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a02f11-c9bb-4598-ae9b-dcb3fc8d94e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:37.762797 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-93a02f11-c9bb-4598-ae9b-dcb3fc8d94e9 None None] MFA Rules not processed for user `9fc6d2cd59444724a33de0f156be18c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:37.764047 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-93a02f11-c9bb-4598-ae9b-dcb3fc8d94e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:37.828756 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1313/2640] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:46:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:37.840293 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41597e1b-4ac9-4bc6-a1eb-43aa46ba23bb admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:37.842116 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-41597e1b-4ac9-4bc6-a1eb-43aa46ba23bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:37.848706 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:37.920213 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41597e1b-4ac9-4bc6-a1eb-43aa46ba23bb admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:37.925816 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7460b-e499-4f3a-af68-0ab1752a87cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef0511f56144ca9945b2dddfa2601a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:37.926469 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7460b-e499-4f3a-af68-0ab1752a87cb service nova] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:37.926757 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7460b-e499-4f3a-af68-0ab1752a87cb service nova] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:37.927038 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7460b-e499-4f3a-af68-0ab1752a87cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:37.936283 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7460b-e499-4f3a-af68-0ab1752a87cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:37.937873 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7460b-e499-4f3a-af68-0ab1752a87cb service nova] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:37.947426 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1328/2641] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:40.637528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a02f11-c9bb-4598-ae9b-dcb3fc8d94e9 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:40.716086 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a02f11-c9bb-4598-ae9b-dcb3fc8d94e9 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:40.720691 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781027c8-4132-4798-b455-cf6a13de053c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:40.721596 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781027c8-4132-4798-b455-cf6a13de053c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:40.721884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781027c8-4132-4798-b455-cf6a13de053c admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:40.722168 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781027c8-4132-4798-b455-cf6a13de053c admin admin] PATH_INFO: `/v3/users/9fc6d2cd59444724a33de0f156be18c8` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:40.723510 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781027c8-4132-4798-b455-cf6a13de053c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fc6d2cd59444724a33de0f156be18c8)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:40.725520 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781027c8-4132-4798-b455-cf6a13de053c admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:40.728386 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:40.781199 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-781027c8-4132-4798-b455-cf6a13de053c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fc6d2cd59444724a33de0f156be18c8'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:40.793683 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-781027c8-4132-4798-b455-cf6a13de053c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fc6d2cd59444724a33de0f156be18c8'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:40.800616 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-781027c8-4132-4798-b455-cf6a13de053c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fc6d2cd59444724a33de0f156be18c8'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:40.801357 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-781027c8-4132-4798-b455-cf6a13de053c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fc6d2cd59444724a33de0f156be18c8'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:40.801969 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-781027c8-4132-4798-b455-cf6a13de053c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fc6d2cd59444724a33de0f156be18c8'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:40.816421 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1314/2642] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:46:40 2022] DELETE /identity/v3/users/9fc6d2cd59444724a33de0f156be18c8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:46:40.820790 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a860242-4dd2-4a04-b41a-5ae40916991e None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:40.821285 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a860242-4dd2-4a04-b41a-5ae40916991e None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:40.821401 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a860242-4dd2-4a04-b41a-5ae40916991e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:40.839756 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-1a860242-4dd2-4a04-b41a-5ae40916991e None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:40.840997 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-1a860242-4dd2-4a04-b41a-5ae40916991e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:40.905175 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1329/2643] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:46:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:46:40.915886 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781027c8-4132-4798-b455-cf6a13de053c admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:40.917985 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-781027c8-4132-4798-b455-cf6a13de053c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:40.982271 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781027c8-4132-4798-b455-cf6a13de053c admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:40.986500 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd8f7e-8134-46cf-8e69-9289f6f89f12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:40.987163 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd8f7e-8134-46cf-8e69-9289f6f89f12 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:40.987485 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd8f7e-8134-46cf-8e69-9289f6f89f12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:40.987769 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd8f7e-8134-46cf-8e69-9289f6f89f12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:40.998211 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd8f7e-8134-46cf-8e69-9289f6f89f12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:40.999717 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd8f7e-8134-46cf-8e69-9289f6f89f12 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:41.010029 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1315/2644] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:41.559828 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a860242-4dd2-4a04-b41a-5ae40916991e None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:41.561224 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-1a860242-4dd2-4a04-b41a-5ae40916991e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:41.574294 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a860242-4dd2-4a04-b41a-5ae40916991e None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:41.579333 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aced4a-21f4-448b-bfc8-41bcf4bcfd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:41.580216 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aced4a-21f4-448b-bfc8-41bcf4bcfd81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:41.580498 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aced4a-21f4-448b-bfc8-41bcf4bcfd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:41.580784 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aced4a-21f4-448b-bfc8-41bcf4bcfd81 admin admin] PATH_INFO: `/v3/projects/21d7c8c29ac042feb90f4e0e36353327` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:41.582130 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aced4a-21f4-448b-bfc8-41bcf4bcfd81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21d7c8c29ac042feb90f4e0e36353327)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:41.584428 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aced4a-21f4-448b-bfc8-41bcf4bcfd81 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:41.635059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-36aced4a-21f4-448b-bfc8-41bcf4bcfd81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21d7c8c29ac042feb90f4e0e36353327', 'request_id': 'req-36aced4a-21f4-448b-bfc8-41bcf4bcfd81'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:41.641727 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-36aced4a-21f4-448b-bfc8-41bcf4bcfd81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21d7c8c29ac042feb90f4e0e36353327', 'request_id': 'req-36aced4a-21f4-448b-bfc8-41bcf4bcfd81'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:41.649213 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-36aced4a-21f4-448b-bfc8-41bcf4bcfd81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21d7c8c29ac042feb90f4e0e36353327', 'request_id': 'req-36aced4a-21f4-448b-bfc8-41bcf4bcfd81'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:41.660078 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-36aced4a-21f4-448b-bfc8-41bcf4bcfd81 admin admin] The token cache is being invalidate because project 21d7c8c29ac042feb90f4e0e36353327 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:46:41.660386 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-36aced4a-21f4-448b-bfc8-41bcf4bcfd81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:41.661060 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-36aced4a-21f4-448b-bfc8-41bcf4bcfd81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:41.662613 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1330/2645] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:46:41 2022] DELETE /identity/v3/projects/21d7c8c29ac042feb90f4e0e36353327 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:41.668134 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ebf7d-a1b7-4b86-89eb-2d3917e5692e None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:41.668693 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ebf7d-a1b7-4b86-89eb-2d3917e5692e None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:41.668796 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ebf7d-a1b7-4b86-89eb-2d3917e5692e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:41.689096 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-4e5ebf7d-a1b7-4b86-89eb-2d3917e5692e None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:41.690318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-4e5ebf7d-a1b7-4b86-89eb-2d3917e5692e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:41.757031 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1316/2646] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:41.766894 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e7052-4e98-4072-9803-e973e075dd87 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:41.767190 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e7052-4e98-4072-9803-e973e075dd87 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:41.767493 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e7052-4e98-4072-9803-e973e075dd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:41.786486 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-4d5e7052-4e98-4072-9803-e973e075dd87 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:41.787752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-4d5e7052-4e98-4072-9803-e973e075dd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:41.795769 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1331/2647] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:41.801066 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ebf7d-a1b7-4b86-89eb-2d3917e5692e None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:41.811099 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ebf7d-a1b7-4b86-89eb-2d3917e5692e None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:41.816328 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f638b42-0b35-4187-9b84-b79fa2c1ebd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:41.816991 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f638b42-0b35-4187-9b84-b79fa2c1ebd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:41.817281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f638b42-0b35-4187-9b84-b79fa2c1ebd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:41.817568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f638b42-0b35-4187-9b84-b79fa2c1ebd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:41.818298 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f638b42-0b35-4187-9b84-b79fa2c1ebd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:46:41.818613 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f638b42-0b35-4187-9b84-b79fa2c1ebd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:41.820261 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f638b42-0b35-4187-9b84-b79fa2c1ebd6 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:41.839201 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1317/2648] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:46:41.841134 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e7052-4e98-4072-9803-e973e075dd87 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:41.850749 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e7052-4e98-4072-9803-e973e075dd87 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:41.855546 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419b1f4-2d9d-47ff-8a82-c51a5b8368bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:41.856217 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419b1f4-2d9d-47ff-8a82-c51a5b8368bf admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:41.856507 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419b1f4-2d9d-47ff-8a82-c51a5b8368bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:41.856815 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419b1f4-2d9d-47ff-8a82-c51a5b8368bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:41.858114 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4419b1f4-2d9d-47ff-8a82-c51a5b8368bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:41.859509 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4419b1f4-2d9d-47ff-8a82-c51a5b8368bf admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:41.863037 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:41.891544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1332/2649] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:46:41 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:46:41.892804 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f638b42-0b35-4187-9b84-b79fa2c1ebd6 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:41.904285 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f638b42-0b35-4187-9b84-b79fa2c1ebd6 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:41.914163 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:41.971174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1804d2-b324-41ea-9c78-469da1a9c21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:41.971896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1804d2-b324-41ea-9c78-469da1a9c21b admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:41.972186 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1804d2-b324-41ea-9c78-469da1a9c21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:41.972468 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1804d2-b324-41ea-9c78-469da1a9c21b admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:41.973182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1804d2-b324-41ea-9c78-469da1a9c21b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:41.975127 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1804d2-b324-41ea-9c78-469da1a9c21b admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:41.996659 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1318/2650] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:46:41 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:46:42.001195 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419b1f4-2d9d-47ff-8a82-c51a5b8368bf admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:42.013130 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419b1f4-2d9d-47ff-8a82-c51a5b8368bf admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:42.018460 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e814abc-5839-4ec1-8215-a8e9c76f5f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:42.019197 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e814abc-5839-4ec1-8215-a8e9c76f5f63 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:42.019516 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e814abc-5839-4ec1-8215-a8e9c76f5f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:42.019796 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e814abc-5839-4ec1-8215-a8e9c76f5f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:42.020632 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e814abc-5839-4ec1-8215-a8e9c76f5f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:42.022256 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e814abc-5839-4ec1-8215-a8e9c76f5f63 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:42.033575 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1333/2651] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:46:42.038197 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1804d2-b324-41ea-9c78-469da1a9c21b admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:42.048742 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1804d2-b324-41ea-9c78-469da1a9c21b admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:42.053582 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fb939-dcad-4d9b-82f4-e0459987e362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:42.054263 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fb939-dcad-4d9b-82f4-e0459987e362 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:42.054549 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fb939-dcad-4d9b-82f4-e0459987e362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:42.054886 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fb939-dcad-4d9b-82f4-e0459987e362 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:42.055746 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fb939-dcad-4d9b-82f4-e0459987e362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:42.058014 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fb939-dcad-4d9b-82f4-e0459987e362 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:42.070263 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1319/2652] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:46:42.075738 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e814abc-5839-4ec1-8215-a8e9c76f5f63 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:42.086335 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e814abc-5839-4ec1-8215-a8e9c76f5f63 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:42.091064 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716ef9a-7af9-471b-83eb-81ee30ba3fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:42.091984 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716ef9a-7af9-471b-83eb-81ee30ba3fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:42.092273 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716ef9a-7af9-471b-83eb-81ee30ba3fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:42.092554 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716ef9a-7af9-471b-83eb-81ee30ba3fbb admin admin] PATH_INFO: `/v3/projects/8c6c5fa3ba484bb0b58c01a88460d630/users/3548258c809f454299953313a8e2430b/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:42.107848 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716ef9a-7af9-471b-83eb-81ee30ba3fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c6c5fa3ba484bb0b58c01a88460d630, user_id=3548258c809f454299953313a8e2430b, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:42.110409 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716ef9a-7af9-471b-83eb-81ee30ba3fbb admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:42.125665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1334/2653] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:46:42 2022] PUT /identity/v3/projects/8c6c5fa3ba484bb0b58c01a88460d630/users/3548258c809f454299953313a8e2430b/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:42.137042 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e95a60-47d1-47ad-a020-913a9e11b29c None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:42.137332 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e95a60-47d1-47ad-a020-913a9e11b29c None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:42.137622 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e95a60-47d1-47ad-a020-913a9e11b29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:42.165768 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-d2e95a60-47d1-47ad-a020-913a9e11b29c None None] MFA Rules not processed for user `3548258c809f454299953313a8e2430b`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:42.166985 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-d2e95a60-47d1-47ad-a020-913a9e11b29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:42.233134 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1320/2654] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:46:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:42.237729 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716ef9a-7af9-471b-83eb-81ee30ba3fbb admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:42.302669 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716ef9a-7af9-471b-83eb-81ee30ba3fbb admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:42.307940 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ec582-c662-4de3-b456-4b88ea7d0795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:42.308606 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ec582-c662-4de3-b456-4b88ea7d0795 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:42.308897 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ec582-c662-4de3-b456-4b88ea7d0795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:42.309178 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ec582-c662-4de3-b456-4b88ea7d0795 admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:42.309881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ec582-c662-4de3-b456-4b88ea7d0795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:42.311908 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ec582-c662-4de3-b456-4b88ea7d0795 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:42.338570 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1335/2655] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:46:42 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:46:42.342934 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e95a60-47d1-47ad-a020-913a9e11b29c None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:42.353961 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e95a60-47d1-47ad-a020-913a9e11b29c None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:42.420138 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c0978-dac1-468c-a8a6-81f4d64ff9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:42.420733 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c0978-dac1-468c-a8a6-81f4d64ff9eb admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:42.421024 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c0978-dac1-468c-a8a6-81f4d64ff9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:42.421307 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c0978-dac1-468c-a8a6-81f4d64ff9eb admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:42.422017 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c0978-dac1-468c-a8a6-81f4d64ff9eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:42.423985 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c0978-dac1-468c-a8a6-81f4d64ff9eb admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:42.445628 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1321/2656] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:46:42 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:46:42.450294 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ec582-c662-4de3-b456-4b88ea7d0795 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:42.460826 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ec582-c662-4de3-b456-4b88ea7d0795 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:42.465612 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ac660-d7a1-4b7c-a012-546cd41b15fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:42.466290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ac660-d7a1-4b7c-a012-546cd41b15fc admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:42.466584 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ac660-d7a1-4b7c-a012-546cd41b15fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:42.466868 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ac660-d7a1-4b7c-a012-546cd41b15fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:42.467773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ac660-d7a1-4b7c-a012-546cd41b15fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:42.469384 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ac660-d7a1-4b7c-a012-546cd41b15fc admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:42.481306 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1336/2657] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:46:42.485943 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c0978-dac1-468c-a8a6-81f4d64ff9eb admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:42.496858 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c0978-dac1-468c-a8a6-81f4d64ff9eb admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:42.501732 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d911902-02f4-4e77-8e56-73873ef2621e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:42.502637 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d911902-02f4-4e77-8e56-73873ef2621e admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:42.502920 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d911902-02f4-4e77-8e56-73873ef2621e admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:42.503202 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d911902-02f4-4e77-8e56-73873ef2621e admin admin] PATH_INFO: `/v3/projects/a1498fe0f0244812a09c0c44ab07a5b2/users/db166279eb374c42a1d5b0fecb44d9ed/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:42.506739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:42.520504 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d911902-02f4-4e77-8e56-73873ef2621e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1498fe0f0244812a09c0c44ab07a5b2, user_id=db166279eb374c42a1d5b0fecb44d9ed, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:42.523153 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d911902-02f4-4e77-8e56-73873ef2621e admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:42.545644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1322/2658] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:46:42 2022] PUT /identity/v3/projects/a1498fe0f0244812a09c0c44ab07a5b2/users/db166279eb374c42a1d5b0fecb44d9ed/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:42.549793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ac660-d7a1-4b7c-a012-546cd41b15fc admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:42.560507 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ac660-d7a1-4b7c-a012-546cd41b15fc admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:42.624094 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996698b-6dde-408d-a3bb-1b57f307aef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:42.625140 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996698b-6dde-408d-a3bb-1b57f307aef7 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:42.625449 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996698b-6dde-408d-a3bb-1b57f307aef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:42.625762 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996698b-6dde-408d-a3bb-1b57f307aef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:42.626629 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996698b-6dde-408d-a3bb-1b57f307aef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:42.629088 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996698b-6dde-408d-a3bb-1b57f307aef7 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:42.642477 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1337/2659] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:46:42.646734 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d911902-02f4-4e77-8e56-73873ef2621e admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:42.658381 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d911902-02f4-4e77-8e56-73873ef2621e admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:42.663212 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e0fc6-af9d-4fd6-a4c8-bb3104bda91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:42.664135 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e0fc6-af9d-4fd6-a4c8-bb3104bda91b admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:42.664425 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e0fc6-af9d-4fd6-a4c8-bb3104bda91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:42.664708 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e0fc6-af9d-4fd6-a4c8-bb3104bda91b admin admin] PATH_INFO: `/v3/projects/a1498fe0f0244812a09c0c44ab07a5b2/users/db166279eb374c42a1d5b0fecb44d9ed/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:42.666713 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e0fc6-af9d-4fd6-a4c8-bb3104bda91b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1498fe0f0244812a09c0c44ab07a5b2, user_id=db166279eb374c42a1d5b0fecb44d9ed, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:42.669464 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e0fc6-af9d-4fd6-a4c8-bb3104bda91b admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:42.680487 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1323/2660] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:46:42 2022] PUT /identity/v3/projects/a1498fe0f0244812a09c0c44ab07a5b2/users/db166279eb374c42a1d5b0fecb44d9ed/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:42.692318 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dcf8e-e8a0-4a47-9597-68ac4c27d8f2 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:42.692610 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dcf8e-e8a0-4a47-9597-68ac4c27d8f2 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:42.692923 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dcf8e-e8a0-4a47-9597-68ac4c27d8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:42.719703 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-796dcf8e-e8a0-4a47-9597-68ac4c27d8f2 None None] MFA Rules not processed for user `db166279eb374c42a1d5b0fecb44d9ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:46:42.720913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-796dcf8e-e8a0-4a47-9597-68ac4c27d8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:42.729593 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:42.788633 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1338/2661] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:46:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:46:42.800312 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e0fc6-af9d-4fd6-a4c8-bb3104bda91b admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:42.802050 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-b69e0fc6-af9d-4fd6-a4c8-bb3104bda91b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:42.859352 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e0fc6-af9d-4fd6-a4c8-bb3104bda91b admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:42.863036 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a78051-b0ad-4e85-a968-0b963e1f4c26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:42.863721 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a78051-b0ad-4e85-a968-0b963e1f4c26 service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:42.864006 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a78051-b0ad-4e85-a968-0b963e1f4c26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:42.864287 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a78051-b0ad-4e85-a968-0b963e1f4c26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:42.874085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a78051-b0ad-4e85-a968-0b963e1f4c26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:42.875550 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a78051-b0ad-4e85-a968-0b963e1f4c26 service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:42.885717 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1324/2662] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:42.961224 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796dcf8e-e8a0-4a47-9597-68ac4c27d8f2 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:42.971441 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796dcf8e-e8a0-4a47-9597-68ac4c27d8f2 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:42.975097 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e608e06-8bd5-459d-b6bd-a8e6ae646021 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:42.975857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e608e06-8bd5-459d-b6bd-a8e6ae646021 service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:42.976160 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e608e06-8bd5-459d-b6bd-a8e6ae646021 service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:42.976423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e608e06-8bd5-459d-b6bd-a8e6ae646021 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:43.037249 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e608e06-8bd5-459d-b6bd-a8e6ae646021 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:43.038689 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e608e06-8bd5-459d-b6bd-a8e6ae646021 service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:43.048829 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1339/2663] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:52.881071 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=37,keystone:INSERT=2 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:53.044491 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=53 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:12.428821 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a78051-b0ad-4e85-a968-0b963e1f4c26 service cinder] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:12.493790 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a78051-b0ad-4e85-a968-0b963e1f4c26 service cinder] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:12.498532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b98e1-8cb0-4878-a655-2fefa4728559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:12.499448 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b98e1-8cb0-4878-a655-2fefa4728559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:12.499735 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b98e1-8cb0-4878-a655-2fefa4728559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:12.500016 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b98e1-8cb0-4878-a655-2fefa4728559 admin admin] PATH_INFO: `/v3/users/3548258c809f454299953313a8e2430b` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:12.501215 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b98e1-8cb0-4878-a655-2fefa4728559 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3548258c809f454299953313a8e2430b)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:12.503131 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b98e1-8cb0-4878-a655-2fefa4728559 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:12.553546 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-d94b98e1-8cb0-4878-a655-2fefa4728559 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3548258c809f454299953313a8e2430b'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:12.570280 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-d94b98e1-8cb0-4878-a655-2fefa4728559 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3548258c809f454299953313a8e2430b'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:12.578225 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-d94b98e1-8cb0-4878-a655-2fefa4728559 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3548258c809f454299953313a8e2430b'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:12.578996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-d94b98e1-8cb0-4878-a655-2fefa4728559 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3548258c809f454299953313a8e2430b'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:12.579643 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-d94b98e1-8cb0-4878-a655-2fefa4728559 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3548258c809f454299953313a8e2430b'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:12.595777 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1325/2664] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:47:12 2022] DELETE /identity/v3/users/3548258c809f454299953313a8e2430b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:12.600833 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9c34b-6ecd-4d03-b749-5f5aef8e9c13 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:12.601320 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9c34b-6ecd-4d03-b749-5f5aef8e9c13 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:12.601549 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9c34b-6ecd-4d03-b749-5f5aef8e9c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:12.620133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-6cb9c34b-6ecd-4d03-b749-5f5aef8e9c13 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:12.621339 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-6cb9c34b-6ecd-4d03-b749-5f5aef8e9c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:12.682652 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1340/2665] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:12.692253 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b98e1-8cb0-4878-a655-2fefa4728559 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:12.693660 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-d94b98e1-8cb0-4878-a655-2fefa4728559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:12.750059 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b98e1-8cb0-4878-a655-2fefa4728559 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:12.753611 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263b67f-71b0-4c95-9b07-4e5153d58beb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:12.754253 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263b67f-71b0-4c95-9b07-4e5153d58beb service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:12.754528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263b67f-71b0-4c95-9b07-4e5153d58beb service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:12.754800 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263b67f-71b0-4c95-9b07-4e5153d58beb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:12.764319 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263b67f-71b0-4c95-9b07-4e5153d58beb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:12.766020 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263b67f-71b0-4c95-9b07-4e5153d58beb service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:12.775335 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1326/2666] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:13.294514 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9c34b-6ecd-4d03-b749-5f5aef8e9c13 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:13.295967 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-6cb9c34b-6ecd-4d03-b749-5f5aef8e9c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:13.310563 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9c34b-6ecd-4d03-b749-5f5aef8e9c13 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:13.315148 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24f3d6-6a0b-40f1-9e87-e4855220df1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:13.316710 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24f3d6-6a0b-40f1-9e87-e4855220df1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:13.317001 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24f3d6-6a0b-40f1-9e87-e4855220df1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:13.317291 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24f3d6-6a0b-40f1-9e87-e4855220df1e admin admin] PATH_INFO: `/v3/projects/8c6c5fa3ba484bb0b58c01a88460d630` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:13.318770 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24f3d6-6a0b-40f1-9e87-e4855220df1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c6c5fa3ba484bb0b58c01a88460d630)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:13.320820 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24f3d6-6a0b-40f1-9e87-e4855220df1e admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:13.368338 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-9e24f3d6-6a0b-40f1-9e87-e4855220df1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c6c5fa3ba484bb0b58c01a88460d630', 'request_id': 'req-9e24f3d6-6a0b-40f1-9e87-e4855220df1e'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:13.375610 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-9e24f3d6-6a0b-40f1-9e87-e4855220df1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c6c5fa3ba484bb0b58c01a88460d630', 'request_id': 'req-9e24f3d6-6a0b-40f1-9e87-e4855220df1e'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:13.383108 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-9e24f3d6-6a0b-40f1-9e87-e4855220df1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c6c5fa3ba484bb0b58c01a88460d630', 'request_id': 'req-9e24f3d6-6a0b-40f1-9e87-e4855220df1e'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:13.394572 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-9e24f3d6-6a0b-40f1-9e87-e4855220df1e admin admin] The token cache is being invalidate because project 8c6c5fa3ba484bb0b58c01a88460d630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:47:13.394826 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-9e24f3d6-6a0b-40f1-9e87-e4855220df1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:13.395494 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-9e24f3d6-6a0b-40f1-9e87-e4855220df1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:13.397059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1341/2667] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:47:13 2022] DELETE /identity/v3/projects/8c6c5fa3ba484bb0b58c01a88460d630 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:13.400989 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263b67f-71b0-4c95-9b07-4e5153d58beb service neutron] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:13.410648 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263b67f-71b0-4c95-9b07-4e5153d58beb service neutron] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:13.428747 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:13.469676 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114610b-cb5f-4d91-8bef-3be97625806f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:13.470561 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114610b-cb5f-4d91-8bef-3be97625806f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:13.470852 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114610b-cb5f-4d91-8bef-3be97625806f admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:13.471135 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114610b-cb5f-4d91-8bef-3be97625806f admin admin] PATH_INFO: `/v3/users/db166279eb374c42a1d5b0fecb44d9ed` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:13.472389 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114610b-cb5f-4d91-8bef-3be97625806f admin admin] RBAC: Authorizing `identity:delete_user(user_id=db166279eb374c42a1d5b0fecb44d9ed)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:13.474315 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114610b-cb5f-4d91-8bef-3be97625806f admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:13.522039 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-b114610b-cb5f-4d91-8bef-3be97625806f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db166279eb374c42a1d5b0fecb44d9ed'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:13.533764 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-b114610b-cb5f-4d91-8bef-3be97625806f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db166279eb374c42a1d5b0fecb44d9ed'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:13.540668 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-b114610b-cb5f-4d91-8bef-3be97625806f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db166279eb374c42a1d5b0fecb44d9ed'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:13.541282 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-b114610b-cb5f-4d91-8bef-3be97625806f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db166279eb374c42a1d5b0fecb44d9ed'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:13.541889 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-b114610b-cb5f-4d91-8bef-3be97625806f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db166279eb374c42a1d5b0fecb44d9ed'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:13.555699 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1327/2668] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:47:13 2022] DELETE /identity/v3/users/db166279eb374c42a1d5b0fecb44d9ed => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:13.914561 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24f3d6-6a0b-40f1-9e87-e4855220df1e admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:13.917832 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-9e24f3d6-6a0b-40f1-9e87-e4855220df1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:13.932148 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24f3d6-6a0b-40f1-9e87-e4855220df1e admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:13.993479 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce82e3d-9e07-4e34-bbf8-2bbc159ddb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:13.994353 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce82e3d-9e07-4e34-bbf8-2bbc159ddb94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:13.994643 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce82e3d-9e07-4e34-bbf8-2bbc159ddb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:13.994927 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce82e3d-9e07-4e34-bbf8-2bbc159ddb94 admin admin] PATH_INFO: `/v3/projects/a1498fe0f0244812a09c0c44ab07a5b2` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:13.996172 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce82e3d-9e07-4e34-bbf8-2bbc159ddb94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1498fe0f0244812a09c0c44ab07a5b2)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:13.998123 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce82e3d-9e07-4e34-bbf8-2bbc159ddb94 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:14.032308 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:14.052559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2ce82e3d-9e07-4e34-bbf8-2bbc159ddb94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1498fe0f0244812a09c0c44ab07a5b2', 'request_id': 'req-2ce82e3d-9e07-4e34-bbf8-2bbc159ddb94'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:14.058820 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2ce82e3d-9e07-4e34-bbf8-2bbc159ddb94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1498fe0f0244812a09c0c44ab07a5b2', 'request_id': 'req-2ce82e3d-9e07-4e34-bbf8-2bbc159ddb94'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:14.066543 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2ce82e3d-9e07-4e34-bbf8-2bbc159ddb94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1498fe0f0244812a09c0c44ab07a5b2', 'request_id': 'req-2ce82e3d-9e07-4e34-bbf8-2bbc159ddb94'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:14.080558 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2ce82e3d-9e07-4e34-bbf8-2bbc159ddb94 admin admin] The token cache is being invalidate because project a1498fe0f0244812a09c0c44ab07a5b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:47:14.080795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2ce82e3d-9e07-4e34-bbf8-2bbc159ddb94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:14.081473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2ce82e3d-9e07-4e34-bbf8-2bbc159ddb94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:14.083103 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1342/2669] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:47:13 2022] DELETE /identity/v3/projects/a1498fe0f0244812a09c0c44ab07a5b2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:14.088291 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52398597-8218-4480-8af9-e2c18df185e3 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:14.088588 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52398597-8218-4480-8af9-e2c18df185e3 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:14.088874 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52398597-8218-4480-8af9-e2c18df185e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:14.110827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-52398597-8218-4480-8af9-e2c18df185e3 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:14.112097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-52398597-8218-4480-8af9-e2c18df185e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:14.175339 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1328/2670] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:14.183128 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c813d4-a30d-4de2-9571-364031dc3b1b None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:14.183450 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c813d4-a30d-4de2-9571-364031dc3b1b None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:14.183740 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c813d4-a30d-4de2-9571-364031dc3b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:14.202724 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-32c813d4-a30d-4de2-9571-364031dc3b1b None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:14.203938 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-32c813d4-a30d-4de2-9571-364031dc3b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:14.211781 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1343/2671] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:14.216828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52398597-8218-4480-8af9-e2c18df185e3 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:14.226325 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52398597-8218-4480-8af9-e2c18df185e3 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:14.231493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a8a60-c90a-47cf-8300-bc88a76a406a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:14.232163 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a8a60-c90a-47cf-8300-bc88a76a406a admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:14.232453 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a8a60-c90a-47cf-8300-bc88a76a406a admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:14.232735 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a8a60-c90a-47cf-8300-bc88a76a406a admin admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:14.233506 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a8a60-c90a-47cf-8300-bc88a76a406a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:47:14.233820 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a8a60-c90a-47cf-8300-bc88a76a406a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:14.235474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a8a60-c90a-47cf-8300-bc88a76a406a admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:14.247242 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1329/2672] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:47:14.251648 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c813d4-a30d-4de2-9571-364031dc3b1b None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:14.261340 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c813d4-a30d-4de2-9571-364031dc3b1b None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:14.266836 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb939bd2-df5d-4cfb-990d-0e7398400b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:14.267527 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb939bd2-df5d-4cfb-990d-0e7398400b25 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:14.267821 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb939bd2-df5d-4cfb-990d-0e7398400b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:14.268104 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb939bd2-df5d-4cfb-990d-0e7398400b25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:14.268802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb939bd2-df5d-4cfb-990d-0e7398400b25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:14.270694 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb939bd2-df5d-4cfb-990d-0e7398400b25 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:14.296705 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1344/2673] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:47:14 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:47:14.300895 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a8a60-c90a-47cf-8300-bc88a76a406a admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:14.310972 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a8a60-c90a-47cf-8300-bc88a76a406a admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:14.339561 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:14.374961 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8cc86-7d98-4b77-9766-b5fb3e52c382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:14.375941 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8cc86-7d98-4b77-9766-b5fb3e52c382 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:14.376250 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8cc86-7d98-4b77-9766-b5fb3e52c382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:14.376527 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8cc86-7d98-4b77-9766-b5fb3e52c382 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:14.377218 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8cc86-7d98-4b77-9766-b5fb3e52c382 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:14.379110 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8cc86-7d98-4b77-9766-b5fb3e52c382 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:14.400122 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1330/2674] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:47:14 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:47:14.405064 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb939bd2-df5d-4cfb-990d-0e7398400b25 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:14.415429 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb939bd2-df5d-4cfb-990d-0e7398400b25 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:14.420022 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37499a93-f30b-46de-9e94-0f031903d6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:14.420716 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37499a93-f30b-46de-9e94-0f031903d6ed admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:14.420998 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37499a93-f30b-46de-9e94-0f031903d6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:14.421275 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37499a93-f30b-46de-9e94-0f031903d6ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:14.422001 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37499a93-f30b-46de-9e94-0f031903d6ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:14.423623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37499a93-f30b-46de-9e94-0f031903d6ed admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:14.434313 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1345/2675] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:14.438379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8cc86-7d98-4b77-9766-b5fb3e52c382 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:14.448642 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8cc86-7d98-4b77-9766-b5fb3e52c382 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:14.454124 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a6084-aa15-4ded-b5f0-dd8ca044862f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:14.454821 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a6084-aa15-4ded-b5f0-dd8ca044862f admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:14.455114 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a6084-aa15-4ded-b5f0-dd8ca044862f admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:14.455432 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a6084-aa15-4ded-b5f0-dd8ca044862f admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:14.456167 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a6084-aa15-4ded-b5f0-dd8ca044862f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:14.457761 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a6084-aa15-4ded-b5f0-dd8ca044862f admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:14.468889 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1331/2676] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:14.473030 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37499a93-f30b-46de-9e94-0f031903d6ed admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:14.483380 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37499a93-f30b-46de-9e94-0f031903d6ed admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:14.488179 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189a1ec-2601-412e-bfb5-7967014765cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:14.489064 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189a1ec-2601-412e-bfb5-7967014765cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:14.489353 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189a1ec-2601-412e-bfb5-7967014765cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:14.489635 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189a1ec-2601-412e-bfb5-7967014765cf admin admin] PATH_INFO: `/v3/projects/21795c999b484729aef1ff23ee15fbfa/users/83a924b9cb2a41c0b4d103a13beecf72/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:14.504260 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189a1ec-2601-412e-bfb5-7967014765cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=21795c999b484729aef1ff23ee15fbfa, user_id=83a924b9cb2a41c0b4d103a13beecf72, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:14.506893 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189a1ec-2601-412e-bfb5-7967014765cf admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:14.522981 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1346/2677] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:14 2022] PUT /identity/v3/projects/21795c999b484729aef1ff23ee15fbfa/users/83a924b9cb2a41c0b4d103a13beecf72/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:14.534101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a357b2-6e4d-4445-80b2-951806744dcf None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:14.534616 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a357b2-6e4d-4445-80b2-951806744dcf None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:14.534735 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a357b2-6e4d-4445-80b2-951806744dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:14.563126 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-e0a357b2-6e4d-4445-80b2-951806744dcf None None] MFA Rules not processed for user `83a924b9cb2a41c0b4d103a13beecf72`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:14.564503 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-e0a357b2-6e4d-4445-80b2-951806744dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:14.630949 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1332/2678] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:14.635546 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189a1ec-2601-412e-bfb5-7967014765cf admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:14.701163 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189a1ec-2601-412e-bfb5-7967014765cf admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:14.706065 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5e6e3-6a11-49ec-b3c6-1a06259de868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:14.706732 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5e6e3-6a11-49ec-b3c6-1a06259de868 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:14.707048 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5e6e3-6a11-49ec-b3c6-1a06259de868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:14.707360 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5e6e3-6a11-49ec-b3c6-1a06259de868 admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:14.708083 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5e6e3-6a11-49ec-b3c6-1a06259de868 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:14.709975 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5e6e3-6a11-49ec-b3c6-1a06259de868 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:14.741995 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1347/2679] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:47:14 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:47:14.748192 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a357b2-6e4d-4445-80b2-951806744dcf None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:14.758961 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a357b2-6e4d-4445-80b2-951806744dcf None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:14.815097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c359ac-de1f-4792-872e-572e622ad722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:14.815802 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c359ac-de1f-4792-872e-572e622ad722 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:14.816084 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c359ac-de1f-4792-872e-572e622ad722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:14.816362 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c359ac-de1f-4792-872e-572e622ad722 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:14.817064 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c359ac-de1f-4792-872e-572e622ad722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:14.818948 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c359ac-de1f-4792-872e-572e622ad722 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:14.844694 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1333/2680] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:47:14 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:47:14.849845 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5e6e3-6a11-49ec-b3c6-1a06259de868 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:14.861773 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5e6e3-6a11-49ec-b3c6-1a06259de868 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:14.867456 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c330b2-54d7-4099-bd16-29acfb7df816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:14.868128 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c330b2-54d7-4099-bd16-29acfb7df816 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:14.868413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c330b2-54d7-4099-bd16-29acfb7df816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:14.868689 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c330b2-54d7-4099-bd16-29acfb7df816 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:14.869425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c330b2-54d7-4099-bd16-29acfb7df816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:14.871134 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c330b2-54d7-4099-bd16-29acfb7df816 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:14.888650 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1348/2681] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:14.889754 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c359ac-de1f-4792-872e-572e622ad722 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:14.900738 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c359ac-de1f-4792-872e-572e622ad722 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:14.905947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bbfd8d-18af-4d84-bec1-8351f9ad73e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:14.907042 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbfd8d-18af-4d84-bec1-8351f9ad73e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:14.907431 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbfd8d-18af-4d84-bec1-8351f9ad73e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:14.908423 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbfd8d-18af-4d84-bec1-8351f9ad73e5 admin admin] PATH_INFO: `/v3/projects/fe30a14569be478f88126716c43e0bdf/users/5af4c7c4addb4afbb998afebfa07fc5b/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:14.929590 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bbfd8d-18af-4d84-bec1-8351f9ad73e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe30a14569be478f88126716c43e0bdf, user_id=5af4c7c4addb4afbb998afebfa07fc5b, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:14.932427 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bbfd8d-18af-4d84-bec1-8351f9ad73e5 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:14.952046 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1334/2682] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:14 2022] PUT /identity/v3/projects/fe30a14569be478f88126716c43e0bdf/users/5af4c7c4addb4afbb998afebfa07fc5b/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:14.953488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c330b2-54d7-4099-bd16-29acfb7df816 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:14.966205 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c330b2-54d7-4099-bd16-29acfb7df816 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:14.987962 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:15.027847 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225cbb4-9d2e-49d0-b834-b7410b01a791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:15.028835 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225cbb4-9d2e-49d0-b834-b7410b01a791 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:15.029126 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225cbb4-9d2e-49d0-b834-b7410b01a791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:15.029408 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225cbb4-9d2e-49d0-b834-b7410b01a791 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:15.030145 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225cbb4-9d2e-49d0-b834-b7410b01a791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:15.031752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225cbb4-9d2e-49d0-b834-b7410b01a791 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:15.042027 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1349/2683] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:15.046882 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bbfd8d-18af-4d84-bec1-8351f9ad73e5 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:15.052472 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:15.059207 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bbfd8d-18af-4d84-bec1-8351f9ad73e5 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:15.065032 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9efba-165a-4c1d-9806-3403deab9774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:15.066013 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9efba-165a-4c1d-9806-3403deab9774 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:15.066371 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9efba-165a-4c1d-9806-3403deab9774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:15.066721 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9efba-165a-4c1d-9806-3403deab9774 admin admin] PATH_INFO: `/v3/projects/fe30a14569be478f88126716c43e0bdf/users/5af4c7c4addb4afbb998afebfa07fc5b/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:15.068876 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9efba-165a-4c1d-9806-3403deab9774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe30a14569be478f88126716c43e0bdf, user_id=5af4c7c4addb4afbb998afebfa07fc5b, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:15.071621 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9efba-165a-4c1d-9806-3403deab9774 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:15.082152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1335/2684] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:15 2022] PUT /identity/v3/projects/fe30a14569be478f88126716c43e0bdf/users/5af4c7c4addb4afbb998afebfa07fc5b/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:15.145494 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26c41f-363e-4309-951e-bf1aa9d4f5f9 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:15.145794 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26c41f-363e-4309-951e-bf1aa9d4f5f9 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:15.146081 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26c41f-363e-4309-951e-bf1aa9d4f5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:15.175990 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-fc26c41f-363e-4309-951e-bf1aa9d4f5f9 None None] MFA Rules not processed for user `5af4c7c4addb4afbb998afebfa07fc5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:15.177360 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-fc26c41f-363e-4309-951e-bf1aa9d4f5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:15.261911 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1350/2685] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:15.276432 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9efba-165a-4c1d-9806-3403deab9774 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:15.279547 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-96e9efba-165a-4c1d-9806-3403deab9774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:15.354678 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9efba-165a-4c1d-9806-3403deab9774 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:15.360701 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bc997-e6b0-4093-b6ca-f300bbe64f18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:15.360885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bc997-e6b0-4093-b6ca-f300bbe64f18 service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:15.361587 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bc997-e6b0-4093-b6ca-f300bbe64f18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:15.361587 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bc997-e6b0-4093-b6ca-f300bbe64f18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:15.377076 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0bc997-e6b0-4093-b6ca-f300bbe64f18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:15.379085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0bc997-e6b0-4093-b6ca-f300bbe64f18 service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:15.392726 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1336/2686] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:15.473330 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26c41f-363e-4309-951e-bf1aa9d4f5f9 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:15.485508 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26c41f-363e-4309-951e-bf1aa9d4f5f9 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:15.489389 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f2026-9081-4488-a2b0-8f7ef90740ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:15.490164 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f2026-9081-4488-a2b0-8f7ef90740ed service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:15.490518 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f2026-9081-4488-a2b0-8f7ef90740ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:15.490867 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f2026-9081-4488-a2b0-8f7ef90740ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:15.553640 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f2026-9081-4488-a2b0-8f7ef90740ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:15.554990 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f2026-9081-4488-a2b0-8f7ef90740ed service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:15.564290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1351/2687] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:20.328848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bc997-e6b0-4093-b6ca-f300bbe64f18 service cinder] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:20.330279 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-3f0bc997-e6b0-4093-b6ca-f300bbe64f18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:20.392568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bc997-e6b0-4093-b6ca-f300bbe64f18 service cinder] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:20.396423 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218c8dc-e76c-4f48-a81d-db877819827d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:20.397081 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218c8dc-e76c-4f48-a81d-db877819827d service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:20.397373 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218c8dc-e76c-4f48-a81d-db877819827d service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:20.397655 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218c8dc-e76c-4f48-a81d-db877819827d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:20.399515 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-8218c8dc-e76c-4f48-a81d-db877819827d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:20.462766 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8218c8dc-e76c-4f48-a81d-db877819827d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:20.464236 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8218c8dc-e76c-4f48-a81d-db877819827d service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:20.474594 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1337/2688] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:22.406841 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f2026-9081-4488-a2b0-8f7ef90740ed service cinder] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:22.418259 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f2026-9081-4488-a2b0-8f7ef90740ed service cinder] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:22.431593 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66691b8a-a2b7-4ddd-9a07-4b97da4233dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:22.432777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66691b8a-a2b7-4ddd-9a07-4b97da4233dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:22.433159 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66691b8a-a2b7-4ddd-9a07-4b97da4233dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:22.433624 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66691b8a-a2b7-4ddd-9a07-4b97da4233dc admin admin] PATH_INFO: `/v3/users/83a924b9cb2a41c0b4d103a13beecf72` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:22.435843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66691b8a-a2b7-4ddd-9a07-4b97da4233dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=83a924b9cb2a41c0b4d103a13beecf72)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:22.437927 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66691b8a-a2b7-4ddd-9a07-4b97da4233dc admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:22.493936 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:22.507022 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-66691b8a-a2b7-4ddd-9a07-4b97da4233dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83a924b9cb2a41c0b4d103a13beecf72'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:22.524656 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-66691b8a-a2b7-4ddd-9a07-4b97da4233dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83a924b9cb2a41c0b4d103a13beecf72'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:22.533674 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-66691b8a-a2b7-4ddd-9a07-4b97da4233dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83a924b9cb2a41c0b4d103a13beecf72'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:22.534551 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-66691b8a-a2b7-4ddd-9a07-4b97da4233dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83a924b9cb2a41c0b4d103a13beecf72'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:22.535281 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-66691b8a-a2b7-4ddd-9a07-4b97da4233dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83a924b9cb2a41c0b4d103a13beecf72'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:22.557285 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1352/2689] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:47:22 2022] DELETE /identity/v3/users/83a924b9cb2a41c0b4d103a13beecf72 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:22.563157 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ff86c-1c59-429f-a7fb-e2fb749aff62 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:22.563755 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ff86c-1c59-429f-a7fb-e2fb749aff62 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:22.564097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ff86c-1c59-429f-a7fb-e2fb749aff62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:22.590474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-d03ff86c-1c59-429f-a7fb-e2fb749aff62 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:22.592975 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-d03ff86c-1c59-429f-a7fb-e2fb749aff62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:22.654690 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:22.690288 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1338/2690] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:47:22.706734 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66691b8a-a2b7-4ddd-9a07-4b97da4233dc admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:22.708303 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-66691b8a-a2b7-4ddd-9a07-4b97da4233dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:22.804402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66691b8a-a2b7-4ddd-9a07-4b97da4233dc admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:22.809812 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1ba35-baff-46df-abab-fa23f765e892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:22.810594 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1ba35-baff-46df-abab-fa23f765e892 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:22.810946 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1ba35-baff-46df-abab-fa23f765e892 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:22.811365 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1ba35-baff-46df-abab-fa23f765e892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:22.822879 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1ba35-baff-46df-abab-fa23f765e892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:22.824473 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1ba35-baff-46df-abab-fa23f765e892 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:22.835887 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1353/2691] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:23.317669 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ff86c-1c59-429f-a7fb-e2fb749aff62 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:23.319286 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-d03ff86c-1c59-429f-a7fb-e2fb749aff62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:23.337780 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ff86c-1c59-429f-a7fb-e2fb749aff62 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:23.343844 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e68e15-482c-48a7-a2ba-cd92f23e0e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:23.345028 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e68e15-482c-48a7-a2ba-cd92f23e0e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:23.345318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e68e15-482c-48a7-a2ba-cd92f23e0e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:23.345600 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e68e15-482c-48a7-a2ba-cd92f23e0e78 admin admin] PATH_INFO: `/v3/projects/21795c999b484729aef1ff23ee15fbfa` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:23.346957 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e68e15-482c-48a7-a2ba-cd92f23e0e78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21795c999b484729aef1ff23ee15fbfa)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:23.349492 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e68e15-482c-48a7-a2ba-cd92f23e0e78 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:23.415492 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-63e68e15-482c-48a7-a2ba-cd92f23e0e78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21795c999b484729aef1ff23ee15fbfa', 'request_id': 'req-63e68e15-482c-48a7-a2ba-cd92f23e0e78'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:23.422930 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-63e68e15-482c-48a7-a2ba-cd92f23e0e78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21795c999b484729aef1ff23ee15fbfa', 'request_id': 'req-63e68e15-482c-48a7-a2ba-cd92f23e0e78'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:23.432806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-63e68e15-482c-48a7-a2ba-cd92f23e0e78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21795c999b484729aef1ff23ee15fbfa', 'request_id': 'req-63e68e15-482c-48a7-a2ba-cd92f23e0e78'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:23.447137 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-63e68e15-482c-48a7-a2ba-cd92f23e0e78 admin admin] The token cache is being invalidate because project 21795c999b484729aef1ff23ee15fbfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:47:23.447609 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-63e68e15-482c-48a7-a2ba-cd92f23e0e78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:23.448480 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-63e68e15-482c-48a7-a2ba-cd92f23e0e78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:23.450518 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1339/2692] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:47:23 2022] DELETE /identity/v3/projects/21795c999b484729aef1ff23ee15fbfa => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:47:23.454761 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1ba35-baff-46df-abab-fa23f765e892 service neutron] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:23.465476 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1ba35-baff-46df-abab-fa23f765e892 service neutron] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:23.531379 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5b568-5392-45cf-a112-8406a21d7f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:23.532430 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5b568-5392-45cf-a112-8406a21d7f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:23.532824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5b568-5392-45cf-a112-8406a21d7f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:23.533209 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5b568-5392-45cf-a112-8406a21d7f4b admin admin] PATH_INFO: `/v3/users/5af4c7c4addb4afbb998afebfa07fc5b` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:23.534670 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a5b568-5392-45cf-a112-8406a21d7f4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5af4c7c4addb4afbb998afebfa07fc5b)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:23.537202 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a5b568-5392-45cf-a112-8406a21d7f4b admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:23.592704 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-09a5b568-5392-45cf-a112-8406a21d7f4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5af4c7c4addb4afbb998afebfa07fc5b'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:23.608018 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:23.612872 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-09a5b568-5392-45cf-a112-8406a21d7f4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5af4c7c4addb4afbb998afebfa07fc5b'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:23.633520 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-09a5b568-5392-45cf-a112-8406a21d7f4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5af4c7c4addb4afbb998afebfa07fc5b'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:23.635070 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-09a5b568-5392-45cf-a112-8406a21d7f4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5af4c7c4addb4afbb998afebfa07fc5b'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:23.635889 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-09a5b568-5392-45cf-a112-8406a21d7f4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5af4c7c4addb4afbb998afebfa07fc5b'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:23.655952 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1354/2693] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:47:23 2022] DELETE /identity/v3/users/5af4c7c4addb4afbb998afebfa07fc5b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:23.888825 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e68e15-482c-48a7-a2ba-cd92f23e0e78 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:23.890602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-63e68e15-482c-48a7-a2ba-cd92f23e0e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:23.961521 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5b568-5392-45cf-a112-8406a21d7f4b admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:23.963742 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-09a5b568-5392-45cf-a112-8406a21d7f4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:23.985135 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e68e15-482c-48a7-a2ba-cd92f23e0e78 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:24.048514 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5b568-5392-45cf-a112-8406a21d7f4b admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:24.053123 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed939129-4820-408b-98d7-41b0e944321e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:24.054273 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed939129-4820-408b-98d7-41b0e944321e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:24.054417 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed939129-4820-408b-98d7-41b0e944321e admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:24.054689 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed939129-4820-408b-98d7-41b0e944321e admin admin] PATH_INFO: `/v3/users/7f462366c9564bb6ac7d01b820d64d37` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:24.056242 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed939129-4820-408b-98d7-41b0e944321e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f462366c9564bb6ac7d01b820d64d37)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:24.058147 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed939129-4820-408b-98d7-41b0e944321e admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:24.063348 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444c2e6-d325-42d6-b53c-8c94b2f5fc14 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a27fe78683743c397fe7929e9053c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:24.064086 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444c2e6-d325-42d6-b53c-8c94b2f5fc14 service placement] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:24.064380 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444c2e6-d325-42d6-b53c-8c94b2f5fc14 service placement] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:24.064666 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444c2e6-d325-42d6-b53c-8c94b2f5fc14 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:24.066628 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-2444c2e6-d325-42d6-b53c-8c94b2f5fc14 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:24.080746 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444c2e6-d325-42d6-b53c-8c94b2f5fc14 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:24.083613 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444c2e6-d325-42d6-b53c-8c94b2f5fc14 service placement] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:24.090694 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:24.101057 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1340/2694] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:24.102581 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444c2e6-d325-42d6-b53c-8c94b2f5fc14 service placement] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:24.104880 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-2444c2e6-d325-42d6-b53c-8c94b2f5fc14 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:24.113315 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ed939129-4820-408b-98d7-41b0e944321e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f462366c9564bb6ac7d01b820d64d37'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:24.127017 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444c2e6-d325-42d6-b53c-8c94b2f5fc14 service placement] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:24.132958 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ed939129-4820-408b-98d7-41b0e944321e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f462366c9564bb6ac7d01b820d64d37'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:24.134299 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b3aa3-3931-47ee-9288-de0f8d84ec2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:24.135722 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b3aa3-3931-47ee-9288-de0f8d84ec2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:24.136101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b3aa3-3931-47ee-9288-de0f8d84ec2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:24.136726 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b3aa3-3931-47ee-9288-de0f8d84ec2c admin admin] PATH_INFO: `/v3/projects/fe30a14569be478f88126716c43e0bdf` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:24.139096 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b3aa3-3931-47ee-9288-de0f8d84ec2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe30a14569be478f88126716c43e0bdf)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:24.142612 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b3aa3-3931-47ee-9288-de0f8d84ec2c admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:24.145133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ed939129-4820-408b-98d7-41b0e944321e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f462366c9564bb6ac7d01b820d64d37'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:24.146184 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ed939129-4820-408b-98d7-41b0e944321e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f462366c9564bb6ac7d01b820d64d37'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:24.146960 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ed939129-4820-408b-98d7-41b0e944321e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f462366c9564bb6ac7d01b820d64d37'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:24.161641 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1355/2695] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:47:23 2022] DELETE /identity/v3/users/7f462366c9564bb6ac7d01b820d64d37 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:24.195704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-c64b3aa3-3931-47ee-9288-de0f8d84ec2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe30a14569be478f88126716c43e0bdf', 'request_id': 'req-c64b3aa3-3931-47ee-9288-de0f8d84ec2c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:24.202519 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-c64b3aa3-3931-47ee-9288-de0f8d84ec2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe30a14569be478f88126716c43e0bdf', 'request_id': 'req-c64b3aa3-3931-47ee-9288-de0f8d84ec2c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:24.211246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-c64b3aa3-3931-47ee-9288-de0f8d84ec2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe30a14569be478f88126716c43e0bdf', 'request_id': 'req-c64b3aa3-3931-47ee-9288-de0f8d84ec2c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:24.222519 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-c64b3aa3-3931-47ee-9288-de0f8d84ec2c admin admin] The token cache is being invalidate because project fe30a14569be478f88126716c43e0bdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:47:24.223369 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-c64b3aa3-3931-47ee-9288-de0f8d84ec2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:24.224040 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-c64b3aa3-3931-47ee-9288-de0f8d84ec2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:24.225613 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1341/2696] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:47:24 2022] DELETE /identity/v3/projects/fe30a14569be478f88126716c43e0bdf => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:24.230777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302a6e2-50fa-4b74-9490-988da12392d9 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:24.231098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302a6e2-50fa-4b74-9490-988da12392d9 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:24.231418 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302a6e2-50fa-4b74-9490-988da12392d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:24.251374 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-6302a6e2-50fa-4b74-9490-988da12392d9 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:24.252584 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-6302a6e2-50fa-4b74-9490-988da12392d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:24.304447 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:24.324818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1356/2697] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:24.334245 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c17dc-b860-4314-a584-45cee63a1611 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:24.334493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c17dc-b860-4314-a584-45cee63a1611 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:24.334780 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c17dc-b860-4314-a584-45cee63a1611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:24.340655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302a6e2-50fa-4b74-9490-988da12392d9 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:24.342138 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-6302a6e2-50fa-4b74-9490-988da12392d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:24.357443 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302a6e2-50fa-4b74-9490-988da12392d9 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:24.358080 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-ef0c17dc-b860-4314-a584-45cee63a1611 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:24.359267 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-ef0c17dc-b860-4314-a584-45cee63a1611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:24.363654 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85cd60-a827-41d9-9d71-f2e19a85a124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:24.364749 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85cd60-a827-41d9-9d71-f2e19a85a124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:24.365131 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85cd60-a827-41d9-9d71-f2e19a85a124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:24.365421 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85cd60-a827-41d9-9d71-f2e19a85a124 admin admin] PATH_INFO: `/v3/projects/0ed941ae19dc4183af535500c26cfee4` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:24.366680 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85cd60-a827-41d9-9d71-f2e19a85a124 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ed941ae19dc4183af535500c26cfee4)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:24.368336 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1342/2698] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:24.368667 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85cd60-a827-41d9-9d71-f2e19a85a124 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:24.373341 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c17dc-b860-4314-a584-45cee63a1611 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:24.382291 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c17dc-b860-4314-a584-45cee63a1611 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:24.387105 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08007aa9-5214-409f-ab13-8f74e475f571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:24.388367 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08007aa9-5214-409f-ab13-8f74e475f571 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:24.388652 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08007aa9-5214-409f-ab13-8f74e475f571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:24.388924 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08007aa9-5214-409f-ab13-8f74e475f571 admin admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:24.389646 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08007aa9-5214-409f-ab13-8f74e475f571 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:47:24.389949 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08007aa9-5214-409f-ab13-8f74e475f571 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:24.391823 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08007aa9-5214-409f-ab13-8f74e475f571 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:24.405138 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1343/2699] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:47:24.409298 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08007aa9-5214-409f-ab13-8f74e475f571 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:24.419150 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08007aa9-5214-409f-ab13-8f74e475f571 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:24.419517 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ed85cd60-a827-41d9-9d71-f2e19a85a124 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ed941ae19dc4183af535500c26cfee4', 'request_id': 'req-ed85cd60-a827-41d9-9d71-f2e19a85a124'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:24.425740 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ed85cd60-a827-41d9-9d71-f2e19a85a124 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ed941ae19dc4183af535500c26cfee4', 'request_id': 'req-ed85cd60-a827-41d9-9d71-f2e19a85a124'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:24.433894 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ed85cd60-a827-41d9-9d71-f2e19a85a124 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ed941ae19dc4183af535500c26cfee4', 'request_id': 'req-ed85cd60-a827-41d9-9d71-f2e19a85a124'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:24.445412 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ed85cd60-a827-41d9-9d71-f2e19a85a124 admin admin] The token cache is being invalidate because project 0ed941ae19dc4183af535500c26cfee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:47:24.445702 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ed85cd60-a827-41d9-9d71-f2e19a85a124 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:24.446366 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ed85cd60-a827-41d9-9d71-f2e19a85a124 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:24.448005 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1357/2700] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:47:24 2022] DELETE /identity/v3/projects/0ed941ae19dc4183af535500c26cfee4 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:47:24.453422 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ca9cc-d779-4681-9bf4-9724df03922c None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:24.453713 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ca9cc-d779-4681-9bf4-9724df03922c None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:24.453998 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ca9cc-d779-4681-9bf4-9724df03922c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:24.473266 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-c85ca9cc-d779-4681-9bf4-9724df03922c None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:24.474470 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-c85ca9cc-d779-4681-9bf4-9724df03922c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:24.478999 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8fc19-dd4f-4930-a540-5e430f554b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:24.479705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8fc19-dd4f-4930-a540-5e430f554b07 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:24.480055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8fc19-dd4f-4930-a540-5e430f554b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:24.480275 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8fc19-dd4f-4930-a540-5e430f554b07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:24.480970 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8fc19-dd4f-4930-a540-5e430f554b07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:24.482604 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1358/2701] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:47:24.482881 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8fc19-dd4f-4930-a540-5e430f554b07 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:24.490272 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c6f31-8322-464a-ae5f-606963fa67e3 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:24.490570 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c6f31-8322-464a-ae5f-606963fa67e3 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:24.490865 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c6f31-8322-464a-ae5f-606963fa67e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:24.511096 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-2a2c6f31-8322-464a-ae5f-606963fa67e3 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:24.515685 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1344/2702] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:47:24 2022] POST /identity/v3/projects => generated 355 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:47:24.515828 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-2a2c6f31-8322-464a-ae5f-606963fa67e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:24.516940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8fc19-dd4f-4930-a540-5e430f554b07 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:24.518968 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-faa8fc19-dd4f-4930-a540-5e430f554b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:24.569325 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:24.576265 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1359/2703] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:47:24.580336 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c6f31-8322-464a-ae5f-606963fa67e3 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:24.589518 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c6f31-8322-464a-ae5f-606963fa67e3 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:24.591209 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8fc19-dd4f-4930-a540-5e430f554b07 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:24.598480 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde68ac-1782-4674-8b2d-7701570824d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:24.598836 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff50f5-09ae-483a-95af-c85366016cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:24.599150 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde68ac-1782-4674-8b2d-7701570824d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:24.599471 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde68ac-1782-4674-8b2d-7701570824d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:24.599601 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff50f5-09ae-483a-95af-c85366016cdb admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:24.599754 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde68ac-1782-4674-8b2d-7701570824d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:24.599907 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff50f5-09ae-483a-95af-c85366016cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:24.600210 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff50f5-09ae-483a-95af-c85366016cdb admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:24.600489 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde68ac-1782-4674-8b2d-7701570824d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:47:24.600778 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff50f5-09ae-483a-95af-c85366016cdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:24.600892 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde68ac-1782-4674-8b2d-7701570824d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:24.602374 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde68ac-1782-4674-8b2d-7701570824d9 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:24.602741 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff50f5-09ae-483a-95af-c85366016cdb admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:24.615150 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1360/2704] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:47:24.619743 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde68ac-1782-4674-8b2d-7701570824d9 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:24.627254 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1345/2705] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:47:24 2022] POST /identity/v3/users => generated 278 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:47:24.631129 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff50f5-09ae-483a-95af-c85366016cdb admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:24.631513 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde68ac-1782-4674-8b2d-7701570824d9 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:24.636277 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b715a98-91f4-437a-9ea5-6bbdf5d1d4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:24.637549 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b715a98-91f4-437a-9ea5-6bbdf5d1d4d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:24.638440 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b715a98-91f4-437a-9ea5-6bbdf5d1d4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:24.638728 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b715a98-91f4-437a-9ea5-6bbdf5d1d4d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:24.639479 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b715a98-91f4-437a-9ea5-6bbdf5d1d4d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:24.641994 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b715a98-91f4-437a-9ea5-6bbdf5d1d4d3 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:24.642296 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff50f5-09ae-483a-95af-c85366016cdb admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:24.647908 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b35000-1479-476d-9538-6ab058f09f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:24.648609 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b35000-1479-476d-9538-6ab058f09f9a admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:24.648894 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b35000-1479-476d-9538-6ab058f09f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:24.649174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b35000-1479-476d-9538-6ab058f09f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:24.649918 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b35000-1479-476d-9538-6ab058f09f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:24.652104 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b35000-1479-476d-9538-6ab058f09f9a admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:24.665484 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1346/2706] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:47:24.675300 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1361/2707] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:47:24 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:47:24.675472 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b35000-1479-476d-9538-6ab058f09f9a admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:24.679633 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b715a98-91f4-437a-9ea5-6bbdf5d1d4d3 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:24.687522 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b35000-1479-476d-9538-6ab058f09f9a admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:24.731074 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:24.758295 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974486f7-a929-4759-b478-cdf1b9a70d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:24.758999 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974486f7-a929-4759-b478-cdf1b9a70d38 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:24.759323 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974486f7-a929-4759-b478-cdf1b9a70d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:24.759447 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b715a98-91f4-437a-9ea5-6bbdf5d1d4d3 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:24.759610 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974486f7-a929-4759-b478-cdf1b9a70d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:24.760355 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974486f7-a929-4759-b478-cdf1b9a70d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:24.761948 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974486f7-a929-4759-b478-cdf1b9a70d38 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:24.764771 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa034e40-2f09-44a4-8b47-f7022327d9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:24.765708 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa034e40-2f09-44a4-8b47-f7022327d9b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:24.765998 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa034e40-2f09-44a4-8b47-f7022327d9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:24.766284 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa034e40-2f09-44a4-8b47-f7022327d9b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:24.766989 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa034e40-2f09-44a4-8b47-f7022327d9b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:24.768925 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa034e40-2f09-44a4-8b47-f7022327d9b1 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:24.776759 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1347/2708] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:47:24.777413 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974486f7-a929-4759-b478-cdf1b9a70d38 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:24.788442 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974486f7-a929-4759-b478-cdf1b9a70d38 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:24.794494 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1362/2709] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:47:24 2022] POST /identity/v3/users => generated 283 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:47:24.794682 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc159e42-d66a-4755-98b1-28d314b780f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:24.794682 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc159e42-d66a-4755-98b1-28d314b780f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:24.794903 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc159e42-d66a-4755-98b1-28d314b780f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:24.795101 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc159e42-d66a-4755-98b1-28d314b780f3 admin admin] PATH_INFO: `/v3/projects/19013748aaf34e9d906bd95d63bbe4d8/users/a11d6dd1f6664c23befc07608ca6af1c/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:24.795680 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa034e40-2f09-44a4-8b47-f7022327d9b1 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:24.805936 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa034e40-2f09-44a4-8b47-f7022327d9b1 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:24.810792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac23ae5-a3bb-4e05-a131-8460ceac6a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:24.810939 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc159e42-d66a-4755-98b1-28d314b780f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19013748aaf34e9d906bd95d63bbe4d8, user_id=a11d6dd1f6664c23befc07608ca6af1c, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:24.811493 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac23ae5-a3bb-4e05-a131-8460ceac6a67 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:24.811785 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac23ae5-a3bb-4e05-a131-8460ceac6a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:24.812069 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac23ae5-a3bb-4e05-a131-8460ceac6a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:24.812805 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac23ae5-a3bb-4e05-a131-8460ceac6a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:24.813913 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc159e42-d66a-4755-98b1-28d314b780f3 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:24.814392 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac23ae5-a3bb-4e05-a131-8460ceac6a67 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:24.824920 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1363/2710] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:47:24.829390 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac23ae5-a3bb-4e05-a131-8460ceac6a67 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:24.830183 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1348/2711] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:24 2022] PUT /identity/v3/projects/19013748aaf34e9d906bd95d63bbe4d8/users/a11d6dd1f6664c23befc07608ca6af1c/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:47:24.840242 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac23ae5-a3bb-4e05-a131-8460ceac6a67 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:24.842355 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418ecda-a38b-4b17-bd92-436fd1f2f05f None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:24.842651 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418ecda-a38b-4b17-bd92-436fd1f2f05f None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:24.842935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418ecda-a38b-4b17-bd92-436fd1f2f05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:24.869531 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-0418ecda-a38b-4b17-bd92-436fd1f2f05f None None] MFA Rules not processed for user `a11d6dd1f6664c23befc07608ca6af1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:24.870747 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-0418ecda-a38b-4b17-bd92-436fd1f2f05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:24.908730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b66356-9fa2-4c22-80bd-6c7829c13e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:24.909696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b66356-9fa2-4c22-80bd-6c7829c13e17 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:24.910033 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b66356-9fa2-4c22-80bd-6c7829c13e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:24.910316 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b66356-9fa2-4c22-80bd-6c7829c13e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:24.911048 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b66356-9fa2-4c22-80bd-6c7829c13e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:24.912669 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b66356-9fa2-4c22-80bd-6c7829c13e17 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:24.925798 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1364/2712] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:47:24.926809 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b66356-9fa2-4c22-80bd-6c7829c13e17 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:24.935901 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1349/2713] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:24 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:24.940594 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418ecda-a38b-4b17-bd92-436fd1f2f05f None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:24.942704 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b66356-9fa2-4c22-80bd-6c7829c13e17 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:24.946701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5457a-4a64-4043-adc5-634d1adab1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:24.947651 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5457a-4a64-4043-adc5-634d1adab1bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:24.947965 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5457a-4a64-4043-adc5-634d1adab1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:24.948245 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5457a-4a64-4043-adc5-634d1adab1bb admin admin] PATH_INFO: `/v3/projects/da69458b6d804618abae94ea7a431005/users/738ef43e050a40388e5fc1038d34db2c/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:24.951970 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418ecda-a38b-4b17-bd92-436fd1f2f05f None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:24.958609 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e671f-f56a-4d99-ae63-5bcca4e6eae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:24.959309 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e671f-f56a-4d99-ae63-5bcca4e6eae3 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:24.959598 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e671f-f56a-4d99-ae63-5bcca4e6eae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:24.959877 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e671f-f56a-4d99-ae63-5bcca4e6eae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:24.960590 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e671f-f56a-4d99-ae63-5bcca4e6eae3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:24.962484 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e671f-f56a-4d99-ae63-5bcca4e6eae3 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:24.964439 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5457a-4a64-4043-adc5-634d1adab1bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=da69458b6d804618abae94ea7a431005, user_id=738ef43e050a40388e5fc1038d34db2c, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:24.967728 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5457a-4a64-4043-adc5-634d1adab1bb admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:24.981659 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1365/2714] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:24 2022] PUT /identity/v3/projects/da69458b6d804618abae94ea7a431005/users/738ef43e050a40388e5fc1038d34db2c/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:24.998272 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1350/2715] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:47:24 2022] POST /identity/v3/projects => generated 355 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:47:24.998508 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a2b1e-2efb-4fa6-86b0-3bec607e2b61 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:24.998508 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a2b1e-2efb-4fa6-86b0-3bec607e2b61 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:24.998508 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a2b1e-2efb-4fa6-86b0-3bec607e2b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:24.999948 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e671f-f56a-4d99-ae63-5bcca4e6eae3 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:25.006442 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:25.032954 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-407a2b1e-2efb-4fa6-86b0-3bec607e2b61 None None] MFA Rules not processed for user `738ef43e050a40388e5fc1038d34db2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:25.034176 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-407a2b1e-2efb-4fa6-86b0-3bec607e2b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:25.067985 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e671f-f56a-4d99-ae63-5bcca4e6eae3 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:25.073119 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab7c32-fff7-45fb-8111-9312d7410b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:25.074208 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab7c32-fff7-45fb-8111-9312d7410b22 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:25.074509 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab7c32-fff7-45fb-8111-9312d7410b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:25.074795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab7c32-fff7-45fb-8111-9312d7410b22 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:25.076638 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fab7c32-fff7-45fb-8111-9312d7410b22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:25.078961 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fab7c32-fff7-45fb-8111-9312d7410b22 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:25.105058 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1366/2716] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:24 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:47:25.105296 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1351/2717] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:47:24 2022] POST /identity/v3/users => generated 284 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:47:25.106042 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a2b1e-2efb-4fa6-86b0-3bec607e2b61 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:25.107379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab7c32-fff7-45fb-8111-9312d7410b22 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:25.117739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a2b1e-2efb-4fa6-86b0-3bec607e2b61 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:25.117911 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab7c32-fff7-45fb-8111-9312d7410b22 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:25.122793 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940021f-d207-4936-960d-676c4289bd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:25.123019 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328c4b6-ff36-4b6a-9414-e2d27284d34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:25.123477 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940021f-d207-4936-960d-676c4289bd6e admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:25.123737 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328c4b6-ff36-4b6a-9414-e2d27284d34a admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:25.123842 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940021f-d207-4936-960d-676c4289bd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:25.124018 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328c4b6-ff36-4b6a-9414-e2d27284d34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:25.124130 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940021f-d207-4936-960d-676c4289bd6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:25.124350 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328c4b6-ff36-4b6a-9414-e2d27284d34a admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:25.124747 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940021f-d207-4936-960d-676c4289bd6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:25.125085 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6328c4b6-ff36-4b6a-9414-e2d27284d34a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:25.126646 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940021f-d207-4936-960d-676c4289bd6e admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:25.126765 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6328c4b6-ff36-4b6a-9414-e2d27284d34a admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:25.137265 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1352/2718] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:25.142606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328c4b6-ff36-4b6a-9414-e2d27284d34a admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:25.151106 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:25.154816 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328c4b6-ff36-4b6a-9414-e2d27284d34a admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:25.159306 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1367/2719] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:47:25 2022] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:47:25.162594 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a564039-47c6-4bb0-a481-fab48f794168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:25.162989 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940021f-d207-4936-960d-676c4289bd6e admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:25.163588 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a564039-47c6-4bb0-a481-fab48f794168 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:25.163883 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a564039-47c6-4bb0-a481-fab48f794168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:25.164168 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a564039-47c6-4bb0-a481-fab48f794168 admin admin] PATH_INFO: `/v3/projects/d90d2f9939e44e0ba82e24aa7e0de0af/users/6d7448d4bd0e4534974bf4bd35cfa610/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:25.180044 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a564039-47c6-4bb0-a481-fab48f794168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90d2f9939e44e0ba82e24aa7e0de0af, user_id=6d7448d4bd0e4534974bf4bd35cfa610, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:25.182718 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a564039-47c6-4bb0-a481-fab48f794168 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:25.196644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1353/2720] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:25 2022] PUT /identity/v3/projects/d90d2f9939e44e0ba82e24aa7e0de0af/users/6d7448d4bd0e4534974bf4bd35cfa610/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:47:25.201152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a564039-47c6-4bb0-a481-fab48f794168 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:25.232367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940021f-d207-4936-960d-676c4289bd6e admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:25.269865 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a564039-47c6-4bb0-a481-fab48f794168 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:25.275350 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b248d-0967-45f4-9b4b-5f7ce7830ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:25.276053 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b248d-0967-45f4-9b4b-5f7ce7830ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:25.276397 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b248d-0967-45f4-9b4b-5f7ce7830ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:25.276668 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b248d-0967-45f4-9b4b-5f7ce7830ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:25.277474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b248d-0967-45f4-9b4b-5f7ce7830ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:25.279306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b248d-0967-45f4-9b4b-5f7ce7830ff6 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:25.289761 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1354/2721] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:47:25.293270 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001cbc30-8ed2-4acc-8c70-e0c51c7d5b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:25.294089 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cbc30-8ed2-4acc-8c70-e0c51c7d5b51 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:25.294339 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b248d-0967-45f4-9b4b-5f7ce7830ff6 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:25.294511 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cbc30-8ed2-4acc-8c70-e0c51c7d5b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:25.294861 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cbc30-8ed2-4acc-8c70-e0c51c7d5b51 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:25.295679 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001cbc30-8ed2-4acc-8c70-e0c51c7d5b51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:25.297659 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001cbc30-8ed2-4acc-8c70-e0c51c7d5b51 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:25.304704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b248d-0967-45f4-9b4b-5f7ce7830ff6 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:25.310426 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd6d2c-fc40-4757-a63c-9a5d1d4b77f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:25.311486 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd6d2c-fc40-4757-a63c-9a5d1d4b77f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:25.311814 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd6d2c-fc40-4757-a63c-9a5d1d4b77f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:25.312055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd6d2c-fc40-4757-a63c-9a5d1d4b77f3 admin admin] PATH_INFO: `/v3/projects/d90d2f9939e44e0ba82e24aa7e0de0af/users/6d7448d4bd0e4534974bf4bd35cfa610/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:25.314051 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd6d2c-fc40-4757-a63c-9a5d1d4b77f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90d2f9939e44e0ba82e24aa7e0de0af, user_id=6d7448d4bd0e4534974bf4bd35cfa610, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:25.316688 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd6d2c-fc40-4757-a63c-9a5d1d4b77f3 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:25.321028 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1368/2722] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:47:25 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:47:25.322917 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001cbc30-8ed2-4acc-8c70-e0c51c7d5b51 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:25.330861 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1355/2723] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:25 2022] PUT /identity/v3/projects/d90d2f9939e44e0ba82e24aa7e0de0af/users/6d7448d4bd0e4534974bf4bd35cfa610/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:47:25.335116 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001cbc30-8ed2-4acc-8c70-e0c51c7d5b51 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:25.345757 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c0333-b260-4c33-be63-dfa32e56ca51 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:25.346055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c0333-b260-4c33-be63-dfa32e56ca51 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:25.346341 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c0333-b260-4c33-be63-dfa32e56ca51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:25.376263 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-9d1c0333-b260-4c33-be63-dfa32e56ca51 None None] MFA Rules not processed for user `6d7448d4bd0e4534974bf4bd35cfa610`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:25.377468 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-9d1c0333-b260-4c33-be63-dfa32e56ca51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:25.397977 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eca2a4-a345-4f60-b889-2fce29569579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:25.398664 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eca2a4-a345-4f60-b889-2fce29569579 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:25.398955 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eca2a4-a345-4f60-b889-2fce29569579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:25.399260 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eca2a4-a345-4f60-b889-2fce29569579 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:25.400006 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eca2a4-a345-4f60-b889-2fce29569579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:25.401810 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eca2a4-a345-4f60-b889-2fce29569579 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:25.411086 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:25.412413 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1369/2724] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:47:25.417164 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eca2a4-a345-4f60-b889-2fce29569579 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:25.428019 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eca2a4-a345-4f60-b889-2fce29569579 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:25.433007 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55e458-5bf6-4ad3-a58f-1b53cc5fec07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:25.433953 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55e458-5bf6-4ad3-a58f-1b53cc5fec07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:25.434302 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55e458-5bf6-4ad3-a58f-1b53cc5fec07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:25.434579 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55e458-5bf6-4ad3-a58f-1b53cc5fec07 admin admin] PATH_INFO: `/v3/projects/05a7ab887ab145a9bd88b95802c131e0/users/3e0808df9e4f488bbe43e3cdaca34839/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:25.451313 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55e458-5bf6-4ad3-a58f-1b53cc5fec07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05a7ab887ab145a9bd88b95802c131e0, user_id=3e0808df9e4f488bbe43e3cdaca34839, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:25.454018 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55e458-5bf6-4ad3-a58f-1b53cc5fec07 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:25.456294 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1356/2725] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:25 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:25.468771 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1370/2726] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:25 2022] PUT /identity/v3/projects/05a7ab887ab145a9bd88b95802c131e0/users/3e0808df9e4f488bbe43e3cdaca34839/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:25.469262 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c0333-b260-4c33-be63-dfa32e56ca51 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:25.470718 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-9d1c0333-b260-4c33-be63-dfa32e56ca51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:25.472682 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55e458-5bf6-4ad3-a58f-1b53cc5fec07 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:25.482649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:25.535475 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c0333-b260-4c33-be63-dfa32e56ca51 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:25.546647 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55e458-5bf6-4ad3-a58f-1b53cc5fec07 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:25.552352 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4777d09-eb37-4ef7-8456-705f3d7b0cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:25.553141 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4777d09-eb37-4ef7-8456-705f3d7b0cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:25.553429 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4777d09-eb37-4ef7-8456-705f3d7b0cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:25.553712 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4777d09-eb37-4ef7-8456-705f3d7b0cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:25.554451 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4777d09-eb37-4ef7-8456-705f3d7b0cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:25.556437 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4777d09-eb37-4ef7-8456-705f3d7b0cc5 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:25.571331 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1371/2727] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:47:25.572465 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4777d09-eb37-4ef7-8456-705f3d7b0cc5 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:25.582651 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4777d09-eb37-4ef7-8456-705f3d7b0cc5 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:25.587739 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0ff83-af9b-45e1-a203-703c23f74599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:25.588651 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0ff83-af9b-45e1-a203-703c23f74599 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:25.589082 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0ff83-af9b-45e1-a203-703c23f74599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:25.589363 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0ff83-af9b-45e1-a203-703c23f74599 admin admin] PATH_INFO: `/v3/projects/05a7ab887ab145a9bd88b95802c131e0/users/3e0808df9e4f488bbe43e3cdaca34839/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:25.591609 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0ff83-af9b-45e1-a203-703c23f74599 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05a7ab887ab145a9bd88b95802c131e0, user_id=3e0808df9e4f488bbe43e3cdaca34839, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:25.592539 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bdb9c-96fd-44c7-ba3d-9dedaada50d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:25.593277 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bdb9c-96fd-44c7-ba3d-9dedaada50d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:25.593570 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bdb9c-96fd-44c7-ba3d-9dedaada50d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:25.593851 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bdb9c-96fd-44c7-ba3d-9dedaada50d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:25.594331 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0ff83-af9b-45e1-a203-703c23f74599 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:25.605457 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1372/2728] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:25 2022] PUT /identity/v3/projects/05a7ab887ab145a9bd88b95802c131e0/users/3e0808df9e4f488bbe43e3cdaca34839/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:47:25.616834 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebc046-5d59-48d1-89ea-b14edb68af27 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:25.617295 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebc046-5d59-48d1-89ea-b14edb68af27 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:25.617592 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebc046-5d59-48d1-89ea-b14edb68af27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:25.650330 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-33ebc046-5d59-48d1-89ea-b14edb68af27 None None] MFA Rules not processed for user `3e0808df9e4f488bbe43e3cdaca34839`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:25.651629 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-33ebc046-5d59-48d1-89ea-b14edb68af27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:25.660226 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932bdb9c-96fd-44c7-ba3d-9dedaada50d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:25.661746 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932bdb9c-96fd-44c7-ba3d-9dedaada50d3 service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:25.673636 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1357/2729] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:25 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:47:25.727859 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1373/2730] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:25 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:25.740296 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bdb9c-96fd-44c7-ba3d-9dedaada50d3 service cinder] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:25.750056 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bdb9c-96fd-44c7-ba3d-9dedaada50d3 service cinder] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:25.753671 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebc046-5d59-48d1-89ea-b14edb68af27 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:25.755381 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-33ebc046-5d59-48d1-89ea-b14edb68af27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:25.786995 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=100 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:25.808546 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ecb69-7bbc-4a92-b1ae-76c8266a42db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:25.809324 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ecb69-7bbc-4a92-b1ae-76c8266a42db service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:25.810263 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ecb69-7bbc-4a92-b1ae-76c8266a42db service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:25.810631 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ecb69-7bbc-4a92-b1ae-76c8266a42db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:25.821035 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebc046-5d59-48d1-89ea-b14edb68af27 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:25.821289 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ecb69-7bbc-4a92-b1ae-76c8266a42db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:25.822729 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ecb69-7bbc-4a92-b1ae-76c8266a42db service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:25.825786 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd366b-cfff-4718-bfc1-5820b31f30cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:25.826570 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd366b-cfff-4718-bfc1-5820b31f30cd service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:25.826854 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd366b-cfff-4718-bfc1-5820b31f30cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:25.827134 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd366b-cfff-4718-bfc1-5820b31f30cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:25.833965 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1358/2731] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:25 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:25.870487 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:25.902780 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd366b-cfff-4718-bfc1-5820b31f30cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:25.904310 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd366b-cfff-4718-bfc1-5820b31f30cd service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:25.918969 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1374/2732] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:25 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:25.920727 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ecb69-7bbc-4a92-b1ae-76c8266a42db service cinder] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:25.930064 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ecb69-7bbc-4a92-b1ae-76c8266a42db service cinder] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:25.934327 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05989dc3-825c-4d9a-9470-b8096156bb28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:25.935517 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05989dc3-825c-4d9a-9470-b8096156bb28 service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:25.935808 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05989dc3-825c-4d9a-9470-b8096156bb28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:25.936142 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05989dc3-825c-4d9a-9470-b8096156bb28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:25.999446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05989dc3-825c-4d9a-9470-b8096156bb28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:26.001104 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05989dc3-825c-4d9a-9470-b8096156bb28 service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:26.012266 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1359/2733] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:25 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:28.751374 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd366b-cfff-4718-bfc1-5820b31f30cd service cinder] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:28.813593 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd366b-cfff-4718-bfc1-5820b31f30cd service cinder] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:28.818141 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c040d-c984-4a02-874d-2ce2f2f6f1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:28.819008 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c040d-c984-4a02-874d-2ce2f2f6f1eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:28.819331 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c040d-c984-4a02-874d-2ce2f2f6f1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:28.819615 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c040d-c984-4a02-874d-2ce2f2f6f1eb admin admin] PATH_INFO: `/v3/users/738ef43e050a40388e5fc1038d34db2c` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:28.820815 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c040d-c984-4a02-874d-2ce2f2f6f1eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=738ef43e050a40388e5fc1038d34db2c)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:28.822761 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c040d-c984-4a02-874d-2ce2f2f6f1eb admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:28.870208 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-f64c040d-c984-4a02-874d-2ce2f2f6f1eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '738ef43e050a40388e5fc1038d34db2c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:28.881872 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-f64c040d-c984-4a02-874d-2ce2f2f6f1eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '738ef43e050a40388e5fc1038d34db2c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:28.888583 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-f64c040d-c984-4a02-874d-2ce2f2f6f1eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '738ef43e050a40388e5fc1038d34db2c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:28.889275 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-f64c040d-c984-4a02-874d-2ce2f2f6f1eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '738ef43e050a40388e5fc1038d34db2c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:28.889902 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-f64c040d-c984-4a02-874d-2ce2f2f6f1eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '738ef43e050a40388e5fc1038d34db2c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:28.902829 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1375/2734] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:47:28 2022] DELETE /identity/v3/users/738ef43e050a40388e5fc1038d34db2c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:28.907948 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed5e74-bf44-4c04-9d4b-76b8ec3d8252 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:28.908438 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed5e74-bf44-4c04-9d4b-76b8ec3d8252 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:28.908535 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed5e74-bf44-4c04-9d4b-76b8ec3d8252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:28.925806 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-2eed5e74-bf44-4c04-9d4b-76b8ec3d8252 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:28.927038 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-2eed5e74-bf44-4c04-9d4b-76b8ec3d8252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:28.987743 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1360/2735] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:28.997449 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c040d-c984-4a02-874d-2ce2f2f6f1eb admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:28.999405 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-f64c040d-c984-4a02-874d-2ce2f2f6f1eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:29.051262 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:29.055451 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c040d-c984-4a02-874d-2ce2f2f6f1eb admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:29.059750 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b2e41-526c-4589-baca-d2b4b1c0d371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:29.060407 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b2e41-526c-4589-baca-d2b4b1c0d371 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:29.061419 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b2e41-526c-4589-baca-d2b4b1c0d371 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:29.062179 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b2e41-526c-4589-baca-d2b4b1c0d371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:29.071974 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b2e41-526c-4589-baca-d2b4b1c0d371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:29.073384 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b2e41-526c-4589-baca-d2b4b1c0d371 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:29.083615 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1376/2736] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:29.351829 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed5e74-bf44-4c04-9d4b-76b8ec3d8252 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:29.353280 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-2eed5e74-bf44-4c04-9d4b-76b8ec3d8252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:29.371309 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed5e74-bf44-4c04-9d4b-76b8ec3d8252 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:29.376719 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000007a-0dfb-4707-a5ad-ceeda2eb1931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:29.377570 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000007a-0dfb-4707-a5ad-ceeda2eb1931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:29.377859 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000007a-0dfb-4707-a5ad-ceeda2eb1931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:29.378138 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000007a-0dfb-4707-a5ad-ceeda2eb1931 admin admin] PATH_INFO: `/v3/projects/da69458b6d804618abae94ea7a431005` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:29.379445 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e000007a-0dfb-4707-a5ad-ceeda2eb1931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da69458b6d804618abae94ea7a431005)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:29.381303 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e000007a-0dfb-4707-a5ad-ceeda2eb1931 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:29.428441 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-e000007a-0dfb-4707-a5ad-ceeda2eb1931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da69458b6d804618abae94ea7a431005', 'request_id': 'req-e000007a-0dfb-4707-a5ad-ceeda2eb1931'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:29.434607 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-e000007a-0dfb-4707-a5ad-ceeda2eb1931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da69458b6d804618abae94ea7a431005', 'request_id': 'req-e000007a-0dfb-4707-a5ad-ceeda2eb1931'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:29.442490 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-e000007a-0dfb-4707-a5ad-ceeda2eb1931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da69458b6d804618abae94ea7a431005', 'request_id': 'req-e000007a-0dfb-4707-a5ad-ceeda2eb1931'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:29.448738 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:29.453435 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-e000007a-0dfb-4707-a5ad-ceeda2eb1931 admin admin] The token cache is being invalidate because project da69458b6d804618abae94ea7a431005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:47:29.454045 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-e000007a-0dfb-4707-a5ad-ceeda2eb1931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:29.454767 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-e000007a-0dfb-4707-a5ad-ceeda2eb1931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:29.456468 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1361/2737] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:47:29 2022] DELETE /identity/v3/projects/da69458b6d804618abae94ea7a431005 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:29.461426 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b2e41-526c-4589-baca-d2b4b1c0d371 service neutron] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:29.471336 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b2e41-526c-4589-baca-d2b4b1c0d371 service neutron] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:29.530438 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7ec2c-db6f-4dae-b3fb-484029ea68b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:29.531255 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7ec2c-db6f-4dae-b3fb-484029ea68b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:29.531539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7ec2c-db6f-4dae-b3fb-484029ea68b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:29.531820 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7ec2c-db6f-4dae-b3fb-484029ea68b8 admin admin] PATH_INFO: `/v3/users/3e0808df9e4f488bbe43e3cdaca34839` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:29.533052 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7ec2c-db6f-4dae-b3fb-484029ea68b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e0808df9e4f488bbe43e3cdaca34839)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:29.534946 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7ec2c-db6f-4dae-b3fb-484029ea68b8 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:29.582622 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ead7ec2c-db6f-4dae-b3fb-484029ea68b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e0808df9e4f488bbe43e3cdaca34839'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:29.594963 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ead7ec2c-db6f-4dae-b3fb-484029ea68b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e0808df9e4f488bbe43e3cdaca34839'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:29.601786 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ead7ec2c-db6f-4dae-b3fb-484029ea68b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e0808df9e4f488bbe43e3cdaca34839'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:29.602481 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ead7ec2c-db6f-4dae-b3fb-484029ea68b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e0808df9e4f488bbe43e3cdaca34839'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:29.603106 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-ead7ec2c-db6f-4dae-b3fb-484029ea68b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e0808df9e4f488bbe43e3cdaca34839'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:29.616909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1377/2738] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:47:29 2022] DELETE /identity/v3/users/3e0808df9e4f488bbe43e3cdaca34839 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:29.906612 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000007a-0dfb-4707-a5ad-ceeda2eb1931 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:29.908313 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-e000007a-0dfb-4707-a5ad-ceeda2eb1931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:29.923640 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000007a-0dfb-4707-a5ad-ceeda2eb1931 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:29.986035 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0316e6-51e2-4d04-989f-544adc13ec7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:29.986953 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0316e6-51e2-4d04-989f-544adc13ec7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:29.987412 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0316e6-51e2-4d04-989f-544adc13ec7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:29.987723 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0316e6-51e2-4d04-989f-544adc13ec7c admin admin] PATH_INFO: `/v3/projects/05a7ab887ab145a9bd88b95802c131e0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:29.989108 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0316e6-51e2-4d04-989f-544adc13ec7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=05a7ab887ab145a9bd88b95802c131e0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:29.991031 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0316e6-51e2-4d04-989f-544adc13ec7c admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:30.042500 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-7d0316e6-51e2-4d04-989f-544adc13ec7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05a7ab887ab145a9bd88b95802c131e0', 'request_id': 'req-7d0316e6-51e2-4d04-989f-544adc13ec7c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:30.048709 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-7d0316e6-51e2-4d04-989f-544adc13ec7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05a7ab887ab145a9bd88b95802c131e0', 'request_id': 'req-7d0316e6-51e2-4d04-989f-544adc13ec7c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:30.056704 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-7d0316e6-51e2-4d04-989f-544adc13ec7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05a7ab887ab145a9bd88b95802c131e0', 'request_id': 'req-7d0316e6-51e2-4d04-989f-544adc13ec7c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:30.068554 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-7d0316e6-51e2-4d04-989f-544adc13ec7c admin admin] The token cache is being invalidate because project 05a7ab887ab145a9bd88b95802c131e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:47:30.068849 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-7d0316e6-51e2-4d04-989f-544adc13ec7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:30.069654 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-7d0316e6-51e2-4d04-989f-544adc13ec7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:30.071724 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1362/2739] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:47:29 2022] DELETE /identity/v3/projects/05a7ab887ab145a9bd88b95802c131e0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:30.077099 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3d7f7-e8cf-443c-8fd6-ff99ff9375af None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:30.077760 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3d7f7-e8cf-443c-8fd6-ff99ff9375af None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:30.077760 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3d7f7-e8cf-443c-8fd6-ff99ff9375af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:30.097845 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-a8a3d7f7-e8cf-443c-8fd6-ff99ff9375af None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:30.099089 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-a8a3d7f7-e8cf-443c-8fd6-ff99ff9375af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:30.167957 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1378/2740] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:30.177556 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86274103-79ee-4011-ab2c-70d0e0a2b4d3 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:30.177938 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86274103-79ee-4011-ab2c-70d0e0a2b4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:30.178118 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86274103-79ee-4011-ab2c-70d0e0a2b4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:30.197602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-86274103-79ee-4011-ab2c-70d0e0a2b4d3 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:30.198829 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-86274103-79ee-4011-ab2c-70d0e0a2b4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:30.207404 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1363/2741] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:30.211852 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3d7f7-e8cf-443c-8fd6-ff99ff9375af None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:30.221956 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3d7f7-e8cf-443c-8fd6-ff99ff9375af None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:30.226897 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc1efb-418a-4d0c-9623-1a609b73b24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:30.227604 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc1efb-418a-4d0c-9623-1a609b73b24d admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:30.227889 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc1efb-418a-4d0c-9623-1a609b73b24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:30.228173 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc1efb-418a-4d0c-9623-1a609b73b24d admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:30.228903 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc1efb-418a-4d0c-9623-1a609b73b24d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:47:30.229215 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc1efb-418a-4d0c-9623-1a609b73b24d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:30.230795 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc1efb-418a-4d0c-9623-1a609b73b24d admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:30.238259 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:30.248292 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1379/2742] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:47:30.250041 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86274103-79ee-4011-ab2c-70d0e0a2b4d3 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:30.259606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86274103-79ee-4011-ab2c-70d0e0a2b4d3 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:30.264807 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5902b-d1f6-4f95-a5ef-41ca1befa76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:30.265737 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5902b-d1f6-4f95-a5ef-41ca1befa76c admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:30.266030 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5902b-d1f6-4f95-a5ef-41ca1befa76c admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:30.266314 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5902b-d1f6-4f95-a5ef-41ca1befa76c admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:30.267016 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5902b-d1f6-4f95-a5ef-41ca1befa76c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:30.268953 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5902b-d1f6-4f95-a5ef-41ca1befa76c admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:30.294752 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1364/2743] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:47:30 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:47:30.299857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc1efb-418a-4d0c-9623-1a609b73b24d admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:30.310894 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc1efb-418a-4d0c-9623-1a609b73b24d admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:30.370381 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471f883-7f24-4beb-9b0a-d71757ab7057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:30.371186 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471f883-7f24-4beb-9b0a-d71757ab7057 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:30.371629 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471f883-7f24-4beb-9b0a-d71757ab7057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:30.371919 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471f883-7f24-4beb-9b0a-d71757ab7057 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:30.372637 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471f883-7f24-4beb-9b0a-d71757ab7057 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:30.374885 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471f883-7f24-4beb-9b0a-d71757ab7057 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:30.395369 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1380/2744] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:47:30 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:47:30.399527 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5902b-d1f6-4f95-a5ef-41ca1befa76c admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:30.410138 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5902b-d1f6-4f95-a5ef-41ca1befa76c admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:30.415036 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb266364-6767-4dd1-9941-cc56fcf36289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:30.415751 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb266364-6767-4dd1-9941-cc56fcf36289 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:30.416049 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb266364-6767-4dd1-9941-cc56fcf36289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:30.416330 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb266364-6767-4dd1-9941-cc56fcf36289 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:30.417095 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb266364-6767-4dd1-9941-cc56fcf36289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:30.418681 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb266364-6767-4dd1-9941-cc56fcf36289 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:30.429793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1365/2745] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:30.433876 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471f883-7f24-4beb-9b0a-d71757ab7057 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:30.446281 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471f883-7f24-4beb-9b0a-d71757ab7057 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:30.451121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e4b6b-6b72-419a-b5d0-71380aa3903a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:30.451882 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e4b6b-6b72-419a-b5d0-71380aa3903a admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:30.452159 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e4b6b-6b72-419a-b5d0-71380aa3903a admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:30.452468 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e4b6b-6b72-419a-b5d0-71380aa3903a admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:30.453204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e4b6b-6b72-419a-b5d0-71380aa3903a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:30.454808 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e4b6b-6b72-419a-b5d0-71380aa3903a admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:30.466564 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1381/2746] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:30.471424 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb266364-6767-4dd1-9941-cc56fcf36289 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:30.481345 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb266364-6767-4dd1-9941-cc56fcf36289 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:30.486592 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f184471-79ab-4bda-9e53-ae789a90c8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:30.487495 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f184471-79ab-4bda-9e53-ae789a90c8cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:30.487782 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f184471-79ab-4bda-9e53-ae789a90c8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:30.488077 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f184471-79ab-4bda-9e53-ae789a90c8cd admin admin] PATH_INFO: `/v3/projects/5d108bbdfd074fb6b3eab458fa4e6d94/users/9e92b3e1da004452aa2fe3311a826cf6/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:30.502045 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f184471-79ab-4bda-9e53-ae789a90c8cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d108bbdfd074fb6b3eab458fa4e6d94, user_id=9e92b3e1da004452aa2fe3311a826cf6, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:30.504782 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f184471-79ab-4bda-9e53-ae789a90c8cd admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:30.518225 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1366/2747] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:30 2022] PUT /identity/v3/projects/5d108bbdfd074fb6b3eab458fa4e6d94/users/9e92b3e1da004452aa2fe3311a826cf6/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:30.528567 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b173e8-5f9e-4290-806e-98a1536b0964 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:30.528889 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b173e8-5f9e-4290-806e-98a1536b0964 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:30.529174 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b173e8-5f9e-4290-806e-98a1536b0964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:30.558772 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-13b173e8-5f9e-4290-806e-98a1536b0964 None None] MFA Rules not processed for user `9e92b3e1da004452aa2fe3311a826cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:30.559829 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-13b173e8-5f9e-4290-806e-98a1536b0964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:30.624024 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1382/2748] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:30.628561 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f184471-79ab-4bda-9e53-ae789a90c8cd admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:30.656476 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:30.693056 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f184471-79ab-4bda-9e53-ae789a90c8cd admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:30.697768 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24780d-d3e8-474f-a568-912870ae5051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:30.698427 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24780d-d3e8-474f-a568-912870ae5051 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:30.698719 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24780d-d3e8-474f-a568-912870ae5051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:30.699004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24780d-d3e8-474f-a568-912870ae5051 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:30.699726 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24780d-d3e8-474f-a568-912870ae5051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:30.702143 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24780d-d3e8-474f-a568-912870ae5051 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:30.729880 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1367/2749] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:47:30 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:47:30.734310 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b173e8-5f9e-4290-806e-98a1536b0964 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:30.745402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b173e8-5f9e-4290-806e-98a1536b0964 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:30.801754 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabf64d-0cf4-4684-a21d-752230d812c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:30.802426 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabf64d-0cf4-4684-a21d-752230d812c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:30.802712 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabf64d-0cf4-4684-a21d-752230d812c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:30.802989 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabf64d-0cf4-4684-a21d-752230d812c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:30.803731 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcabf64d-0cf4-4684-a21d-752230d812c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:30.805635 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcabf64d-0cf4-4684-a21d-752230d812c4 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:30.815286 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:30.827425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1383/2750] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:47:30 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:47:30.831458 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24780d-d3e8-474f-a568-912870ae5051 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:30.841912 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24780d-d3e8-474f-a568-912870ae5051 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:30.847247 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b429d-7e8e-4c24-9ce6-c55135336b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:30.847928 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b429d-7e8e-4c24-9ce6-c55135336b0d admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:30.848219 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b429d-7e8e-4c24-9ce6-c55135336b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:30.848504 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b429d-7e8e-4c24-9ce6-c55135336b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:30.849234 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b429d-7e8e-4c24-9ce6-c55135336b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:30.850832 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b429d-7e8e-4c24-9ce6-c55135336b0d admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:30.861843 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1368/2751] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:30.868745 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabf64d-0cf4-4684-a21d-752230d812c4 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:30.879275 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabf64d-0cf4-4684-a21d-752230d812c4 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:30.883834 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd3c09-1453-44a2-81ed-9fd7ee8f692a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:30.884706 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd3c09-1453-44a2-81ed-9fd7ee8f692a admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:30.884991 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd3c09-1453-44a2-81ed-9fd7ee8f692a admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:30.885267 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd3c09-1453-44a2-81ed-9fd7ee8f692a admin admin] PATH_INFO: `/v3/projects/78a58ea9b85949df841920ad0a7a3d1e/users/2b53762272114273a474a822ec53e020/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:30.900777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd3c09-1453-44a2-81ed-9fd7ee8f692a admin admin] RBAC: Authorizing `identity:create_grant(project_id=78a58ea9b85949df841920ad0a7a3d1e, user_id=2b53762272114273a474a822ec53e020, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:30.903484 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd3c09-1453-44a2-81ed-9fd7ee8f692a admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:30.917045 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1384/2752] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:30 2022] PUT /identity/v3/projects/78a58ea9b85949df841920ad0a7a3d1e/users/2b53762272114273a474a822ec53e020/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:30.921181 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b429d-7e8e-4c24-9ce6-c55135336b0d admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:30.931446 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b429d-7e8e-4c24-9ce6-c55135336b0d admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:30.989515 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86adb6-3354-49e3-b348-43cc7fa05d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:30.990277 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86adb6-3354-49e3-b348-43cc7fa05d79 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:30.990569 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86adb6-3354-49e3-b348-43cc7fa05d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:30.990867 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86adb6-3354-49e3-b348-43cc7fa05d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:30.991614 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86adb6-3354-49e3-b348-43cc7fa05d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:30.993339 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86adb6-3354-49e3-b348-43cc7fa05d79 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:31.003710 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1369/2753] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:47:31.007843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd3c09-1453-44a2-81ed-9fd7ee8f692a admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:31.019007 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd3c09-1453-44a2-81ed-9fd7ee8f692a admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:31.023655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ebf20-a9f3-4b1d-ac5f-01ff80ad70c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:31.024529 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ebf20-a9f3-4b1d-ac5f-01ff80ad70c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:31.024818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ebf20-a9f3-4b1d-ac5f-01ff80ad70c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:31.025094 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ebf20-a9f3-4b1d-ac5f-01ff80ad70c8 admin admin] PATH_INFO: `/v3/projects/78a58ea9b85949df841920ad0a7a3d1e/users/2b53762272114273a474a822ec53e020/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:31.027076 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ebf20-a9f3-4b1d-ac5f-01ff80ad70c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78a58ea9b85949df841920ad0a7a3d1e, user_id=2b53762272114273a474a822ec53e020, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:31.029804 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ebf20-a9f3-4b1d-ac5f-01ff80ad70c8 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:31.040709 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1385/2754] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:31 2022] PUT /identity/v3/projects/78a58ea9b85949df841920ad0a7a3d1e/users/2b53762272114273a474a822ec53e020/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:31.052856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeedf1-e0c8-4754-a6e2-7eeb0ff6a88c None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:31.053162 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeedf1-e0c8-4754-a6e2-7eeb0ff6a88c None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:31.053633 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeedf1-e0c8-4754-a6e2-7eeb0ff6a88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:31.081820 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-3bbeedf1-e0c8-4754-a6e2-7eeb0ff6a88c None None] MFA Rules not processed for user `2b53762272114273a474a822ec53e020`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:31.083428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-3bbeedf1-e0c8-4754-a6e2-7eeb0ff6a88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:31.152955 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1370/2755] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:31.164696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ebf20-a9f3-4b1d-ac5f-01ff80ad70c8 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:31.166476 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-dd2ebf20-a9f3-4b1d-ac5f-01ff80ad70c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:31.227299 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ebf20-a9f3-4b1d-ac5f-01ff80ad70c8 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:31.231069 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310607a-069d-424f-ac83-b6c77d8d67b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:31.231766 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310607a-069d-424f-ac83-b6c77d8d67b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:31.232058 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310607a-069d-424f-ac83-b6c77d8d67b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:31.232342 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310607a-069d-424f-ac83-b6c77d8d67b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:31.292646 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310607a-069d-424f-ac83-b6c77d8d67b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:31.294077 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310607a-069d-424f-ac83-b6c77d8d67b2 service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:31.304241 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1386/2756] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:32.665666 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbeedf1-e0c8-4754-a6e2-7eeb0ff6a88c None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:32.676687 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbeedf1-e0c8-4754-a6e2-7eeb0ff6a88c None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:32.680469 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056c6d2-d557-4768-83c8-3003e2952bc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:32.681121 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056c6d2-d557-4768-83c8-3003e2952bc6 service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:32.681410 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056c6d2-d557-4768-83c8-3003e2952bc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:32.681707 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056c6d2-d557-4768-83c8-3003e2952bc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:32.691453 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056c6d2-d557-4768-83c8-3003e2952bc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:32.692890 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056c6d2-d557-4768-83c8-3003e2952bc6 service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:32.703775 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1371/2757] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:36.511881 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310607a-069d-424f-ac83-b6c77d8d67b2 service cinder] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:36.577193 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310607a-069d-424f-ac83-b6c77d8d67b2 service cinder] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:36.582316 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac67e7-e554-4d9f-a04f-6d5a29a6248d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:36.583183 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac67e7-e554-4d9f-a04f-6d5a29a6248d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:36.583501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac67e7-e554-4d9f-a04f-6d5a29a6248d admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:36.583784 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac67e7-e554-4d9f-a04f-6d5a29a6248d admin admin] PATH_INFO: `/v3/users/9e92b3e1da004452aa2fe3311a826cf6` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:36.584984 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac67e7-e554-4d9f-a04f-6d5a29a6248d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e92b3e1da004452aa2fe3311a826cf6)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:36.586885 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac67e7-e554-4d9f-a04f-6d5a29a6248d admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:36.602185 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:36.634342 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-d2ac67e7-e554-4d9f-a04f-6d5a29a6248d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e92b3e1da004452aa2fe3311a826cf6'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:36.646726 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-d2ac67e7-e554-4d9f-a04f-6d5a29a6248d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e92b3e1da004452aa2fe3311a826cf6'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:36.653527 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-d2ac67e7-e554-4d9f-a04f-6d5a29a6248d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e92b3e1da004452aa2fe3311a826cf6'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:36.654226 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-d2ac67e7-e554-4d9f-a04f-6d5a29a6248d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e92b3e1da004452aa2fe3311a826cf6'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:36.654843 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-d2ac67e7-e554-4d9f-a04f-6d5a29a6248d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e92b3e1da004452aa2fe3311a826cf6'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:36.668404 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1387/2758] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:47:36 2022] DELETE /identity/v3/users/9e92b3e1da004452aa2fe3311a826cf6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:36.673584 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5e5b3-290a-40cd-a01b-3ad50768e282 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:36.674143 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5e5b3-290a-40cd-a01b-3ad50768e282 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:36.674143 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5e5b3-290a-40cd-a01b-3ad50768e282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:36.685998 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:36.692534 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-3ec5e5b3-290a-40cd-a01b-3ad50768e282 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:36.694230 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-3ec5e5b3-290a-40cd-a01b-3ad50768e282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:36.757559 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1372/2759] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:36.768069 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac67e7-e554-4d9f-a04f-6d5a29a6248d admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:36.769252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-d2ac67e7-e554-4d9f-a04f-6d5a29a6248d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:36.831707 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac67e7-e554-4d9f-a04f-6d5a29a6248d admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:36.836188 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ef710-b207-49b9-9726-27b042ba0c13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:36.837093 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ef710-b207-49b9-9726-27b042ba0c13 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:36.837605 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ef710-b207-49b9-9726-27b042ba0c13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:36.837993 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ef710-b207-49b9-9726-27b042ba0c13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:36.848581 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ef710-b207-49b9-9726-27b042ba0c13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:36.850068 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ef710-b207-49b9-9726-27b042ba0c13 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:36.861519 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1388/2760] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:37.131262 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5e5b3-290a-40cd-a01b-3ad50768e282 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:37.132893 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-3ec5e5b3-290a-40cd-a01b-3ad50768e282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:37.145099 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5e5b3-290a-40cd-a01b-3ad50768e282 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:37.150323 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff1117-269f-4259-a01e-30c67564a1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:37.151251 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff1117-269f-4259-a01e-30c67564a1f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:37.151546 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff1117-269f-4259-a01e-30c67564a1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:37.151829 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff1117-269f-4259-a01e-30c67564a1f3 admin admin] PATH_INFO: `/v3/projects/5d108bbdfd074fb6b3eab458fa4e6d94` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:37.153283 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff1117-269f-4259-a01e-30c67564a1f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d108bbdfd074fb6b3eab458fa4e6d94)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:37.155326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff1117-269f-4259-a01e-30c67564a1f3 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:37.204657 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-5aff1117-269f-4259-a01e-30c67564a1f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d108bbdfd074fb6b3eab458fa4e6d94', 'request_id': 'req-5aff1117-269f-4259-a01e-30c67564a1f3'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:37.210822 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-5aff1117-269f-4259-a01e-30c67564a1f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d108bbdfd074fb6b3eab458fa4e6d94', 'request_id': 'req-5aff1117-269f-4259-a01e-30c67564a1f3'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:37.219608 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-5aff1117-269f-4259-a01e-30c67564a1f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d108bbdfd074fb6b3eab458fa4e6d94', 'request_id': 'req-5aff1117-269f-4259-a01e-30c67564a1f3'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:37.230298 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-5aff1117-269f-4259-a01e-30c67564a1f3 admin admin] The token cache is being invalidate because project 5d108bbdfd074fb6b3eab458fa4e6d94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:47:37.230591 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-5aff1117-269f-4259-a01e-30c67564a1f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:37.231246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-5aff1117-269f-4259-a01e-30c67564a1f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:37.232803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1373/2761] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:47:37 2022] DELETE /identity/v3/projects/5d108bbdfd074fb6b3eab458fa4e6d94 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:37.237436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ef710-b207-49b9-9726-27b042ba0c13 service neutron] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:37.246965 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ef710-b207-49b9-9726-27b042ba0c13 service neutron] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:37.302924 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd9767-55d3-4146-b01b-a5aa116fea25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:37.303724 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd9767-55d3-4146-b01b-a5aa116fea25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:37.304009 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd9767-55d3-4146-b01b-a5aa116fea25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:37.304285 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd9767-55d3-4146-b01b-a5aa116fea25 admin admin] PATH_INFO: `/v3/users/2b53762272114273a474a822ec53e020` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:37.305468 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd9767-55d3-4146-b01b-a5aa116fea25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b53762272114273a474a822ec53e020)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:37.307400 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd9767-55d3-4146-b01b-a5aa116fea25 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:37.345358 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:37.355231 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-e1cd9767-55d3-4146-b01b-a5aa116fea25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b53762272114273a474a822ec53e020'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:37.367586 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-e1cd9767-55d3-4146-b01b-a5aa116fea25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b53762272114273a474a822ec53e020'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:37.374229 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-e1cd9767-55d3-4146-b01b-a5aa116fea25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b53762272114273a474a822ec53e020'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:37.374967 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-e1cd9767-55d3-4146-b01b-a5aa116fea25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b53762272114273a474a822ec53e020'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:37.375621 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-e1cd9767-55d3-4146-b01b-a5aa116fea25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b53762272114273a474a822ec53e020'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:37.389412 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1389/2762] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:47:37 2022] DELETE /identity/v3/users/2b53762272114273a474a822ec53e020 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:37.665986 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff1117-269f-4259-a01e-30c67564a1f3 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:37.668204 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-5aff1117-269f-4259-a01e-30c67564a1f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:37.690204 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff1117-269f-4259-a01e-30c67564a1f3 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:37.746629 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0972cf64-b670-47f4-8a6f-226c4da7eb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:37.747535 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972cf64-b670-47f4-8a6f-226c4da7eb70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:37.747820 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972cf64-b670-47f4-8a6f-226c4da7eb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:37.748103 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972cf64-b670-47f4-8a6f-226c4da7eb70 admin admin] PATH_INFO: `/v3/projects/78a58ea9b85949df841920ad0a7a3d1e` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:37.749802 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0972cf64-b670-47f4-8a6f-226c4da7eb70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78a58ea9b85949df841920ad0a7a3d1e)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:37.751795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0972cf64-b670-47f4-8a6f-226c4da7eb70 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:37.787403 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:37.801762 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0972cf64-b670-47f4-8a6f-226c4da7eb70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78a58ea9b85949df841920ad0a7a3d1e', 'request_id': 'req-0972cf64-b670-47f4-8a6f-226c4da7eb70'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:37.808169 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0972cf64-b670-47f4-8a6f-226c4da7eb70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78a58ea9b85949df841920ad0a7a3d1e', 'request_id': 'req-0972cf64-b670-47f4-8a6f-226c4da7eb70'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:37.816636 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0972cf64-b670-47f4-8a6f-226c4da7eb70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78a58ea9b85949df841920ad0a7a3d1e', 'request_id': 'req-0972cf64-b670-47f4-8a6f-226c4da7eb70'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:37.829634 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0972cf64-b670-47f4-8a6f-226c4da7eb70 admin admin] The token cache is being invalidate because project 78a58ea9b85949df841920ad0a7a3d1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:47:37.829984 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0972cf64-b670-47f4-8a6f-226c4da7eb70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:37.830732 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0972cf64-b670-47f4-8a6f-226c4da7eb70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:37.832615 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1374/2763] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:47:37 2022] DELETE /identity/v3/projects/78a58ea9b85949df841920ad0a7a3d1e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:37.838481 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a847718-c88f-4c4d-b87d-4fcebe5a75a0 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:37.839320 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a847718-c88f-4c4d-b87d-4fcebe5a75a0 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:37.839320 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a847718-c88f-4c4d-b87d-4fcebe5a75a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:37.863807 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-2a847718-c88f-4c4d-b87d-4fcebe5a75a0 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:37.865026 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-2a847718-c88f-4c4d-b87d-4fcebe5a75a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:37.927777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1390/2764] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:37.937516 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccb057-bf0f-44b8-b45b-fd0c2f028311 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:37.937803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccb057-bf0f-44b8-b45b-fd0c2f028311 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:37.938088 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccb057-bf0f-44b8-b45b-fd0c2f028311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:37.957895 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-3eccb057-bf0f-44b8-b45b-fd0c2f028311 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:37.959127 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-3eccb057-bf0f-44b8-b45b-fd0c2f028311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:37.967191 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1375/2765] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:37.971839 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a847718-c88f-4c4d-b87d-4fcebe5a75a0 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:37.982028 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a847718-c88f-4c4d-b87d-4fcebe5a75a0 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:37.987310 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae327a-1a95-49fd-a5db-afbcc6acdc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:37.987966 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae327a-1a95-49fd-a5db-afbcc6acdc68 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:37.988255 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae327a-1a95-49fd-a5db-afbcc6acdc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:37.988533 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae327a-1a95-49fd-a5db-afbcc6acdc68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:37.989265 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae327a-1a95-49fd-a5db-afbcc6acdc68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:47:37.989607 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae327a-1a95-49fd-a5db-afbcc6acdc68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:37.991180 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae327a-1a95-49fd-a5db-afbcc6acdc68 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:38.004359 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1391/2766] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:47:38.008584 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccb057-bf0f-44b8-b45b-fd0c2f028311 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:38.020034 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccb057-bf0f-44b8-b45b-fd0c2f028311 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:38.025365 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0693d-a65c-40f7-a4bb-d064119c860f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:38.026213 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0693d-a65c-40f7-a4bb-d064119c860f admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:38.026534 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0693d-a65c-40f7-a4bb-d064119c860f admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:38.026864 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0693d-a65c-40f7-a4bb-d064119c860f admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:38.027673 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0693d-a65c-40f7-a4bb-d064119c860f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:38.029572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0693d-a65c-40f7-a4bb-d064119c860f admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:38.055560 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1376/2767] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:47:38 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:47:38.059828 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae327a-1a95-49fd-a5db-afbcc6acdc68 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:38.071077 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae327a-1a95-49fd-a5db-afbcc6acdc68 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:38.131569 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84660fc6-4f7e-4943-b6be-f5cde4b37ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:38.132341 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84660fc6-4f7e-4943-b6be-f5cde4b37ead admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:38.132630 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84660fc6-4f7e-4943-b6be-f5cde4b37ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:38.132912 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84660fc6-4f7e-4943-b6be-f5cde4b37ead admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:38.133630 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84660fc6-4f7e-4943-b6be-f5cde4b37ead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:38.135638 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84660fc6-4f7e-4943-b6be-f5cde4b37ead admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:38.157166 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1392/2768] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:47:38 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:47:38.161346 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0693d-a65c-40f7-a4bb-d064119c860f admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:38.171822 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0693d-a65c-40f7-a4bb-d064119c860f admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:38.176544 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76b2ff-0e1d-43a6-9bb9-28cb6d313499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:38.177209 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76b2ff-0e1d-43a6-9bb9-28cb6d313499 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:38.177498 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76b2ff-0e1d-43a6-9bb9-28cb6d313499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:38.177781 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76b2ff-0e1d-43a6-9bb9-28cb6d313499 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:38.178509 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76b2ff-0e1d-43a6-9bb9-28cb6d313499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:38.180152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76b2ff-0e1d-43a6-9bb9-28cb6d313499 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:38.192091 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1377/2769] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:47:38.196233 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84660fc6-4f7e-4943-b6be-f5cde4b37ead admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:38.206937 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84660fc6-4f7e-4943-b6be-f5cde4b37ead admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:38.211794 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659fb81-229b-465b-8722-c4740a96f06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:38.212455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659fb81-229b-465b-8722-c4740a96f06a admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:38.212745 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659fb81-229b-465b-8722-c4740a96f06a admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:38.213028 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659fb81-229b-465b-8722-c4740a96f06a admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:38.213756 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659fb81-229b-465b-8722-c4740a96f06a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:38.215367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659fb81-229b-465b-8722-c4740a96f06a admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:38.225948 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1393/2770] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:38.230134 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76b2ff-0e1d-43a6-9bb9-28cb6d313499 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:38.240176 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76b2ff-0e1d-43a6-9bb9-28cb6d313499 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:38.244861 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f5fee-0f61-4b68-bd09-5976cf6342a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:38.245731 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f5fee-0f61-4b68-bd09-5976cf6342a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:38.246017 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f5fee-0f61-4b68-bd09-5976cf6342a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:38.246300 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f5fee-0f61-4b68-bd09-5976cf6342a2 admin admin] PATH_INFO: `/v3/projects/01b9855539624bb69840d2c3af6372c8/users/c40b21d331464679bff6c84ae0ea7347/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:38.260778 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f5fee-0f61-4b68-bd09-5976cf6342a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01b9855539624bb69840d2c3af6372c8, user_id=c40b21d331464679bff6c84ae0ea7347, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:38.263423 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f5fee-0f61-4b68-bd09-5976cf6342a2 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:38.276999 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1378/2771] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:38 2022] PUT /identity/v3/projects/01b9855539624bb69840d2c3af6372c8/users/c40b21d331464679bff6c84ae0ea7347/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:38.288155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a455a1-c789-4b99-b08a-4cd6e31637ab None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:38.288452 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a455a1-c789-4b99-b08a-4cd6e31637ab None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:38.288733 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a455a1-c789-4b99-b08a-4cd6e31637ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:38.314003 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-21a455a1-c789-4b99-b08a-4cd6e31637ab None None] MFA Rules not processed for user `c40b21d331464679bff6c84ae0ea7347`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:38.315239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-21a455a1-c789-4b99-b08a-4cd6e31637ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:38.323101 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:38.380227 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1394/2772] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:38.384588 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f5fee-0f61-4b68-bd09-5976cf6342a2 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:38.446219 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f5fee-0f61-4b68-bd09-5976cf6342a2 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:38.450905 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64a9d3-b309-4df8-acf2-5b02941f41a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:38.451590 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64a9d3-b309-4df8-acf2-5b02941f41a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:38.451882 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64a9d3-b309-4df8-acf2-5b02941f41a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:38.452167 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64a9d3-b309-4df8-acf2-5b02941f41a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:38.452887 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64a9d3-b309-4df8-acf2-5b02941f41a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:38.454777 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64a9d3-b309-4df8-acf2-5b02941f41a6 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:38.485380 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1379/2773] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:47:38 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:47:38.489482 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a455a1-c789-4b99-b08a-4cd6e31637ab None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:38.500456 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a455a1-c789-4b99-b08a-4cd6e31637ab None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:38.559170 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c09d5-fd7d-4ba8-9eb2-84f24c40a33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:38.559876 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c09d5-fd7d-4ba8-9eb2-84f24c40a33c admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:38.560170 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c09d5-fd7d-4ba8-9eb2-84f24c40a33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:38.560455 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c09d5-fd7d-4ba8-9eb2-84f24c40a33c admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:38.561200 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c09d5-fd7d-4ba8-9eb2-84f24c40a33c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:38.563162 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c09d5-fd7d-4ba8-9eb2-84f24c40a33c admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:38.583152 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1395/2774] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:47:38 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:47:38.587232 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64a9d3-b309-4df8-acf2-5b02941f41a6 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:38.598094 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64a9d3-b309-4df8-acf2-5b02941f41a6 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:38.602919 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da7613-092d-4b10-a94b-fc4d4367f9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:38.603615 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da7613-092d-4b10-a94b-fc4d4367f9ad admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:38.603906 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da7613-092d-4b10-a94b-fc4d4367f9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:38.604259 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da7613-092d-4b10-a94b-fc4d4367f9ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:38.604920 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da7613-092d-4b10-a94b-fc4d4367f9ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:38.606528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da7613-092d-4b10-a94b-fc4d4367f9ad admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:38.618207 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1380/2775] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:38.622489 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c09d5-fd7d-4ba8-9eb2-84f24c40a33c admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:38.632649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c09d5-fd7d-4ba8-9eb2-84f24c40a33c admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:38.637230 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc3f20-16af-46b5-ab61-9b3b7ec0b397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:38.638104 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc3f20-16af-46b5-ab61-9b3b7ec0b397 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:38.638393 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc3f20-16af-46b5-ab61-9b3b7ec0b397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:38.638673 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc3f20-16af-46b5-ab61-9b3b7ec0b397 admin admin] PATH_INFO: `/v3/projects/a10b21cd5d63433ca3729260c4327f97/users/7945380feeb24d18beeabe56db19ebdc/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:38.653880 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc3f20-16af-46b5-ab61-9b3b7ec0b397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a10b21cd5d63433ca3729260c4327f97, user_id=7945380feeb24d18beeabe56db19ebdc, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:38.657066 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc3f20-16af-46b5-ab61-9b3b7ec0b397 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:38.672005 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1396/2776] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:38 2022] PUT /identity/v3/projects/a10b21cd5d63433ca3729260c4327f97/users/7945380feeb24d18beeabe56db19ebdc/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:38.675940 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da7613-092d-4b10-a94b-fc4d4367f9ad admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:38.685958 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da7613-092d-4b10-a94b-fc4d4367f9ad admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:38.714475 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:38.745407 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92492d4-446d-47b3-8b95-309b9769ea77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:38.746269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92492d4-446d-47b3-8b95-309b9769ea77 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:38.746566 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92492d4-446d-47b3-8b95-309b9769ea77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:38.746872 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92492d4-446d-47b3-8b95-309b9769ea77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:38.747605 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92492d4-446d-47b3-8b95-309b9769ea77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:38.749182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92492d4-446d-47b3-8b95-309b9769ea77 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:38.758791 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1381/2777] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:38.762962 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc3f20-16af-46b5-ab61-9b3b7ec0b397 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:38.773548 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc3f20-16af-46b5-ab61-9b3b7ec0b397 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:38.778168 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb0e8b-9ee5-47b7-b66a-cc9e6e41c96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:38.779043 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb0e8b-9ee5-47b7-b66a-cc9e6e41c96c admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:38.779360 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb0e8b-9ee5-47b7-b66a-cc9e6e41c96c admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:38.779637 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb0e8b-9ee5-47b7-b66a-cc9e6e41c96c admin admin] PATH_INFO: `/v3/projects/a10b21cd5d63433ca3729260c4327f97/users/7945380feeb24d18beeabe56db19ebdc/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:38.782133 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb0e8b-9ee5-47b7-b66a-cc9e6e41c96c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a10b21cd5d63433ca3729260c4327f97, user_id=7945380feeb24d18beeabe56db19ebdc, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:38.784787 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb0e8b-9ee5-47b7-b66a-cc9e6e41c96c admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:38.794824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1397/2778] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:38 2022] PUT /identity/v3/projects/a10b21cd5d63433ca3729260c4327f97/users/7945380feeb24d18beeabe56db19ebdc/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:38.810392 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16270ef-a959-4773-bb30-610d82a57ca1 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:38.810768 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16270ef-a959-4773-bb30-610d82a57ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:38.811121 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16270ef-a959-4773-bb30-610d82a57ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:38.839276 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-f16270ef-a959-4773-bb30-610d82a57ca1 None None] MFA Rules not processed for user `7945380feeb24d18beeabe56db19ebdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:38.840509 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-f16270ef-a959-4773-bb30-610d82a57ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:38.914328 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1382/2779] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:38.925340 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb0e8b-9ee5-47b7-b66a-cc9e6e41c96c admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:38.927108 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-0ebb0e8b-9ee5-47b7-b66a-cc9e6e41c96c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:38.986794 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb0e8b-9ee5-47b7-b66a-cc9e6e41c96c admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:38.991383 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4101a-8973-4335-be18-d18deeca8325 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:38.992041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4101a-8973-4335-be18-d18deeca8325 service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:38.992329 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4101a-8973-4335-be18-d18deeca8325 service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:38.992612 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4101a-8973-4335-be18-d18deeca8325 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:39.002270 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e4101a-8973-4335-be18-d18deeca8325 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:39.003744 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e4101a-8973-4335-be18-d18deeca8325 service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:39.013375 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1398/2780] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:39.078782 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16270ef-a959-4773-bb30-610d82a57ca1 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:39.143530 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16270ef-a959-4773-bb30-610d82a57ca1 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:39.148716 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e9c8b-545d-4b07-826e-6c3b773fb143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:39.149674 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e9c8b-545d-4b07-826e-6c3b773fb143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:39.150037 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e9c8b-545d-4b07-826e-6c3b773fb143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:39.150397 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e9c8b-545d-4b07-826e-6c3b773fb143 admin admin] PATH_INFO: `/v3/users/c40b21d331464679bff6c84ae0ea7347` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:39.151817 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e9c8b-545d-4b07-826e-6c3b773fb143 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c40b21d331464679bff6c84ae0ea7347)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:39.154144 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e9c8b-545d-4b07-826e-6c3b773fb143 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:39.203317 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-637e9c8b-545d-4b07-826e-6c3b773fb143 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c40b21d331464679bff6c84ae0ea7347'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:39.208611 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:39.217065 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-637e9c8b-545d-4b07-826e-6c3b773fb143 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c40b21d331464679bff6c84ae0ea7347'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:39.224805 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-637e9c8b-545d-4b07-826e-6c3b773fb143 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c40b21d331464679bff6c84ae0ea7347'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:39.225564 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-637e9c8b-545d-4b07-826e-6c3b773fb143 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c40b21d331464679bff6c84ae0ea7347'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:39.226210 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-637e9c8b-545d-4b07-826e-6c3b773fb143 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c40b21d331464679bff6c84ae0ea7347'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:39.244463 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1383/2781] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:47:39 2022] DELETE /identity/v3/users/c40b21d331464679bff6c84ae0ea7347 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:39.246123 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4d26f-4a3e-43b4-b4a8-ac1d205a3cc7 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:39.246571 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4d26f-4a3e-43b4-b4a8-ac1d205a3cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:39.246774 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4d26f-4a3e-43b4-b4a8-ac1d205a3cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:39.254461 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:39.267774 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-6ed4d26f-4a3e-43b4-b4a8-ac1d205a3cc7 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:39.269047 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-6ed4d26f-4a3e-43b4-b4a8-ac1d205a3cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:39.332033 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1399/2782] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:39.342010 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e9c8b-545d-4b07-826e-6c3b773fb143 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:39.343997 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-637e9c8b-545d-4b07-826e-6c3b773fb143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:39.407721 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e9c8b-545d-4b07-826e-6c3b773fb143 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:39.411478 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83321010-696f-42cc-acaa-9558974298d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:39.412096 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83321010-696f-42cc-acaa-9558974298d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:39.412384 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83321010-696f-42cc-acaa-9558974298d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:39.412667 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83321010-696f-42cc-acaa-9558974298d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:39.423420 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83321010-696f-42cc-acaa-9558974298d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:39.424853 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83321010-696f-42cc-acaa-9558974298d9 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:39.434691 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1384/2783] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:39.724140 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4d26f-4a3e-43b4-b4a8-ac1d205a3cc7 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:39.725727 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-6ed4d26f-4a3e-43b4-b4a8-ac1d205a3cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:39.740350 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4d26f-4a3e-43b4-b4a8-ac1d205a3cc7 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:39.746168 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee74dc7-9405-4778-b7f0-5dc428045491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:39.747103 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee74dc7-9405-4778-b7f0-5dc428045491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:39.747436 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee74dc7-9405-4778-b7f0-5dc428045491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:39.747895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee74dc7-9405-4778-b7f0-5dc428045491 admin admin] PATH_INFO: `/v3/projects/01b9855539624bb69840d2c3af6372c8` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:39.749123 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee74dc7-9405-4778-b7f0-5dc428045491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01b9855539624bb69840d2c3af6372c8)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:39.751119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee74dc7-9405-4778-b7f0-5dc428045491 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:39.800678 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2ee74dc7-9405-4778-b7f0-5dc428045491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01b9855539624bb69840d2c3af6372c8', 'request_id': 'req-2ee74dc7-9405-4778-b7f0-5dc428045491'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:39.806942 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2ee74dc7-9405-4778-b7f0-5dc428045491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01b9855539624bb69840d2c3af6372c8', 'request_id': 'req-2ee74dc7-9405-4778-b7f0-5dc428045491'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:39.814648 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2ee74dc7-9405-4778-b7f0-5dc428045491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01b9855539624bb69840d2c3af6372c8', 'request_id': 'req-2ee74dc7-9405-4778-b7f0-5dc428045491'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:39.825553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2ee74dc7-9405-4778-b7f0-5dc428045491 admin admin] The token cache is being invalidate because project 01b9855539624bb69840d2c3af6372c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:47:39.825847 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2ee74dc7-9405-4778-b7f0-5dc428045491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:39.826493 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2ee74dc7-9405-4778-b7f0-5dc428045491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:39.828567 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1400/2784] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:47:39 2022] DELETE /identity/v3/projects/01b9855539624bb69840d2c3af6372c8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:47:39.833146 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83321010-696f-42cc-acaa-9558974298d9 service neutron] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:39.844417 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83321010-696f-42cc-acaa-9558974298d9 service neutron] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:39.909673 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d81197-bb26-4e1d-89c3-76291ed99a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:39.911124 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d81197-bb26-4e1d-89c3-76291ed99a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:39.911708 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d81197-bb26-4e1d-89c3-76291ed99a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:39.911996 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d81197-bb26-4e1d-89c3-76291ed99a36 admin admin] PATH_INFO: `/v3/users/7945380feeb24d18beeabe56db19ebdc` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:39.913224 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d81197-bb26-4e1d-89c3-76291ed99a36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7945380feeb24d18beeabe56db19ebdc)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:39.915526 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d81197-bb26-4e1d-89c3-76291ed99a36 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:39.965590 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-67d81197-bb26-4e1d-89c3-76291ed99a36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7945380feeb24d18beeabe56db19ebdc'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:39.978474 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-67d81197-bb26-4e1d-89c3-76291ed99a36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7945380feeb24d18beeabe56db19ebdc'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:39.986217 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-67d81197-bb26-4e1d-89c3-76291ed99a36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7945380feeb24d18beeabe56db19ebdc'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:39.986907 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-67d81197-bb26-4e1d-89c3-76291ed99a36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7945380feeb24d18beeabe56db19ebdc'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:39.987544 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-67d81197-bb26-4e1d-89c3-76291ed99a36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7945380feeb24d18beeabe56db19ebdc'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:39.990108 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:40.003844 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1385/2785] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:47:39 2022] DELETE /identity/v3/users/7945380feeb24d18beeabe56db19ebdc => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:40.282938 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee74dc7-9405-4778-b7f0-5dc428045491 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:40.284664 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-2ee74dc7-9405-4778-b7f0-5dc428045491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:40.298191 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee74dc7-9405-4778-b7f0-5dc428045491 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:40.354740 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584fe59-28b7-4674-8696-1758293ef2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:40.355637 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584fe59-28b7-4674-8696-1758293ef2bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:40.355926 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584fe59-28b7-4674-8696-1758293ef2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:40.356198 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584fe59-28b7-4674-8696-1758293ef2bf admin admin] PATH_INFO: `/v3/projects/a10b21cd5d63433ca3729260c4327f97` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:40.357383 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584fe59-28b7-4674-8696-1758293ef2bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a10b21cd5d63433ca3729260c4327f97)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:40.359945 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584fe59-28b7-4674-8696-1758293ef2bf admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:40.393714 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:40.407803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-0584fe59-28b7-4674-8696-1758293ef2bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a10b21cd5d63433ca3729260c4327f97', 'request_id': 'req-0584fe59-28b7-4674-8696-1758293ef2bf'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:40.414028 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-0584fe59-28b7-4674-8696-1758293ef2bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a10b21cd5d63433ca3729260c4327f97', 'request_id': 'req-0584fe59-28b7-4674-8696-1758293ef2bf'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:40.424537 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-0584fe59-28b7-4674-8696-1758293ef2bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a10b21cd5d63433ca3729260c4327f97', 'request_id': 'req-0584fe59-28b7-4674-8696-1758293ef2bf'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:40.440383 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-0584fe59-28b7-4674-8696-1758293ef2bf admin admin] The token cache is being invalidate because project a10b21cd5d63433ca3729260c4327f97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:47:40.440677 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-0584fe59-28b7-4674-8696-1758293ef2bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:40.441329 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-0584fe59-28b7-4674-8696-1758293ef2bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:40.442878 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1401/2786] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:47:40 2022] DELETE /identity/v3/projects/a10b21cd5d63433ca3729260c4327f97 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:40.447748 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd381619-48a7-40ad-ab5c-e71b8117c002 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:40.448607 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd381619-48a7-40ad-ab5c-e71b8117c002 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:40.448607 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd381619-48a7-40ad-ab5c-e71b8117c002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:40.466396 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-cd381619-48a7-40ad-ab5c-e71b8117c002 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:40.467643 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-cd381619-48a7-40ad-ab5c-e71b8117c002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:40.527691 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1386/2787] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:40.587684 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c24cd-c53b-4e88-9b0b-b974638c3f52 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:40.587985 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c24cd-c53b-4e88-9b0b-b974638c3f52 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:40.588273 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c24cd-c53b-4e88-9b0b-b974638c3f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:40.607286 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-4c8c24cd-c53b-4e88-9b0b-b974638c3f52 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:40.608491 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-4c8c24cd-c53b-4e88-9b0b-b974638c3f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:40.618382 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1402/2788] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:40.622767 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd381619-48a7-40ad-ab5c-e71b8117c002 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:40.633676 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd381619-48a7-40ad-ab5c-e71b8117c002 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:40.638343 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b7369-dfea-47fc-ad04-c97226867bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:40.639007 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b7369-dfea-47fc-ad04-c97226867bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:40.639330 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b7369-dfea-47fc-ad04-c97226867bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:40.639615 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b7369-dfea-47fc-ad04-c97226867bd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:40.640353 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b7369-dfea-47fc-ad04-c97226867bd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80305) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:47:40.640935 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b7369-dfea-47fc-ad04-c97226867bd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:40.642610 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b7369-dfea-47fc-ad04-c97226867bd2 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:40.655309 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1387/2789] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:47:40.660385 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c24cd-c53b-4e88-9b0b-b974638c3f52 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:40.671849 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c24cd-c53b-4e88-9b0b-b974638c3f52 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:40.677361 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7364c-e375-457f-b5b2-302dc41c23b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:40.677623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7364c-e375-457f-b5b2-302dc41c23b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:40.677913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7364c-e375-457f-b5b2-302dc41c23b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:40.678196 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7364c-e375-457f-b5b2-302dc41c23b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:40.678909 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7364c-e375-457f-b5b2-302dc41c23b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:40.680819 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7364c-e375-457f-b5b2-302dc41c23b2 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:40.711423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1403/2790] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:47:40 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:47:40.712408 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b7369-dfea-47fc-ad04-c97226867bd2 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:40.723181 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b7369-dfea-47fc-ad04-c97226867bd2 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:40.788358 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c4af2-2dd5-42bd-a09f-99de5a657104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:40.789079 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c4af2-2dd5-42bd-a09f-99de5a657104 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:40.789471 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c4af2-2dd5-42bd-a09f-99de5a657104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:40.789657 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c4af2-2dd5-42bd-a09f-99de5a657104 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:40.790338 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c4af2-2dd5-42bd-a09f-99de5a657104 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:40.792320 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c4af2-2dd5-42bd-a09f-99de5a657104 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:40.815807 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1388/2791] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:47:40 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:47:40.820130 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7364c-e375-457f-b5b2-302dc41c23b2 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:40.830774 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7364c-e375-457f-b5b2-302dc41c23b2 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:40.835658 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd872c6e-e57f-4fe4-a8aa-ac666f530a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:40.836338 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd872c6e-e57f-4fe4-a8aa-ac666f530a5f admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:40.836630 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd872c6e-e57f-4fe4-a8aa-ac666f530a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:40.836913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd872c6e-e57f-4fe4-a8aa-ac666f530a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:40.837658 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd872c6e-e57f-4fe4-a8aa-ac666f530a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:40.839278 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd872c6e-e57f-4fe4-a8aa-ac666f530a5f admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:40.851850 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1404/2792] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:40.856800 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c4af2-2dd5-42bd-a09f-99de5a657104 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:40.870001 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c4af2-2dd5-42bd-a09f-99de5a657104 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:40.875528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acf2b7-80b1-47e5-9a4b-833284d51d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:40.876363 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acf2b7-80b1-47e5-9a4b-833284d51d87 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:40.876654 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acf2b7-80b1-47e5-9a4b-833284d51d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:40.876933 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acf2b7-80b1-47e5-9a4b-833284d51d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:40.877673 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39acf2b7-80b1-47e5-9a4b-833284d51d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:40.879123 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd872c6e-e57f-4fe4-a8aa-ac666f530a5f admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:40.879481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39acf2b7-80b1-47e5-9a4b-833284d51d87 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:40.880923 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-cd872c6e-e57f-4fe4-a8aa-ac666f530a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:40.890314 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1389/2793] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:40.894896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd872c6e-e57f-4fe4-a8aa-ac666f530a5f admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:40.895148 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acf2b7-80b1-47e5-9a4b-833284d51d87 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:40.899649 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ec4b3-97f9-410a-b5f0-4f177509c3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:40.900524 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ec4b3-97f9-410a-b5f0-4f177509c3fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:40.900813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ec4b3-97f9-410a-b5f0-4f177509c3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:40.901096 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ec4b3-97f9-410a-b5f0-4f177509c3fb admin admin] PATH_INFO: `/v3/users/a11d6dd1f6664c23befc07608ca6af1c` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:40.902305 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ec4b3-97f9-410a-b5f0-4f177509c3fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a11d6dd1f6664c23befc07608ca6af1c)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:40.904324 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ec4b3-97f9-410a-b5f0-4f177509c3fb admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:40.905276 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acf2b7-80b1-47e5-9a4b-833284d51d87 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:40.910981 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da61b0-437c-497e-9d97-4f6649d46fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:40.911877 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da61b0-437c-497e-9d97-4f6649d46fac admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:40.912160 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da61b0-437c-497e-9d97-4f6649d46fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:40.912437 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da61b0-437c-497e-9d97-4f6649d46fac admin admin] PATH_INFO: `/v3/projects/4e3dfb63ce464f40b6cfe62ede844c88/users/1e7db1f7cb47429b8366fbea576007fc/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:40.929329 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da61b0-437c-497e-9d97-4f6649d46fac admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e3dfb63ce464f40b6cfe62ede844c88, user_id=1e7db1f7cb47429b8366fbea576007fc, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:40.932018 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da61b0-437c-497e-9d97-4f6649d46fac admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:40.950457 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1390/2794] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:40 2022] PUT /identity/v3/projects/4e3dfb63ce464f40b6cfe62ede844c88/users/1e7db1f7cb47429b8366fbea576007fc/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:47:40.960977 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d17adb-9b71-4220-b377-f70f443fd605 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:40.961294 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d17adb-9b71-4220-b377-f70f443fd605 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:40.961747 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d17adb-9b71-4220-b377-f70f443fd605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:40.964424 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-d12ec4b3-97f9-410a-b5f0-4f177509c3fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a11d6dd1f6664c23befc07608ca6af1c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:40.978744 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-d12ec4b3-97f9-410a-b5f0-4f177509c3fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a11d6dd1f6664c23befc07608ca6af1c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:40.986543 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-d12ec4b3-97f9-410a-b5f0-4f177509c3fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a11d6dd1f6664c23befc07608ca6af1c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:40.987345 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-d12ec4b3-97f9-410a-b5f0-4f177509c3fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a11d6dd1f6664c23befc07608ca6af1c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:40.987994 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-d12ec4b3-97f9-410a-b5f0-4f177509c3fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a11d6dd1f6664c23befc07608ca6af1c'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:40.997931 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-d0d17adb-9b71-4220-b377-f70f443fd605 None None] MFA Rules not processed for user `1e7db1f7cb47429b8366fbea576007fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:40.999874 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-d0d17adb-9b71-4220-b377-f70f443fd605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:41.005853 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1405/2795] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:47:40 2022] DELETE /identity/v3/users/a11d6dd1f6664c23befc07608ca6af1c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:47:41.010981 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6160b-407c-4927-a92a-f28daecd50d4 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:41.011537 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6160b-407c-4927-a92a-f28daecd50d4 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:41.012041 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6160b-407c-4927-a92a-f28daecd50d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:41.039071 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-39b6160b-407c-4927-a92a-f28daecd50d4 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:41.040477 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:41.040933 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-39b6160b-407c-4927-a92a-f28daecd50d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:41.089669 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1391/2796] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:47:41.094954 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d17adb-9b71-4220-b377-f70f443fd605 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:41.095199 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:41.096404 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-d0d17adb-9b71-4220-b377-f70f443fd605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:41.112134 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1406/2797] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:47:41.123141 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6160b-407c-4927-a92a-f28daecd50d4 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:41.124524 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-39b6160b-407c-4927-a92a-f28daecd50d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:41.163711 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d17adb-9b71-4220-b377-f70f443fd605 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:41.168346 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094317c-6342-4632-b59e-3b9f3c1665d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:41.169013 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094317c-6342-4632-b59e-3b9f3c1665d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:41.169299 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094317c-6342-4632-b59e-3b9f3c1665d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:41.169580 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094317c-6342-4632-b59e-3b9f3c1665d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:41.170271 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094317c-6342-4632-b59e-3b9f3c1665d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:41.172318 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094317c-6342-4632-b59e-3b9f3c1665d2 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:41.182519 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6160b-407c-4927-a92a-f28daecd50d4 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:41.186148 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfe5c4-ebc6-419a-888f-b37b86c23754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:41.186846 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfe5c4-ebc6-419a-888f-b37b86c23754 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:41.187143 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfe5c4-ebc6-419a-888f-b37b86c23754 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:41.187462 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfe5c4-ebc6-419a-888f-b37b86c23754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:41.197082 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfe5c4-ebc6-419a-888f-b37b86c23754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:41.200921 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1392/2798] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:47:41 2022] POST /identity/v3/projects => generated 391 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:47:41.201082 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfe5c4-ebc6-419a-888f-b37b86c23754 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:41.201863 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094317c-6342-4632-b59e-3b9f3c1665d2 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:41.209152 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1407/2799] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:47:41.270462 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094317c-6342-4632-b59e-3b9f3c1665d2 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:41.275618 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ebc9bb-8e2e-4c23-9c73-7c24f9502915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:41.276303 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebc9bb-8e2e-4c23-9c73-7c24f9502915 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:41.276594 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebc9bb-8e2e-4c23-9c73-7c24f9502915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:41.276885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebc9bb-8e2e-4c23-9c73-7c24f9502915 admin admin] PATH_INFO: `/v3/users` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:41.277584 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ebc9bb-8e2e-4c23-9c73-7c24f9502915 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:41.279717 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ebc9bb-8e2e-4c23-9c73-7c24f9502915 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:41.303877 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1393/2800] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:47:41 2022] POST /identity/v3/users => generated 302 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:47:41.305236 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfe5c4-ebc6-419a-888f-b37b86c23754 service neutron] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:41.315973 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfe5c4-ebc6-419a-888f-b37b86c23754 service neutron] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:41.320686 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ddd2a7-21fb-4ce6-ba90-284f54f548ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:41.321356 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddd2a7-21fb-4ce6-ba90-284f54f548ad admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:41.321665 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddd2a7-21fb-4ce6-ba90-284f54f548ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:41.321930 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddd2a7-21fb-4ce6-ba90-284f54f548ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:41.322663 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ddd2a7-21fb-4ce6-ba90-284f54f548ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:41.324294 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ddd2a7-21fb-4ce6-ba90-284f54f548ad admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:41.335684 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1408/2801] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:41.339856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ebc9bb-8e2e-4c23-9c73-7c24f9502915 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:41.351152 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ebc9bb-8e2e-4c23-9c73-7c24f9502915 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:41.358231 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6941cde-d825-44b8-b652-9eb0797fd5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:41.359320 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6941cde-d825-44b8-b652-9eb0797fd5f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:41.359739 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6941cde-d825-44b8-b652-9eb0797fd5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:41.360127 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6941cde-d825-44b8-b652-9eb0797fd5f5 admin admin] PATH_INFO: `/v3/projects/88fb26ab97cc4e11906fc5d193312fad/users/bfbf0ed441d14d8b91422867d034714b/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:41.379281 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6941cde-d825-44b8-b652-9eb0797fd5f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88fb26ab97cc4e11906fc5d193312fad, user_id=bfbf0ed441d14d8b91422867d034714b, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:41.382354 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6941cde-d825-44b8-b652-9eb0797fd5f5 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:41.396705 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1394/2802] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:41 2022] PUT /identity/v3/projects/88fb26ab97cc4e11906fc5d193312fad/users/bfbf0ed441d14d8b91422867d034714b/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:41.400943 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ddd2a7-21fb-4ce6-ba90-284f54f548ad admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:41.412061 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ddd2a7-21fb-4ce6-ba90-284f54f548ad admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:41.471635 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f6546-a284-4b35-a8fb-21a86272c56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:41.472314 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f6546-a284-4b35-a8fb-21a86272c56f admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:41.472605 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f6546-a284-4b35-a8fb-21a86272c56f admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:41.472895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f6546-a284-4b35-a8fb-21a86272c56f admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:41.473632 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f6546-a284-4b35-a8fb-21a86272c56f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:41.475615 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f6546-a284-4b35-a8fb-21a86272c56f admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:41.485249 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6941cde-d825-44b8-b652-9eb0797fd5f5 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:41.488468 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-a6941cde-d825-44b8-b652-9eb0797fd5f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:41.491262 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1409/2803] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:47:41.493155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f6546-a284-4b35-a8fb-21a86272c56f admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:41.504364 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f6546-a284-4b35-a8fb-21a86272c56f admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:41.505290 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6941cde-d825-44b8-b652-9eb0797fd5f5 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:41.510097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d833dce-14fe-473c-b319-0e775b1e6265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:41.510281 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9840ab-aff9-4d9c-a23e-4616f30e9c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:41.510965 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d833dce-14fe-473c-b319-0e775b1e6265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:41.511282 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d833dce-14fe-473c-b319-0e775b1e6265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:41.511488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9840ab-aff9-4d9c-a23e-4616f30e9c5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:41.511625 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d833dce-14fe-473c-b319-0e775b1e6265 admin admin] PATH_INFO: `/v3/projects/19013748aaf34e9d906bd95d63bbe4d8` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:41.511796 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9840ab-aff9-4d9c-a23e-4616f30e9c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:41.512093 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9840ab-aff9-4d9c-a23e-4616f30e9c5a admin admin] PATH_INFO: `/v3/projects/88fb26ab97cc4e11906fc5d193312fad/users/bfbf0ed441d14d8b91422867d034714b/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:41.512987 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d833dce-14fe-473c-b319-0e775b1e6265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19013748aaf34e9d906bd95d63bbe4d8)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:41.514633 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9840ab-aff9-4d9c-a23e-4616f30e9c5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=88fb26ab97cc4e11906fc5d193312fad, user_id=bfbf0ed441d14d8b91422867d034714b, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:41.516114 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d833dce-14fe-473c-b319-0e775b1e6265 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:41.518064 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9840ab-aff9-4d9c-a23e-4616f30e9c5a admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:41.527837 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:41.529687 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1410/2804] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:41 2022] PUT /identity/v3/projects/88fb26ab97cc4e11906fc5d193312fad/users/bfbf0ed441d14d8b91422867d034714b/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:47:41.542630 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7b867-3af8-42d7-acef-be975ce556d4 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:41.542932 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7b867-3af8-42d7-acef-be975ce556d4 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:41.543302 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7b867-3af8-42d7-acef-be975ce556d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:41.569978 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0d833dce-14fe-473c-b319-0e775b1e6265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19013748aaf34e9d906bd95d63bbe4d8', 'request_id': 'req-0d833dce-14fe-473c-b319-0e775b1e6265'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:41.572368 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-cca7b867-3af8-42d7-acef-be975ce556d4 None None] MFA Rules not processed for user `bfbf0ed441d14d8b91422867d034714b`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:41.573590 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-cca7b867-3af8-42d7-acef-be975ce556d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:41.576798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0d833dce-14fe-473c-b319-0e775b1e6265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19013748aaf34e9d906bd95d63bbe4d8', 'request_id': 'req-0d833dce-14fe-473c-b319-0e775b1e6265'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:41.585313 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0d833dce-14fe-473c-b319-0e775b1e6265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19013748aaf34e9d906bd95d63bbe4d8', 'request_id': 'req-0d833dce-14fe-473c-b319-0e775b1e6265'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:41.598063 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0d833dce-14fe-473c-b319-0e775b1e6265 admin admin] The token cache is being invalidate because project 19013748aaf34e9d906bd95d63bbe4d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:47:41.598398 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0d833dce-14fe-473c-b319-0e775b1e6265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:41.599071 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-0d833dce-14fe-473c-b319-0e775b1e6265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:41.600789 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1395/2805] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:47:41 2022] DELETE /identity/v3/projects/19013748aaf34e9d906bd95d63bbe4d8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:47:41.604672 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d833dce-14fe-473c-b319-0e775b1e6265 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:41.606048 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-0d833dce-14fe-473c-b319-0e775b1e6265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:41.628015 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:41.648994 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1411/2806] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:47:41.660049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7b867-3af8-42d7-acef-be975ce556d4 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:41.661312 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-cca7b867-3af8-42d7-acef-be975ce556d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:41.673204 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d833dce-14fe-473c-b319-0e775b1e6265 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:41.679329 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad6471-2b13-4590-ac86-79c4404d1853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:41.680943 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad6471-2b13-4590-ac86-79c4404d1853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:41.681233 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad6471-2b13-4590-ac86-79c4404d1853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:41.681923 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad6471-2b13-4590-ac86-79c4404d1853 admin admin] PATH_INFO: `/v3/users/6d7448d4bd0e4534974bf4bd35cfa610` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:41.683659 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad6471-2b13-4590-ac86-79c4404d1853 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d7448d4bd0e4534974bf4bd35cfa610)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:41.685629 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad6471-2b13-4590-ac86-79c4404d1853 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:41.721577 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7b867-3af8-42d7-acef-be975ce556d4 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:41.725645 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edac822-4dc1-45fb-ad2f-856fcfca33e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:41.726301 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edac822-4dc1-45fb-ad2f-856fcfca33e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:41.726590 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edac822-4dc1-45fb-ad2f-856fcfca33e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:41.726869 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edac822-4dc1-45fb-ad2f-856fcfca33e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:41.736348 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edac822-4dc1-45fb-ad2f-856fcfca33e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:41.736503 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-d7ad6471-2b13-4590-ac86-79c4404d1853 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d7448d4bd0e4534974bf4bd35cfa610'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:41.737779 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edac822-4dc1-45fb-ad2f-856fcfca33e6 service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:41.747640 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1412/2807] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:41 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:47:41.752372 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-d7ad6471-2b13-4590-ac86-79c4404d1853 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d7448d4bd0e4534974bf4bd35cfa610'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:41.761007 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-d7ad6471-2b13-4590-ac86-79c4404d1853 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d7448d4bd0e4534974bf4bd35cfa610'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:41.762182 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-d7ad6471-2b13-4590-ac86-79c4404d1853 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d7448d4bd0e4534974bf4bd35cfa610'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:41.763013 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-d7ad6471-2b13-4590-ac86-79c4404d1853 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d7448d4bd0e4534974bf4bd35cfa610'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:41.778764 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1396/2808] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:47:41 2022] DELETE /identity/v3/users/6d7448d4bd0e4534974bf4bd35cfa610 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:47:41.797970 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edac822-4dc1-45fb-ad2f-856fcfca33e6 service cinder] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:41.799655 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-2edac822-4dc1-45fb-ad2f-856fcfca33e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:41.813999 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edac822-4dc1-45fb-ad2f-856fcfca33e6 service cinder] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:41.873299 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456b56b-16f9-4200-abe1-8264c582a761 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:41.874047 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456b56b-16f9-4200-abe1-8264c582a761 service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:41.875022 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456b56b-16f9-4200-abe1-8264c582a761 service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:41.875408 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456b56b-16f9-4200-abe1-8264c582a761 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:41.878021 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-e456b56b-16f9-4200-abe1-8264c582a761 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:41.954935 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456b56b-16f9-4200-abe1-8264c582a761 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:41.956411 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456b56b-16f9-4200-abe1-8264c582a761 service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:41.966119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1413/2809] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:42.079243 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad6471-2b13-4590-ac86-79c4404d1853 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:42.081568 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-d7ad6471-2b13-4590-ac86-79c4404d1853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:42.116622 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:42.178282 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad6471-2b13-4590-ac86-79c4404d1853 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:42.183771 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf50f62-d810-40a1-aae6-8e3dd1320487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:42.184636 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf50f62-d810-40a1-aae6-8e3dd1320487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:42.184927 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf50f62-d810-40a1-aae6-8e3dd1320487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:42.185207 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf50f62-d810-40a1-aae6-8e3dd1320487 admin admin] PATH_INFO: `/v3/projects/d90d2f9939e44e0ba82e24aa7e0de0af` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:42.187596 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf50f62-d810-40a1-aae6-8e3dd1320487 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d90d2f9939e44e0ba82e24aa7e0de0af)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:42.189784 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf50f62-d810-40a1-aae6-8e3dd1320487 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:42.241363 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-fbf50f62-d810-40a1-aae6-8e3dd1320487 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd90d2f9939e44e0ba82e24aa7e0de0af', 'request_id': 'req-fbf50f62-d810-40a1-aae6-8e3dd1320487'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:42.247737 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-fbf50f62-d810-40a1-aae6-8e3dd1320487 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd90d2f9939e44e0ba82e24aa7e0de0af', 'request_id': 'req-fbf50f62-d810-40a1-aae6-8e3dd1320487'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:42.256993 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-fbf50f62-d810-40a1-aae6-8e3dd1320487 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd90d2f9939e44e0ba82e24aa7e0de0af', 'request_id': 'req-fbf50f62-d810-40a1-aae6-8e3dd1320487'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:42.268663 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-fbf50f62-d810-40a1-aae6-8e3dd1320487 admin admin] The token cache is being invalidate because project d90d2f9939e44e0ba82e24aa7e0de0af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:47:42.269114 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-fbf50f62-d810-40a1-aae6-8e3dd1320487 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:42.269788 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-fbf50f62-d810-40a1-aae6-8e3dd1320487 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:42.271698 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1397/2810] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:47:42 2022] DELETE /identity/v3/projects/d90d2f9939e44e0ba82e24aa7e0de0af => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:42.276513 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d535a6-e637-4613-926d-126a2380aee9 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:42.276764 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d535a6-e637-4613-926d-126a2380aee9 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:42.277044 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d535a6-e637-4613-926d-126a2380aee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:42.297971 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-28d535a6-e637-4613-926d-126a2380aee9 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:42.299211 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-28d535a6-e637-4613-926d-126a2380aee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:42.347765 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=100 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:42.364249 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1414/2811] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:42.372155 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d9f89-7350-4330-8402-e4fd0ce56ef9 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:42.372443 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d9f89-7350-4330-8402-e4fd0ce56ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:42.372724 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d9f89-7350-4330-8402-e4fd0ce56ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:42.392796 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-3c9d9f89-7350-4330-8402-e4fd0ce56ef9 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:42.394684 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-3c9d9f89-7350-4330-8402-e4fd0ce56ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:42.404602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1398/2812] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:42.409412 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d535a6-e637-4613-926d-126a2380aee9 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:42.419407 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d535a6-e637-4613-926d-126a2380aee9 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:42.428530 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b968ee7-4a45-4d13-b283-91dba9b9e7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:42.429196 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b968ee7-4a45-4d13-b283-91dba9b9e7ca admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:42.429485 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b968ee7-4a45-4d13-b283-91dba9b9e7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:42.433434 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b968ee7-4a45-4d13-b283-91dba9b9e7ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:42.433434 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b968ee7-4a45-4d13-b283-91dba9b9e7ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:47:42.433434 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b968ee7-4a45-4d13-b283-91dba9b9e7ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:42.433434 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b968ee7-4a45-4d13-b283-91dba9b9e7ca admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:42.444580 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1415/2813] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:47:42.449068 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d9f89-7350-4330-8402-e4fd0ce56ef9 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:42.458550 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d9f89-7350-4330-8402-e4fd0ce56ef9 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:42.463239 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14586de9-80d0-4eb6-92cb-e1261371fde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:42.463896 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14586de9-80d0-4eb6-92cb-e1261371fde7 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:42.464181 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14586de9-80d0-4eb6-92cb-e1261371fde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:42.464458 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14586de9-80d0-4eb6-92cb-e1261371fde7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:42.465145 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14586de9-80d0-4eb6-92cb-e1261371fde7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:42.467019 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14586de9-80d0-4eb6-92cb-e1261371fde7 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:42.494720 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1399/2814] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:47:42 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:47:42.498895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b968ee7-4a45-4d13-b283-91dba9b9e7ca admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:42.508884 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b968ee7-4a45-4d13-b283-91dba9b9e7ca admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:42.565554 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021194d-eb90-4e15-b01d-25f1791d8f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:42.566222 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021194d-eb90-4e15-b01d-25f1791d8f34 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:42.566505 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021194d-eb90-4e15-b01d-25f1791d8f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:42.566782 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021194d-eb90-4e15-b01d-25f1791d8f34 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:42.567511 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021194d-eb90-4e15-b01d-25f1791d8f34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:42.569395 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021194d-eb90-4e15-b01d-25f1791d8f34 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:42.589329 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1416/2815] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:47:42 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:47:42.594092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14586de9-80d0-4eb6-92cb-e1261371fde7 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:42.604840 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14586de9-80d0-4eb6-92cb-e1261371fde7 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:42.610010 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325df8b-7842-4db0-943e-fd87ab1f0cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:42.610676 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325df8b-7842-4db0-943e-fd87ab1f0cde admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:42.610961 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325df8b-7842-4db0-943e-fd87ab1f0cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:42.611268 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325df8b-7842-4db0-943e-fd87ab1f0cde admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:42.612009 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325df8b-7842-4db0-943e-fd87ab1f0cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:42.613588 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325df8b-7842-4db0-943e-fd87ab1f0cde admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:42.624383 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1400/2816] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:47:42.628421 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021194d-eb90-4e15-b01d-25f1791d8f34 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:42.638278 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021194d-eb90-4e15-b01d-25f1791d8f34 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:42.644020 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13d8d9-922c-45f8-afdc-9cca97b8c65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:42.644719 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13d8d9-922c-45f8-afdc-9cca97b8c65f admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:42.645012 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13d8d9-922c-45f8-afdc-9cca97b8c65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:42.645299 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13d8d9-922c-45f8-afdc-9cca97b8c65f admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:42.646065 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d13d8d9-922c-45f8-afdc-9cca97b8c65f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:42.647704 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d13d8d9-922c-45f8-afdc-9cca97b8c65f admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:42.662056 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1417/2817] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:42.663194 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325df8b-7842-4db0-943e-fd87ab1f0cde admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:42.673291 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325df8b-7842-4db0-943e-fd87ab1f0cde admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:42.677883 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592e7e9-a06e-4f16-a0ce-47903b9cc192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:42.678760 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592e7e9-a06e-4f16-a0ce-47903b9cc192 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:42.679040 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592e7e9-a06e-4f16-a0ce-47903b9cc192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:42.679351 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592e7e9-a06e-4f16-a0ce-47903b9cc192 admin admin] PATH_INFO: `/v3/projects/805ee1dd5d114709be1b4ae612b26b5b/users/41fb498a6dbe4f4685cf7370e17e1077/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:42.693707 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592e7e9-a06e-4f16-a0ce-47903b9cc192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=805ee1dd5d114709be1b4ae612b26b5b, user_id=41fb498a6dbe4f4685cf7370e17e1077, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:42.696363 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592e7e9-a06e-4f16-a0ce-47903b9cc192 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:42.709355 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1401/2818] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:42 2022] PUT /identity/v3/projects/805ee1dd5d114709be1b4ae612b26b5b/users/41fb498a6dbe4f4685cf7370e17e1077/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:42.721140 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c2d98-0f0c-4cbf-8826-a467c8f7cdc8 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:42.721437 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c2d98-0f0c-4cbf-8826-a467c8f7cdc8 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:42.721730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c2d98-0f0c-4cbf-8826-a467c8f7cdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:42.748078 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-8f6c2d98-0f0c-4cbf-8826-a467c8f7cdc8 None None] MFA Rules not processed for user `41fb498a6dbe4f4685cf7370e17e1077`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:42.749292 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-8f6c2d98-0f0c-4cbf-8826-a467c8f7cdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:42.816337 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1418/2819] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:42.820838 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592e7e9-a06e-4f16-a0ce-47903b9cc192 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:42.874023 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:42.893553 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592e7e9-a06e-4f16-a0ce-47903b9cc192 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:42.898229 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c884d6-caf3-4aad-9c7f-2cce64bea8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:42.898885 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c884d6-caf3-4aad-9c7f-2cce64bea8c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:42.899171 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c884d6-caf3-4aad-9c7f-2cce64bea8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:42.899478 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c884d6-caf3-4aad-9c7f-2cce64bea8c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:42.900245 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c884d6-caf3-4aad-9c7f-2cce64bea8c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:42.902123 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c884d6-caf3-4aad-9c7f-2cce64bea8c5 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:42.927449 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1402/2820] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:47:42 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:47:42.931592 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c2d98-0f0c-4cbf-8826-a467c8f7cdc8 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:42.943112 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c2d98-0f0c-4cbf-8826-a467c8f7cdc8 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:42.984533 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:43.001923 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61c879-f0e4-4afd-b5cd-ce1d328483e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:43.003257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61c879-f0e4-4afd-b5cd-ce1d328483e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:43.003257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61c879-f0e4-4afd-b5cd-ce1d328483e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:43.003257 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61c879-f0e4-4afd-b5cd-ce1d328483e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:43.003896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61c879-f0e4-4afd-b5cd-ce1d328483e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:43.005833 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61c879-f0e4-4afd-b5cd-ce1d328483e6 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:43.026871 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1419/2821] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:47:42 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:47:43.030789 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c884d6-caf3-4aad-9c7f-2cce64bea8c5 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:43.041095 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c884d6-caf3-4aad-9c7f-2cce64bea8c5 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:43.045690 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74114e9e-5d8c-42e0-8a41-e10be3ee68ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:43.046393 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74114e9e-5d8c-42e0-8a41-e10be3ee68ec admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:43.046679 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74114e9e-5d8c-42e0-8a41-e10be3ee68ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:43.047025 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74114e9e-5d8c-42e0-8a41-e10be3ee68ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:43.047721 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74114e9e-5d8c-42e0-8a41-e10be3ee68ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:43.049323 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74114e9e-5d8c-42e0-8a41-e10be3ee68ec admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:43.059926 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1403/2822] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:43.064675 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61c879-f0e4-4afd-b5cd-ce1d328483e6 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:43.074870 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61c879-f0e4-4afd-b5cd-ce1d328483e6 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:43.080858 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3003e09-3201-4ceb-b41c-1dfc67e2c931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:43.081783 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3003e09-3201-4ceb-b41c-1dfc67e2c931 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:43.082113 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3003e09-3201-4ceb-b41c-1dfc67e2c931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:43.082452 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3003e09-3201-4ceb-b41c-1dfc67e2c931 admin admin] PATH_INFO: `/v3/projects/62e89b78bd794375b2e20f280cb1aa4f/users/68bbfd2f285d4fb799a24a04c0aed098/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:43.103752 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3003e09-3201-4ceb-b41c-1dfc67e2c931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62e89b78bd794375b2e20f280cb1aa4f, user_id=68bbfd2f285d4fb799a24a04c0aed098, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:43.106416 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3003e09-3201-4ceb-b41c-1dfc67e2c931 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:43.119519 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1420/2823] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:43 2022] PUT /identity/v3/projects/62e89b78bd794375b2e20f280cb1aa4f/users/68bbfd2f285d4fb799a24a04c0aed098/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:43.123934 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74114e9e-5d8c-42e0-8a41-e10be3ee68ec admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:43.134919 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74114e9e-5d8c-42e0-8a41-e10be3ee68ec admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:43.192365 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2095f3d-1e72-4821-8c38-3442732232e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:43.192927 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2095f3d-1e72-4821-8c38-3442732232e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:43.193209 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2095f3d-1e72-4821-8c38-3442732232e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:43.193485 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2095f3d-1e72-4821-8c38-3442732232e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:43.194205 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2095f3d-1e72-4821-8c38-3442732232e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:43.195813 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2095f3d-1e72-4821-8c38-3442732232e5 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:43.206016 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1404/2824] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:43.210198 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3003e09-3201-4ceb-b41c-1dfc67e2c931 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:43.220674 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3003e09-3201-4ceb-b41c-1dfc67e2c931 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:43.225145 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3309fe-f486-4cb3-81ee-329bef3c3d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:43.226025 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3309fe-f486-4cb3-81ee-329bef3c3d79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:43.226311 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3309fe-f486-4cb3-81ee-329bef3c3d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:43.226589 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3309fe-f486-4cb3-81ee-329bef3c3d79 admin admin] PATH_INFO: `/v3/projects/62e89b78bd794375b2e20f280cb1aa4f/users/68bbfd2f285d4fb799a24a04c0aed098/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:43.228575 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3309fe-f486-4cb3-81ee-329bef3c3d79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62e89b78bd794375b2e20f280cb1aa4f, user_id=68bbfd2f285d4fb799a24a04c0aed098, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:43.231155 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3309fe-f486-4cb3-81ee-329bef3c3d79 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:43.241535 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1421/2825] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:43 2022] PUT /identity/v3/projects/62e89b78bd794375b2e20f280cb1aa4f/users/68bbfd2f285d4fb799a24a04c0aed098/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:43.252408 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c5e4c-8a91-4649-81a2-33780c74d927 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:43.252702 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c5e4c-8a91-4649-81a2-33780c74d927 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:43.252987 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c5e4c-8a91-4649-81a2-33780c74d927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:43.280963 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-969c5e4c-8a91-4649-81a2-33780c74d927 None None] MFA Rules not processed for user `68bbfd2f285d4fb799a24a04c0aed098`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:43.282377 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-969c5e4c-8a91-4649-81a2-33780c74d927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:43.352321 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1405/2826] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:43.363726 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3309fe-f486-4cb3-81ee-329bef3c3d79 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:43.365505 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-7a3309fe-f486-4cb3-81ee-329bef3c3d79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:43.428367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3309fe-f486-4cb3-81ee-329bef3c3d79 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:43.432730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36350b1f-f402-4c48-bd55-e96a23ccab0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:43.433384 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36350b1f-f402-4c48-bd55-e96a23ccab0d service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:43.433671 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36350b1f-f402-4c48-bd55-e96a23ccab0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:43.433947 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36350b1f-f402-4c48-bd55-e96a23ccab0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:43.495188 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36350b1f-f402-4c48-bd55-e96a23ccab0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:43.496657 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36350b1f-f402-4c48-bd55-e96a23ccab0d service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:43.506506 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1422/2827] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:45.305888 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c5e4c-8a91-4649-81a2-33780c74d927 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:45.307376 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-969c5e4c-8a91-4649-81a2-33780c74d927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:45.350447 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:45.375122 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c5e4c-8a91-4649-81a2-33780c74d927 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:45.379768 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e34ddc-b3f9-4335-8769-baee1db3365a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:45.380655 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e34ddc-b3f9-4335-8769-baee1db3365a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:45.380948 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e34ddc-b3f9-4335-8769-baee1db3365a admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:45.381226 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e34ddc-b3f9-4335-8769-baee1db3365a admin admin] PATH_INFO: `/v3/users/1e7db1f7cb47429b8366fbea576007fc` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:45.382428 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e34ddc-b3f9-4335-8769-baee1db3365a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e7db1f7cb47429b8366fbea576007fc)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:45.384388 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e34ddc-b3f9-4335-8769-baee1db3365a admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:45.431620 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-73e34ddc-b3f9-4335-8769-baee1db3365a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e7db1f7cb47429b8366fbea576007fc'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:45.443800 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-73e34ddc-b3f9-4335-8769-baee1db3365a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e7db1f7cb47429b8366fbea576007fc'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:45.450778 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-73e34ddc-b3f9-4335-8769-baee1db3365a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e7db1f7cb47429b8366fbea576007fc'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:45.451477 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-73e34ddc-b3f9-4335-8769-baee1db3365a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e7db1f7cb47429b8366fbea576007fc'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:45.452095 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-73e34ddc-b3f9-4335-8769-baee1db3365a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e7db1f7cb47429b8366fbea576007fc'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:45.464578 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1406/2828] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:47:45 2022] DELETE /identity/v3/users/1e7db1f7cb47429b8366fbea576007fc => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:45.469229 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58318cf-1f47-4fad-8ff0-7644f16dfb71 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:45.469838 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58318cf-1f47-4fad-8ff0-7644f16dfb71 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:45.469838 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58318cf-1f47-4fad-8ff0-7644f16dfb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:45.487564 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-e58318cf-1f47-4fad-8ff0-7644f16dfb71 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:45.488763 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-e58318cf-1f47-4fad-8ff0-7644f16dfb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:45.532300 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:45.547784 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1423/2829] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:45.558062 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e34ddc-b3f9-4335-8769-baee1db3365a admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:45.559494 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-73e34ddc-b3f9-4335-8769-baee1db3365a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:45.616249 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e34ddc-b3f9-4335-8769-baee1db3365a admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:45.619966 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040644a1-2011-41ed-9ed8-0d77121aed78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:45.620617 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040644a1-2011-41ed-9ed8-0d77121aed78 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:45.620903 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040644a1-2011-41ed-9ed8-0d77121aed78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:45.621184 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040644a1-2011-41ed-9ed8-0d77121aed78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:45.630452 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040644a1-2011-41ed-9ed8-0d77121aed78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:45.631917 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040644a1-2011-41ed-9ed8-0d77121aed78 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:45.641652 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1407/2830] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:45.915148 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58318cf-1f47-4fad-8ff0-7644f16dfb71 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:45.916623 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-e58318cf-1f47-4fad-8ff0-7644f16dfb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:45.930590 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58318cf-1f47-4fad-8ff0-7644f16dfb71 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:45.940329 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a56ae-f741-420c-9892-df1e2255e402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:45.941161 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a56ae-f741-420c-9892-df1e2255e402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:45.941439 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a56ae-f741-420c-9892-df1e2255e402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:45.941745 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a56ae-f741-420c-9892-df1e2255e402 admin admin] PATH_INFO: `/v3/projects/4e3dfb63ce464f40b6cfe62ede844c88` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:45.942926 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a56ae-f741-420c-9892-df1e2255e402 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e3dfb63ce464f40b6cfe62ede844c88)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:45.944888 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a56ae-f741-420c-9892-df1e2255e402 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:45.992961 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-876a56ae-f741-420c-9892-df1e2255e402 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e3dfb63ce464f40b6cfe62ede844c88', 'request_id': 'req-876a56ae-f741-420c-9892-df1e2255e402'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:45.999060 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-876a56ae-f741-420c-9892-df1e2255e402 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e3dfb63ce464f40b6cfe62ede844c88', 'request_id': 'req-876a56ae-f741-420c-9892-df1e2255e402'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:46.006530 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-876a56ae-f741-420c-9892-df1e2255e402 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e3dfb63ce464f40b6cfe62ede844c88', 'request_id': 'req-876a56ae-f741-420c-9892-df1e2255e402'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:46.017693 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-876a56ae-f741-420c-9892-df1e2255e402 admin admin] The token cache is being invalidate because project 4e3dfb63ce464f40b6cfe62ede844c88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:47:46.017985 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-876a56ae-f741-420c-9892-df1e2255e402 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:46.018616 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-876a56ae-f741-420c-9892-df1e2255e402 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:46.020193 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1424/2831] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:47:45 2022] DELETE /identity/v3/projects/4e3dfb63ce464f40b6cfe62ede844c88 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:46.024344 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040644a1-2011-41ed-9ed8-0d77121aed78 service neutron] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:46.034538 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040644a1-2011-41ed-9ed8-0d77121aed78 service neutron] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:46.082180 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a56ae-f741-420c-9892-df1e2255e402 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:46.084001 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-876a56ae-f741-420c-9892-df1e2255e402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:46.092593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8ba1d-682f-4dd0-9a0e-4ea6c06d9ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:46.094061 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8ba1d-682f-4dd0-9a0e-4ea6c06d9ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:46.094345 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8ba1d-682f-4dd0-9a0e-4ea6c06d9ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:46.094623 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8ba1d-682f-4dd0-9a0e-4ea6c06d9ef9 admin admin] PATH_INFO: `/v3/users/bfbf0ed441d14d8b91422867d034714b` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:46.095848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8ba1d-682f-4dd0-9a0e-4ea6c06d9ef9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfbf0ed441d14d8b91422867d034714b)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:46.097750 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8ba1d-682f-4dd0-9a0e-4ea6c06d9ef9 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:46.100266 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:46.143075 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a56ae-f741-420c-9892-df1e2255e402 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:46.146805 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe99742-282d-4356-8127-0dc770019de7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:46.147494 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe99742-282d-4356-8127-0dc770019de7 service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:46.147719 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-a4b8ba1d-682f-4dd0-9a0e-4ea6c06d9ef9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfbf0ed441d14d8b91422867d034714b'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:46.147856 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe99742-282d-4356-8127-0dc770019de7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:46.148049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe99742-282d-4356-8127-0dc770019de7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:46.149891 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-bbe99742-282d-4356-8127-0dc770019de7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:46.160801 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-a4b8ba1d-682f-4dd0-9a0e-4ea6c06d9ef9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfbf0ed441d14d8b91422867d034714b'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:46.167664 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-a4b8ba1d-682f-4dd0-9a0e-4ea6c06d9ef9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfbf0ed441d14d8b91422867d034714b'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:46.168377 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-a4b8ba1d-682f-4dd0-9a0e-4ea6c06d9ef9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfbf0ed441d14d8b91422867d034714b'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:46.169062 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-a4b8ba1d-682f-4dd0-9a0e-4ea6c06d9ef9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfbf0ed441d14d8b91422867d034714b'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:46.185257 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1408/2832] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:47:46 2022] DELETE /identity/v3/users/bfbf0ed441d14d8b91422867d034714b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:46.217734 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe99742-282d-4356-8127-0dc770019de7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:46.219817 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe99742-282d-4356-8127-0dc770019de7 service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:46.230451 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1425/2833] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:47:46.473217 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8ba1d-682f-4dd0-9a0e-4ea6c06d9ef9 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:46.475147 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-a4b8ba1d-682f-4dd0-9a0e-4ea6c06d9ef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:46.560777 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8ba1d-682f-4dd0-9a0e-4ea6c06d9ef9 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:46.566128 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da979b6a-813a-40fe-ab83-4e35b5ae38e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:46.566997 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da979b6a-813a-40fe-ab83-4e35b5ae38e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:46.567321 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da979b6a-813a-40fe-ab83-4e35b5ae38e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:46.567587 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da979b6a-813a-40fe-ab83-4e35b5ae38e0 admin admin] PATH_INFO: `/v3/projects/88fb26ab97cc4e11906fc5d193312fad` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:46.569908 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da979b6a-813a-40fe-ab83-4e35b5ae38e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88fb26ab97cc4e11906fc5d193312fad)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:46.571952 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da979b6a-813a-40fe-ab83-4e35b5ae38e0 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:46.621114 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-da979b6a-813a-40fe-ab83-4e35b5ae38e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88fb26ab97cc4e11906fc5d193312fad', 'request_id': 'req-da979b6a-813a-40fe-ab83-4e35b5ae38e0'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:46.628010 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-da979b6a-813a-40fe-ab83-4e35b5ae38e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88fb26ab97cc4e11906fc5d193312fad', 'request_id': 'req-da979b6a-813a-40fe-ab83-4e35b5ae38e0'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:46.635603 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-da979b6a-813a-40fe-ab83-4e35b5ae38e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88fb26ab97cc4e11906fc5d193312fad', 'request_id': 'req-da979b6a-813a-40fe-ab83-4e35b5ae38e0'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:46.647619 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-da979b6a-813a-40fe-ab83-4e35b5ae38e0 admin admin] The token cache is being invalidate because project 88fb26ab97cc4e11906fc5d193312fad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:47:46.647908 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-da979b6a-813a-40fe-ab83-4e35b5ae38e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:46.648537 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-da979b6a-813a-40fe-ab83-4e35b5ae38e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:46.650102 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1409/2834] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:47:46 2022] DELETE /identity/v3/projects/88fb26ab97cc4e11906fc5d193312fad => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:46.655368 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c3226-39c8-4254-96ee-c1d32056a59c None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:46.655829 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c3226-39c8-4254-96ee-c1d32056a59c None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:46.655927 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c3226-39c8-4254-96ee-c1d32056a59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:46.673764 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-fe5c3226-39c8-4254-96ee-c1d32056a59c None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:46.674952 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-fe5c3226-39c8-4254-96ee-c1d32056a59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:46.694346 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:46.736559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1426/2835] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:46.744584 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d25fb2-2b38-4e15-b466-123769c066a5 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:46.744884 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d25fb2-2b38-4e15-b466-123769c066a5 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:46.745170 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d25fb2-2b38-4e15-b466-123769c066a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:46.764477 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-15d25fb2-2b38-4e15-b466-123769c066a5 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:46.766029 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-15d25fb2-2b38-4e15-b466-123769c066a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:46.774880 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1410/2836] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:46.779243 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c3226-39c8-4254-96ee-c1d32056a59c None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:46.789173 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c3226-39c8-4254-96ee-c1d32056a59c None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:46.793836 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92fa7b9-d02b-4083-bcf0-c9bb87337fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:46.794523 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fa7b9-d02b-4083-bcf0-c9bb87337fef admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:46.794818 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fa7b9-d02b-4083-bcf0-c9bb87337fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:46.795100 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fa7b9-d02b-4083-bcf0-c9bb87337fef admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:46.795880 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92fa7b9-d02b-4083-bcf0-c9bb87337fef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:47:46.796701 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92fa7b9-d02b-4083-bcf0-c9bb87337fef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:46.798331 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92fa7b9-d02b-4083-bcf0-c9bb87337fef admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:46.810185 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1427/2837] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:47:46.815132 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d25fb2-2b38-4e15-b466-123769c066a5 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:46.820835 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:46.824872 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d25fb2-2b38-4e15-b466-123769c066a5 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:46.830644 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92910cf-14b1-42bb-9cb4-a7ca80befd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:46.831509 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92910cf-14b1-42bb-9cb4-a7ca80befd89 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:46.832007 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92910cf-14b1-42bb-9cb4-a7ca80befd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:46.832341 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92910cf-14b1-42bb-9cb4-a7ca80befd89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:46.833684 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92910cf-14b1-42bb-9cb4-a7ca80befd89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:46.839853 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92910cf-14b1-42bb-9cb4-a7ca80befd89 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:46.861624 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1411/2838] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:47:46 2022] POST /identity/v3/projects => generated 399 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:47:46.865763 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92fa7b9-d02b-4083-bcf0-c9bb87337fef admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:46.876359 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92fa7b9-d02b-4083-bcf0-c9bb87337fef admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:46.937951 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2fde0-5937-41c6-a110-a79cdaf35109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:46.938642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2fde0-5937-41c6-a110-a79cdaf35109 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:46.938927 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2fde0-5937-41c6-a110-a79cdaf35109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:46.939204 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2fde0-5937-41c6-a110-a79cdaf35109 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:46.939940 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2fde0-5937-41c6-a110-a79cdaf35109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:46.941895 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2fde0-5937-41c6-a110-a79cdaf35109 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:46.962267 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1428/2839] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:47:46 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:47:46.966964 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92910cf-14b1-42bb-9cb4-a7ca80befd89 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:46.977460 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92910cf-14b1-42bb-9cb4-a7ca80befd89 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:46.982185 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ab47c-45f9-4042-a653-072fbcfe74cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:46.982844 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ab47c-45f9-4042-a653-072fbcfe74cb admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:46.983131 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ab47c-45f9-4042-a653-072fbcfe74cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:46.984005 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ab47c-45f9-4042-a653-072fbcfe74cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:46.984795 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ab47c-45f9-4042-a653-072fbcfe74cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:46.986432 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ab47c-45f9-4042-a653-072fbcfe74cb admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:46.997061 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1412/2840] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:47.001832 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2fde0-5937-41c6-a110-a79cdaf35109 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:47.011774 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2fde0-5937-41c6-a110-a79cdaf35109 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:47.016636 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0f5b1-0ed3-4255-bcec-181baedc5d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:47.017285 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0f5b1-0ed3-4255-bcec-181baedc5d54 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:47.017572 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0f5b1-0ed3-4255-bcec-181baedc5d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:47.017856 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0f5b1-0ed3-4255-bcec-181baedc5d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:47.018577 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0f5b1-0ed3-4255-bcec-181baedc5d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:47.020187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0f5b1-0ed3-4255-bcec-181baedc5d54 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:47.030188 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1429/2841] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:47.034224 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ab47c-45f9-4042-a653-072fbcfe74cb admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:47.044151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ab47c-45f9-4042-a653-072fbcfe74cb admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:47.049586 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe02c2-8bcd-4c0a-b5e4-42a0a9657b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:47.050477 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe02c2-8bcd-4c0a-b5e4-42a0a9657b66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:47.050766 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe02c2-8bcd-4c0a-b5e4-42a0a9657b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:47.051049 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe02c2-8bcd-4c0a-b5e4-42a0a9657b66 admin admin] PATH_INFO: `/v3/projects/69baf2fdf5f8414daef272d4847f4cae/users/5bb1b5e72e8c4b14a97766df1f48ca5a/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:47.067213 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe02c2-8bcd-4c0a-b5e4-42a0a9657b66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69baf2fdf5f8414daef272d4847f4cae, user_id=5bb1b5e72e8c4b14a97766df1f48ca5a, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:47.069878 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe02c2-8bcd-4c0a-b5e4-42a0a9657b66 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:47.082431 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1413/2842] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:47 2022] PUT /identity/v3/projects/69baf2fdf5f8414daef272d4847f4cae/users/5bb1b5e72e8c4b14a97766df1f48ca5a/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:47.093636 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9bd05-2e16-4350-9461-a0daa88791f0 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:47.093950 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9bd05-2e16-4350-9461-a0daa88791f0 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:47.094219 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9bd05-2e16-4350-9461-a0daa88791f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:47.122231 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-aab9bd05-2e16-4350-9461-a0daa88791f0 None None] MFA Rules not processed for user `5bb1b5e72e8c4b14a97766df1f48ca5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:47.123488 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-aab9bd05-2e16-4350-9461-a0daa88791f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:47.190501 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1430/2843] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:47.195174 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe02c2-8bcd-4c0a-b5e4-42a0a9657b66 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:47.262714 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe02c2-8bcd-4c0a-b5e4-42a0a9657b66 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:47.267719 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf130e8-9b34-41a1-8799-7ca37f50d4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:47.268379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf130e8-9b34-41a1-8799-7ca37f50d4cf admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:47.268673 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf130e8-9b34-41a1-8799-7ca37f50d4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:47.268956 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf130e8-9b34-41a1-8799-7ca37f50d4cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:47.269655 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf130e8-9b34-41a1-8799-7ca37f50d4cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:47.271579 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf130e8-9b34-41a1-8799-7ca37f50d4cf admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:47.297524 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1414/2844] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:47:47 2022] POST /identity/v3/projects => generated 399 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:47:47.301529 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9bd05-2e16-4350-9461-a0daa88791f0 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:47.312320 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9bd05-2e16-4350-9461-a0daa88791f0 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:47.329109 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:47.370270 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f87c8-b4c1-43c6-8e9e-335eda1f9290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:47.370953 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f87c8-b4c1-43c6-8e9e-335eda1f9290 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:47.371263 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f87c8-b4c1-43c6-8e9e-335eda1f9290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:47.371553 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f87c8-b4c1-43c6-8e9e-335eda1f9290 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:47.372255 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f87c8-b4c1-43c6-8e9e-335eda1f9290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:47.374203 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f87c8-b4c1-43c6-8e9e-335eda1f9290 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:47.393568 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1431/2845] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:47:47 2022] POST /identity/v3/users => generated 306 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:47:47.397614 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf130e8-9b34-41a1-8799-7ca37f50d4cf admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:47.408782 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf130e8-9b34-41a1-8799-7ca37f50d4cf admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:47.413378 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48149376-cdda-46f9-a1c5-64afc5fcbed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:47.414035 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48149376-cdda-46f9-a1c5-64afc5fcbed2 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:47.414322 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48149376-cdda-46f9-a1c5-64afc5fcbed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:47.414617 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48149376-cdda-46f9-a1c5-64afc5fcbed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:47.415365 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48149376-cdda-46f9-a1c5-64afc5fcbed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:47.416945 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48149376-cdda-46f9-a1c5-64afc5fcbed2 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:47.428422 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1415/2846] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:47.432693 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f87c8-b4c1-43c6-8e9e-335eda1f9290 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:47.444751 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f87c8-b4c1-43c6-8e9e-335eda1f9290 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:47.449384 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753b6ff-6fe8-42c9-beb3-e52954eac24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:47.450260 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753b6ff-6fe8-42c9-beb3-e52954eac24c admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:47.454215 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753b6ff-6fe8-42c9-beb3-e52954eac24c admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:47.454215 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753b6ff-6fe8-42c9-beb3-e52954eac24c admin admin] PATH_INFO: `/v3/projects/d451397100e34fc48231a4bc401d9e93/users/b39b12ed7aa148ada132f9965f0c2af5/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:47.467478 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753b6ff-6fe8-42c9-beb3-e52954eac24c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d451397100e34fc48231a4bc401d9e93, user_id=b39b12ed7aa148ada132f9965f0c2af5, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:47.470706 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753b6ff-6fe8-42c9-beb3-e52954eac24c admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:47.484142 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1432/2847] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:47 2022] PUT /identity/v3/projects/d451397100e34fc48231a4bc401d9e93/users/b39b12ed7aa148ada132f9965f0c2af5/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:47:47.488471 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48149376-cdda-46f9-a1c5-64afc5fcbed2 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:47.498330 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48149376-cdda-46f9-a1c5-64afc5fcbed2 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:47.554808 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50bb7a-0433-499c-8507-54ebfec0a8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:47.555375 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50bb7a-0433-499c-8507-54ebfec0a8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:47.555664 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50bb7a-0433-499c-8507-54ebfec0a8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:47.555944 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50bb7a-0433-499c-8507-54ebfec0a8b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:47.556679 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50bb7a-0433-499c-8507-54ebfec0a8b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:47.558266 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50bb7a-0433-499c-8507-54ebfec0a8b1 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:47.571863 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1416/2848] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:47.573205 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753b6ff-6fe8-42c9-beb3-e52954eac24c admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:47.590070 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753b6ff-6fe8-42c9-beb3-e52954eac24c admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:47.595660 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89059a-9a0e-47ae-96e6-c498f189d6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:47.596555 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89059a-9a0e-47ae-96e6-c498f189d6cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:47.596896 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89059a-9a0e-47ae-96e6-c498f189d6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:47.597182 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89059a-9a0e-47ae-96e6-c498f189d6cc admin admin] PATH_INFO: `/v3/projects/d451397100e34fc48231a4bc401d9e93/users/b39b12ed7aa148ada132f9965f0c2af5/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:47.599213 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89059a-9a0e-47ae-96e6-c498f189d6cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d451397100e34fc48231a4bc401d9e93, user_id=b39b12ed7aa148ada132f9965f0c2af5, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:47.602014 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89059a-9a0e-47ae-96e6-c498f189d6cc admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:47.614490 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1433/2849] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:47 2022] PUT /identity/v3/projects/d451397100e34fc48231a4bc401d9e93/users/b39b12ed7aa148ada132f9965f0c2af5/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:47.626403 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c019b8e-2cee-49d1-98c9-96a0bab44f93 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:47.626702 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c019b8e-2cee-49d1-98c9-96a0bab44f93 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:47.626993 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c019b8e-2cee-49d1-98c9-96a0bab44f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:47.656345 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-3c019b8e-2cee-49d1-98c9-96a0bab44f93 None None] MFA Rules not processed for user `b39b12ed7aa148ada132f9965f0c2af5`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:47.657692 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-3c019b8e-2cee-49d1-98c9-96a0bab44f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:47.662821 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:47.737616 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1417/2850] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:47 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:47.748515 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89059a-9a0e-47ae-96e6-c498f189d6cc admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:47.750893 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-ad89059a-9a0e-47ae-96e6-c498f189d6cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:47.808312 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89059a-9a0e-47ae-96e6-c498f189d6cc admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:47.812595 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca72cd-edab-4751-828c-0c67952dc692 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:47.813237 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca72cd-edab-4751-828c-0c67952dc692 service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:47.813526 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca72cd-edab-4751-828c-0c67952dc692 service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:47.813805 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca72cd-edab-4751-828c-0c67952dc692 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:47.823355 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca72cd-edab-4751-828c-0c67952dc692 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:47.824794 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca72cd-edab-4751-828c-0c67952dc692 service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:47.834589 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1434/2851] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:47 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:47.911857 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c019b8e-2cee-49d1-98c9-96a0bab44f93 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:47.922055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c019b8e-2cee-49d1-98c9-96a0bab44f93 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:47.925655 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c9a04-e5ba-489d-ab39-e63999ebe0a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:47.926297 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c9a04-e5ba-489d-ab39-e63999ebe0a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:47.926584 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c9a04-e5ba-489d-ab39-e63999ebe0a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:47.926861 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c9a04-e5ba-489d-ab39-e63999ebe0a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:47.984039 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c9a04-e5ba-489d-ab39-e63999ebe0a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:47.985608 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c9a04-e5ba-489d-ab39-e63999ebe0a0 service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:47.995004 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1418/2852] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:47 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:52.206364 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca72cd-edab-4751-828c-0c67952dc692 service cinder] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:52.267282 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca72cd-edab-4751-828c-0c67952dc692 service cinder] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:52.272187 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5bd70-6210-499c-95b7-57bef4fa05c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:52.273066 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5bd70-6210-499c-95b7-57bef4fa05c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:52.273353 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5bd70-6210-499c-95b7-57bef4fa05c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:52.273635 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5bd70-6210-499c-95b7-57bef4fa05c1 admin admin] PATH_INFO: `/v3/users/5bb1b5e72e8c4b14a97766df1f48ca5a` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:52.274820 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5bd70-6210-499c-95b7-57bef4fa05c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bb1b5e72e8c4b14a97766df1f48ca5a)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:52.276781 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5bd70-6210-499c-95b7-57bef4fa05c1 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:52.292732 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:52.323499 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-24c5bd70-6210-499c-95b7-57bef4fa05c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bb1b5e72e8c4b14a97766df1f48ca5a'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:52.336009 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-24c5bd70-6210-499c-95b7-57bef4fa05c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bb1b5e72e8c4b14a97766df1f48ca5a'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:52.342853 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-24c5bd70-6210-499c-95b7-57bef4fa05c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bb1b5e72e8c4b14a97766df1f48ca5a'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:52.343583 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-24c5bd70-6210-499c-95b7-57bef4fa05c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bb1b5e72e8c4b14a97766df1f48ca5a'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:52.344194 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-24c5bd70-6210-499c-95b7-57bef4fa05c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bb1b5e72e8c4b14a97766df1f48ca5a'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:52.357273 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1435/2853] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:47:52 2022] DELETE /identity/v3/users/5bb1b5e72e8c4b14a97766df1f48ca5a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:52.361866 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94e77b-88d8-439a-af01-5e4bfd09e2bb None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:52.362381 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94e77b-88d8-439a-af01-5e4bfd09e2bb None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:52.362499 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94e77b-88d8-439a-af01-5e4bfd09e2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:52.379675 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-3a94e77b-88d8-439a-af01-5e4bfd09e2bb None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:52.380869 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-3a94e77b-88d8-439a-af01-5e4bfd09e2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:52.440429 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1419/2854] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:52.449227 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5bd70-6210-499c-95b7-57bef4fa05c1 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:52.450685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-24c5bd70-6210-499c-95b7-57bef4fa05c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:52.515098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5bd70-6210-499c-95b7-57bef4fa05c1 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:52.520508 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5db41-a8be-4dda-8c8b-24bd1dc05d00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:52.520508 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5db41-a8be-4dda-8c8b-24bd1dc05d00 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:52.520508 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5db41-a8be-4dda-8c8b-24bd1dc05d00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:52.520508 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5db41-a8be-4dda-8c8b-24bd1dc05d00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:52.529870 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5db41-a8be-4dda-8c8b-24bd1dc05d00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:52.532329 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5db41-a8be-4dda-8c8b-24bd1dc05d00 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:52.542237 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1436/2855] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:52.813529 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94e77b-88d8-439a-af01-5e4bfd09e2bb None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:52.814987 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-3a94e77b-88d8-439a-af01-5e4bfd09e2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:52.827133 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94e77b-88d8-439a-af01-5e4bfd09e2bb None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:52.832655 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5321d-baa3-4d55-a57e-443375c40b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:52.833528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5321d-baa3-4d55-a57e-443375c40b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:52.833814 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5321d-baa3-4d55-a57e-443375c40b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:52.834096 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5321d-baa3-4d55-a57e-443375c40b58 admin admin] PATH_INFO: `/v3/projects/69baf2fdf5f8414daef272d4847f4cae` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:52.835351 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5321d-baa3-4d55-a57e-443375c40b58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69baf2fdf5f8414daef272d4847f4cae)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:52.837269 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5321d-baa3-4d55-a57e-443375c40b58 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:52.876436 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:52.886227 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-f3a5321d-baa3-4d55-a57e-443375c40b58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69baf2fdf5f8414daef272d4847f4cae', 'request_id': 'req-f3a5321d-baa3-4d55-a57e-443375c40b58'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:52.893009 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-f3a5321d-baa3-4d55-a57e-443375c40b58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69baf2fdf5f8414daef272d4847f4cae', 'request_id': 'req-f3a5321d-baa3-4d55-a57e-443375c40b58'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:52.900157 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-f3a5321d-baa3-4d55-a57e-443375c40b58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69baf2fdf5f8414daef272d4847f4cae', 'request_id': 'req-f3a5321d-baa3-4d55-a57e-443375c40b58'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:52.911141 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-f3a5321d-baa3-4d55-a57e-443375c40b58 admin admin] The token cache is being invalidate because project 69baf2fdf5f8414daef272d4847f4cae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:47:52.911481 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-f3a5321d-baa3-4d55-a57e-443375c40b58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:52.912121 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-f3a5321d-baa3-4d55-a57e-443375c40b58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:52.913719 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1420/2856] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:47:52 2022] DELETE /identity/v3/projects/69baf2fdf5f8414daef272d4847f4cae => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:52.917668 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5db41-a8be-4dda-8c8b-24bd1dc05d00 service neutron] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:52.927268 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5db41-a8be-4dda-8c8b-24bd1dc05d00 service neutron] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:52.983642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ca54a-1bf1-4d31-8ce0-d119659f3ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:52.984635 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ca54a-1bf1-4d31-8ce0-d119659f3ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:52.984917 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ca54a-1bf1-4d31-8ce0-d119659f3ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:52.985191 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ca54a-1bf1-4d31-8ce0-d119659f3ce7 admin admin] PATH_INFO: `/v3/users/b39b12ed7aa148ada132f9965f0c2af5` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:52.986371 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ca54a-1bf1-4d31-8ce0-d119659f3ce7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b39b12ed7aa148ada132f9965f0c2af5)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:52.988298 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ca54a-1bf1-4d31-8ce0-d119659f3ce7 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:53.029235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:53.036131 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-276ca54a-1bf1-4d31-8ce0-d119659f3ce7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b39b12ed7aa148ada132f9965f0c2af5'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:53.048765 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-276ca54a-1bf1-4d31-8ce0-d119659f3ce7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b39b12ed7aa148ada132f9965f0c2af5'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:53.056278 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-276ca54a-1bf1-4d31-8ce0-d119659f3ce7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b39b12ed7aa148ada132f9965f0c2af5'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:53.057120 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-276ca54a-1bf1-4d31-8ce0-d119659f3ce7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b39b12ed7aa148ada132f9965f0c2af5'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:53.057832 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-276ca54a-1bf1-4d31-8ce0-d119659f3ce7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b39b12ed7aa148ada132f9965f0c2af5'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:53.071847 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1437/2857] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:47:52 2022] DELETE /identity/v3/users/b39b12ed7aa148ada132f9965f0c2af5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:53.349938 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5321d-baa3-4d55-a57e-443375c40b58 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:53.351842 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-f3a5321d-baa3-4d55-a57e-443375c40b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:53.366653 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5321d-baa3-4d55-a57e-443375c40b58 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:53.425807 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecad5c2-e215-4007-a7ab-2a8c1f115c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:53.426666 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecad5c2-e215-4007-a7ab-2a8c1f115c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:53.426948 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecad5c2-e215-4007-a7ab-2a8c1f115c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:53.427242 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecad5c2-e215-4007-a7ab-2a8c1f115c48 admin admin] PATH_INFO: `/v3/projects/d451397100e34fc48231a4bc401d9e93` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:53.428429 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecad5c2-e215-4007-a7ab-2a8c1f115c48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d451397100e34fc48231a4bc401d9e93)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:53.430326 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecad5c2-e215-4007-a7ab-2a8c1f115c48 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:53.477501 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-eecad5c2-e215-4007-a7ab-2a8c1f115c48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd451397100e34fc48231a4bc401d9e93', 'request_id': 'req-eecad5c2-e215-4007-a7ab-2a8c1f115c48'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:53.483815 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-eecad5c2-e215-4007-a7ab-2a8c1f115c48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd451397100e34fc48231a4bc401d9e93', 'request_id': 'req-eecad5c2-e215-4007-a7ab-2a8c1f115c48'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:53.491793 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-eecad5c2-e215-4007-a7ab-2a8c1f115c48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd451397100e34fc48231a4bc401d9e93', 'request_id': 'req-eecad5c2-e215-4007-a7ab-2a8c1f115c48'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:53.503032 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-eecad5c2-e215-4007-a7ab-2a8c1f115c48 admin admin] The token cache is being invalidate because project d451397100e34fc48231a4bc401d9e93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:47:53.503360 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-eecad5c2-e215-4007-a7ab-2a8c1f115c48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:53.503988 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-eecad5c2-e215-4007-a7ab-2a8c1f115c48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:53.505532 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1421/2858] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:47:53 2022] DELETE /identity/v3/projects/d451397100e34fc48231a4bc401d9e93 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:53.510444 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a43cb-c23c-4452-a7c3-1fca8bf769da None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:53.510928 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a43cb-c23c-4452-a7c3-1fca8bf769da None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:53.511050 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a43cb-c23c-4452-a7c3-1fca8bf769da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:53.529235 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-9b7a43cb-c23c-4452-a7c3-1fca8bf769da None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:53.530440 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-9b7a43cb-c23c-4452-a7c3-1fca8bf769da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:53.591802 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1438/2859] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:53.599581 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389b53b-eb79-4e99-931e-77a3b69b4991 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:53.599819 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389b53b-eb79-4e99-931e-77a3b69b4991 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:53.600102 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389b53b-eb79-4e99-931e-77a3b69b4991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:53.622979 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-f389b53b-eb79-4e99-931e-77a3b69b4991 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:53.624720 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-f389b53b-eb79-4e99-931e-77a3b69b4991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:53.633483 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1422/2860] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:53.637806 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a43cb-c23c-4452-a7c3-1fca8bf769da None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:53.648667 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a43cb-c23c-4452-a7c3-1fca8bf769da None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:53.653402 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7213276-a89a-4184-857c-a7d03e652871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:53.654142 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7213276-a89a-4184-857c-a7d03e652871 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:53.654432 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7213276-a89a-4184-857c-a7d03e652871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:53.654717 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7213276-a89a-4184-857c-a7d03e652871 admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:53.655502 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7213276-a89a-4184-857c-a7d03e652871 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:47:53.655815 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7213276-a89a-4184-857c-a7d03e652871 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:53.658379 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7213276-a89a-4184-857c-a7d03e652871 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:53.673659 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1439/2861] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:47:53.674572 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389b53b-eb79-4e99-931e-77a3b69b4991 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:53.683987 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389b53b-eb79-4e99-931e-77a3b69b4991 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:53.688950 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad338cd-d3de-4694-832b-4ffcf7697111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:53.689758 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad338cd-d3de-4694-832b-4ffcf7697111 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:53.690055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad338cd-d3de-4694-832b-4ffcf7697111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:53.690340 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad338cd-d3de-4694-832b-4ffcf7697111 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:53.691058 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad338cd-d3de-4694-832b-4ffcf7697111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:53.693071 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad338cd-d3de-4694-832b-4ffcf7697111 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:53.726689 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1423/2862] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:47:53 2022] POST /identity/v3/projects => generated 359 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:47:53.727968 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7213276-a89a-4184-857c-a7d03e652871 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:53.742009 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7213276-a89a-4184-857c-a7d03e652871 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:53.803469 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871851d-4ffc-4fed-880a-09c465d0f895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:53.804355 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871851d-4ffc-4fed-880a-09c465d0f895 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:53.804481 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871851d-4ffc-4fed-880a-09c465d0f895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:53.804696 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871851d-4ffc-4fed-880a-09c465d0f895 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:53.805611 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871851d-4ffc-4fed-880a-09c465d0f895 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:53.807925 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871851d-4ffc-4fed-880a-09c465d0f895 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:53.831311 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1440/2863] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:47:53 2022] POST /identity/v3/users => generated 280 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:47:53.834905 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad338cd-d3de-4694-832b-4ffcf7697111 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:53.845962 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad338cd-d3de-4694-832b-4ffcf7697111 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:53.850664 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692fbc17-77fa-452c-ba64-381882155405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:53.851322 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fbc17-77fa-452c-ba64-381882155405 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:53.851591 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fbc17-77fa-452c-ba64-381882155405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:53.851878 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fbc17-77fa-452c-ba64-381882155405 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:53.852620 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692fbc17-77fa-452c-ba64-381882155405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:53.854224 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692fbc17-77fa-452c-ba64-381882155405 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:53.866327 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1424/2864] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:53.870528 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871851d-4ffc-4fed-880a-09c465d0f895 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:53.888342 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871851d-4ffc-4fed-880a-09c465d0f895 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:53.897961 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97be79-b028-4245-94dc-a96f7489cd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:53.899922 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97be79-b028-4245-94dc-a96f7489cd54 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:53.900285 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97be79-b028-4245-94dc-a96f7489cd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:53.900688 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97be79-b028-4245-94dc-a96f7489cd54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:53.901445 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97be79-b028-4245-94dc-a96f7489cd54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:53.903203 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97be79-b028-4245-94dc-a96f7489cd54 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:53.921158 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1441/2865] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:53.926856 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692fbc17-77fa-452c-ba64-381882155405 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:53.937264 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692fbc17-77fa-452c-ba64-381882155405 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:53.942606 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed924b9-f72a-4734-b20c-0109e7731c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:53.943628 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed924b9-f72a-4734-b20c-0109e7731c56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:53.944470 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed924b9-f72a-4734-b20c-0109e7731c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:53.944470 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed924b9-f72a-4734-b20c-0109e7731c56 admin admin] PATH_INFO: `/v3/projects/4eb4333967454360981d2f419acb6cef/users/f486c7af4b9042ee9e349fc10df032bb/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:53.958566 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:53.962170 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed924b9-f72a-4734-b20c-0109e7731c56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eb4333967454360981d2f419acb6cef, user_id=f486c7af4b9042ee9e349fc10df032bb, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:53.965222 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed924b9-f72a-4734-b20c-0109e7731c56 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:53.979873 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1425/2866] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:53 2022] PUT /identity/v3/projects/4eb4333967454360981d2f419acb6cef/users/f486c7af4b9042ee9e349fc10df032bb/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:53.991880 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89e3b6-39cb-4f3e-9db5-4e063453bc54 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:53.992178 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89e3b6-39cb-4f3e-9db5-4e063453bc54 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:53.992465 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89e3b6-39cb-4f3e-9db5-4e063453bc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:54.019452 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-ff89e3b6-39cb-4f3e-9db5-4e063453bc54 None None] MFA Rules not processed for user `f486c7af4b9042ee9e349fc10df032bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:54.020695 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-ff89e3b6-39cb-4f3e-9db5-4e063453bc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:54.029857 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:54.087854 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1442/2867] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:53 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:54.121079 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed924b9-f72a-4734-b20c-0109e7731c56 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:54.122788 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-eed924b9-f72a-4734-b20c-0109e7731c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:54.180331 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed924b9-f72a-4734-b20c-0109e7731c56 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:54.184002 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231f2f0-2721-493e-837e-0ba68e989797 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:54.184643 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231f2f0-2721-493e-837e-0ba68e989797 service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:54.184932 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231f2f0-2721-493e-837e-0ba68e989797 service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:54.185211 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231f2f0-2721-493e-837e-0ba68e989797 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:54.193816 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231f2f0-2721-493e-837e-0ba68e989797 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:54.195246 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231f2f0-2721-493e-837e-0ba68e989797 service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:54.204614 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1426/2868] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:54 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:54.219468 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89e3b6-39cb-4f3e-9db5-4e063453bc54 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:54.287452 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89e3b6-39cb-4f3e-9db5-4e063453bc54 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:54.298834 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa505fa-efcb-4050-96a0-b1a85c80e982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:54.299786 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa505fa-efcb-4050-96a0-b1a85c80e982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:54.300138 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa505fa-efcb-4050-96a0-b1a85c80e982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:54.300350 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa505fa-efcb-4050-96a0-b1a85c80e982 admin admin] PATH_INFO: `/v3/users/f486c7af4b9042ee9e349fc10df032bb` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:54.301586 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa505fa-efcb-4050-96a0-b1a85c80e982 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f486c7af4b9042ee9e349fc10df032bb)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:54.303545 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa505fa-efcb-4050-96a0-b1a85c80e982 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:54.348280 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2fa505fa-efcb-4050-96a0-b1a85c80e982 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f486c7af4b9042ee9e349fc10df032bb'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:54.360901 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2fa505fa-efcb-4050-96a0-b1a85c80e982 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f486c7af4b9042ee9e349fc10df032bb'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:54.367741 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2fa505fa-efcb-4050-96a0-b1a85c80e982 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f486c7af4b9042ee9e349fc10df032bb'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:54.368435 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2fa505fa-efcb-4050-96a0-b1a85c80e982 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f486c7af4b9042ee9e349fc10df032bb'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:54.369057 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-2fa505fa-efcb-4050-96a0-b1a85c80e982 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f486c7af4b9042ee9e349fc10df032bb'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:54.382373 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1443/2869] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:47:54 2022] DELETE /identity/v3/users/f486c7af4b9042ee9e349fc10df032bb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:54.387253 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87af2a5-f059-4d62-a991-886dfeab6f2a None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:54.387761 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87af2a5-f059-4d62-a991-886dfeab6f2a None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:54.387877 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87af2a5-f059-4d62-a991-886dfeab6f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:54.405794 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-b87af2a5-f059-4d62-a991-886dfeab6f2a None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:54.407048 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-b87af2a5-f059-4d62-a991-886dfeab6f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:54.464605 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1427/2870] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:54.474600 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa505fa-efcb-4050-96a0-b1a85c80e982 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:54.476013 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-2fa505fa-efcb-4050-96a0-b1a85c80e982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:54.510994 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:54.535490 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa505fa-efcb-4050-96a0-b1a85c80e982 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:54.539054 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3cfa5-0ad1-49c5-8744-6ed79ba217f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:54.539730 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3cfa5-0ad1-49c5-8744-6ed79ba217f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:54.540015 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3cfa5-0ad1-49c5-8744-6ed79ba217f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:54.540293 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3cfa5-0ad1-49c5-8744-6ed79ba217f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:54.549993 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3cfa5-0ad1-49c5-8744-6ed79ba217f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:54.551916 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3cfa5-0ad1-49c5-8744-6ed79ba217f8 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:54.563371 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1444/2871] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:54.838472 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87af2a5-f059-4d62-a991-886dfeab6f2a None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:54.840490 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-b87af2a5-f059-4d62-a991-886dfeab6f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:54.860554 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87af2a5-f059-4d62-a991-886dfeab6f2a None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:54.866044 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63436e5e-83d4-45d4-aab5-2804fdb19526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:54.866997 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63436e5e-83d4-45d4-aab5-2804fdb19526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:54.867312 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63436e5e-83d4-45d4-aab5-2804fdb19526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:54.867599 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63436e5e-83d4-45d4-aab5-2804fdb19526 admin admin] PATH_INFO: `/v3/projects/4eb4333967454360981d2f419acb6cef` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:54.868794 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63436e5e-83d4-45d4-aab5-2804fdb19526 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eb4333967454360981d2f419acb6cef)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:54.870706 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63436e5e-83d4-45d4-aab5-2804fdb19526 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:54.919828 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-63436e5e-83d4-45d4-aab5-2804fdb19526 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eb4333967454360981d2f419acb6cef', 'request_id': 'req-63436e5e-83d4-45d4-aab5-2804fdb19526'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:54.927827 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-63436e5e-83d4-45d4-aab5-2804fdb19526 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eb4333967454360981d2f419acb6cef', 'request_id': 'req-63436e5e-83d4-45d4-aab5-2804fdb19526'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:54.939111 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-63436e5e-83d4-45d4-aab5-2804fdb19526 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eb4333967454360981d2f419acb6cef', 'request_id': 'req-63436e5e-83d4-45d4-aab5-2804fdb19526'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:54.950573 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-63436e5e-83d4-45d4-aab5-2804fdb19526 admin admin] The token cache is being invalidate because project 4eb4333967454360981d2f419acb6cef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:47:54.950855 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-63436e5e-83d4-45d4-aab5-2804fdb19526 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:54.951528 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-63436e5e-83d4-45d4-aab5-2804fdb19526 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:54.953605 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1428/2872] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:47:54 2022] DELETE /identity/v3/projects/4eb4333967454360981d2f419acb6cef => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:54.958706 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e016e-f52b-4d18-a9a3-827b25c91815 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:54.959052 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e016e-f52b-4d18-a9a3-827b25c91815 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:54.959252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e016e-f52b-4d18-a9a3-827b25c91815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:54.978145 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-ea2e016e-f52b-4d18-a9a3-827b25c91815 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:54.979459 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-ea2e016e-f52b-4d18-a9a3-827b25c91815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:55.044848 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1445/2873] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:55.052610 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf77c23-74a6-4ef3-aaae-86254a64557c None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:55.052977 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf77c23-74a6-4ef3-aaae-86254a64557c None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:55.053324 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf77c23-74a6-4ef3-aaae-86254a64557c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:55.071960 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-4cf77c23-74a6-4ef3-aaae-86254a64557c None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:55.073399 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-4cf77c23-74a6-4ef3-aaae-86254a64557c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:55.082713 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1429/2874] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:55.086855 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e016e-f52b-4d18-a9a3-827b25c91815 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:55.097242 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e016e-f52b-4d18-a9a3-827b25c91815 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:55.102072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bebf20d-a300-48bc-a08a-b99a45b3a4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:55.102746 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebf20d-a300-48bc-a08a-b99a45b3a4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:55.103036 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebf20d-a300-48bc-a08a-b99a45b3a4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:55.103472 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebf20d-a300-48bc-a08a-b99a45b3a4d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:55.104088 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bebf20d-a300-48bc-a08a-b99a45b3a4d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:47:55.104403 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bebf20d-a300-48bc-a08a-b99a45b3a4d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:55.105983 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bebf20d-a300-48bc-a08a-b99a45b3a4d6 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:55.122604 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1446/2875] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:47:55.126878 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf77c23-74a6-4ef3-aaae-86254a64557c None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:55.136232 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf77c23-74a6-4ef3-aaae-86254a64557c None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:55.141387 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21bc224-41f6-409c-a8e6-f9156271d113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:55.142035 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bc224-41f6-409c-a8e6-f9156271d113 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:55.142315 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bc224-41f6-409c-a8e6-f9156271d113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:55.142593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bc224-41f6-409c-a8e6-f9156271d113 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:55.143319 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21bc224-41f6-409c-a8e6-f9156271d113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:55.145189 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21bc224-41f6-409c-a8e6-f9156271d113 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:55.153308 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:55.174520 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1430/2876] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:47:55 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:47:55.178919 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bebf20d-a300-48bc-a08a-b99a45b3a4d6 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:55.189057 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bebf20d-a300-48bc-a08a-b99a45b3a4d6 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:55.245139 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5835c6a-9711-44dc-9d86-9ecea5ff81ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:55.246060 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5835c6a-9711-44dc-9d86-9ecea5ff81ae admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:55.246416 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5835c6a-9711-44dc-9d86-9ecea5ff81ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:55.246846 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5835c6a-9711-44dc-9d86-9ecea5ff81ae admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:55.247614 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5835c6a-9711-44dc-9d86-9ecea5ff81ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:55.249513 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5835c6a-9711-44dc-9d86-9ecea5ff81ae admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:55.269903 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1447/2877] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:47:55 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:47:55.274045 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21bc224-41f6-409c-a8e6-f9156271d113 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:55.284879 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21bc224-41f6-409c-a8e6-f9156271d113 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:55.289488 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eccbd2e-0e28-4523-9d96-71a584add6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:55.290149 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccbd2e-0e28-4523-9d96-71a584add6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:55.290432 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccbd2e-0e28-4523-9d96-71a584add6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:55.290711 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccbd2e-0e28-4523-9d96-71a584add6a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:55.291472 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eccbd2e-0e28-4523-9d96-71a584add6a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:55.293054 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eccbd2e-0e28-4523-9d96-71a584add6a7 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:55.302995 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1431/2878] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:55.306971 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5835c6a-9711-44dc-9d86-9ecea5ff81ae admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:55.318119 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5835c6a-9711-44dc-9d86-9ecea5ff81ae admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:55.322115 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33587d-c22c-473b-a90b-d953b91a49ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:55.322768 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33587d-c22c-473b-a90b-d953b91a49ad admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:55.323059 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33587d-c22c-473b-a90b-d953b91a49ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:55.323384 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33587d-c22c-473b-a90b-d953b91a49ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:55.324116 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b33587d-c22c-473b-a90b-d953b91a49ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:55.325703 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b33587d-c22c-473b-a90b-d953b91a49ad admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:55.336301 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1448/2879] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:55.340263 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eccbd2e-0e28-4523-9d96-71a584add6a7 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:55.350276 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eccbd2e-0e28-4523-9d96-71a584add6a7 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:55.354910 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef36506-7306-4eec-8c1e-eaa055ec4a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:55.355809 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef36506-7306-4eec-8c1e-eaa055ec4a5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:55.356100 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef36506-7306-4eec-8c1e-eaa055ec4a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:55.356382 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef36506-7306-4eec-8c1e-eaa055ec4a5b admin admin] PATH_INFO: `/v3/projects/70fe2a55b32848559373d2a355557cb0/users/8d3cf3ec8feb4991bc4c05883b403d6c/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:55.370790 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef36506-7306-4eec-8c1e-eaa055ec4a5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=70fe2a55b32848559373d2a355557cb0, user_id=8d3cf3ec8feb4991bc4c05883b403d6c, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:55.373484 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef36506-7306-4eec-8c1e-eaa055ec4a5b admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:55.386975 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1432/2880] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:55 2022] PUT /identity/v3/projects/70fe2a55b32848559373d2a355557cb0/users/8d3cf3ec8feb4991bc4c05883b403d6c/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:47:55.397902 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7b90a-23c7-4066-a6f7-80df719319b0 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:55.398331 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7b90a-23c7-4066-a6f7-80df719319b0 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:55.398441 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7b90a-23c7-4066-a6f7-80df719319b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:55.424480 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-12a7b90a-23c7-4066-a6f7-80df719319b0 None None] MFA Rules not processed for user `8d3cf3ec8feb4991bc4c05883b403d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:55.425754 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-12a7b90a-23c7-4066-a6f7-80df719319b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:55.455474 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:55.492309 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1449/2881] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:55.504074 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef36506-7306-4eec-8c1e-eaa055ec4a5b admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:55.505951 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-eef36506-7306-4eec-8c1e-eaa055ec4a5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:55.565073 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef36506-7306-4eec-8c1e-eaa055ec4a5b admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:55.569605 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7f63f-a0f9-472e-b9b8-8a1d7a9b4c2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:55.570445 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7f63f-a0f9-472e-b9b8-8a1d7a9b4c2c service cinder] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:55.570741 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7f63f-a0f9-472e-b9b8-8a1d7a9b4c2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:55.571028 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7f63f-a0f9-472e-b9b8-8a1d7a9b4c2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:55.580384 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7f63f-a0f9-472e-b9b8-8a1d7a9b4c2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:55.582151 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7f63f-a0f9-472e-b9b8-8a1d7a9b4c2c service cinder] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:55.595698 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1433/2882] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:55 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:58.734162 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7b90a-23c7-4066-a6f7-80df719319b0 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:58.735713 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-12a7b90a-23c7-4066-a6f7-80df719319b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:58.802642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7b90a-23c7-4066-a6f7-80df719319b0 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:58.807376 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ca5e8-4b73-4bde-b0d7-f0e3106fbba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:58.808252 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ca5e8-4b73-4bde-b0d7-f0e3106fbba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:58.808539 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ca5e8-4b73-4bde-b0d7-f0e3106fbba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:58.808814 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ca5e8-4b73-4bde-b0d7-f0e3106fbba9 admin admin] PATH_INFO: `/v3/users/41fb498a6dbe4f4685cf7370e17e1077` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:58.810072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ca5e8-4b73-4bde-b0d7-f0e3106fbba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41fb498a6dbe4f4685cf7370e17e1077)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:58.812046 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ca5e8-4b73-4bde-b0d7-f0e3106fbba9 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:58.859587 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-0a7ca5e8-4b73-4bde-b0d7-f0e3106fbba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41fb498a6dbe4f4685cf7370e17e1077'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:58.872804 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-0a7ca5e8-4b73-4bde-b0d7-f0e3106fbba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41fb498a6dbe4f4685cf7370e17e1077'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:58.881563 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-0a7ca5e8-4b73-4bde-b0d7-f0e3106fbba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41fb498a6dbe4f4685cf7370e17e1077'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:58.882311 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-0a7ca5e8-4b73-4bde-b0d7-f0e3106fbba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41fb498a6dbe4f4685cf7370e17e1077'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:58.882946 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-0a7ca5e8-4b73-4bde-b0d7-f0e3106fbba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41fb498a6dbe4f4685cf7370e17e1077'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:58.897001 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1450/2883] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:47:58 2022] DELETE /identity/v3/users/41fb498a6dbe4f4685cf7370e17e1077 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:58.901721 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8079cbe-8433-421c-b3ba-507e34f01a2c None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:58.902222 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8079cbe-8433-421c-b3ba-507e34f01a2c None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:58.902325 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8079cbe-8433-421c-b3ba-507e34f01a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:58.920514 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-b8079cbe-8433-421c-b3ba-507e34f01a2c None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:58.921783 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-b8079cbe-8433-421c-b3ba-507e34f01a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:58.979703 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1434/2884] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:58.989217 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ca5e8-4b73-4bde-b0d7-f0e3106fbba9 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:58.990645 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-0a7ca5e8-4b73-4bde-b0d7-f0e3106fbba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:59.043873 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:59.047828 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ca5e8-4b73-4bde-b0d7-f0e3106fbba9 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:59.052853 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9a384-4a65-4eca-a5cd-50dcff1a0c47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:59.053685 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9a384-4a65-4eca-a5cd-50dcff1a0c47 service neutron] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:59.054045 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9a384-4a65-4eca-a5cd-50dcff1a0c47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:59.054462 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9a384-4a65-4eca-a5cd-50dcff1a0c47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:59.064546 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9a384-4a65-4eca-a5cd-50dcff1a0c47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:59.065972 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9a384-4a65-4eca-a5cd-50dcff1a0c47 service neutron] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:59.075565 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1451/2885] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:59.354574 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8079cbe-8433-421c-b3ba-507e34f01a2c None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:59.356032 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-b8079cbe-8433-421c-b3ba-507e34f01a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:59.368227 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8079cbe-8433-421c-b3ba-507e34f01a2c None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:59.373000 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a43e96-9f9c-4c88-abbf-c527cd36027d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:59.373863 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a43e96-9f9c-4c88-abbf-c527cd36027d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:59.374157 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a43e96-9f9c-4c88-abbf-c527cd36027d admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:59.374933 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a43e96-9f9c-4c88-abbf-c527cd36027d admin admin] PATH_INFO: `/v3/projects/805ee1dd5d114709be1b4ae612b26b5b` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:59.376185 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a43e96-9f9c-4c88-abbf-c527cd36027d admin admin] RBAC: Authorizing `identity:delete_project(project_id=805ee1dd5d114709be1b4ae612b26b5b)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:59.378092 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a43e96-9f9c-4c88-abbf-c527cd36027d admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:59.424919 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-07a43e96-9f9c-4c88-abbf-c527cd36027d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '805ee1dd5d114709be1b4ae612b26b5b', 'request_id': 'req-07a43e96-9f9c-4c88-abbf-c527cd36027d'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:59.426797 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:59.431493 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-07a43e96-9f9c-4c88-abbf-c527cd36027d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '805ee1dd5d114709be1b4ae612b26b5b', 'request_id': 'req-07a43e96-9f9c-4c88-abbf-c527cd36027d'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:59.440352 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-07a43e96-9f9c-4c88-abbf-c527cd36027d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '805ee1dd5d114709be1b4ae612b26b5b', 'request_id': 'req-07a43e96-9f9c-4c88-abbf-c527cd36027d'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:59.450901 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-07a43e96-9f9c-4c88-abbf-c527cd36027d admin admin] The token cache is being invalidate because project 805ee1dd5d114709be1b4ae612b26b5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:47:59.451188 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-07a43e96-9f9c-4c88-abbf-c527cd36027d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:59.451841 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-07a43e96-9f9c-4c88-abbf-c527cd36027d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:59.453943 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1435/2886] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:47:59 2022] DELETE /identity/v3/projects/805ee1dd5d114709be1b4ae612b26b5b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:59.457939 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9a384-4a65-4eca-a5cd-50dcff1a0c47 service neutron] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:59.467965 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9a384-4a65-4eca-a5cd-50dcff1a0c47 service neutron] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:59.524408 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719063ea-e289-4f18-a3c2-f4f58c91973b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:59.525313 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719063ea-e289-4f18-a3c2-f4f58c91973b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:59.525603 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719063ea-e289-4f18-a3c2-f4f58c91973b admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:59.525919 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719063ea-e289-4f18-a3c2-f4f58c91973b admin admin] PATH_INFO: `/v3/users/68bbfd2f285d4fb799a24a04c0aed098` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:59.527064 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719063ea-e289-4f18-a3c2-f4f58c91973b admin admin] RBAC: Authorizing `identity:delete_user(user_id=68bbfd2f285d4fb799a24a04c0aed098)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:59.529477 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719063ea-e289-4f18-a3c2-f4f58c91973b admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:59.576208 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-719063ea-e289-4f18-a3c2-f4f58c91973b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68bbfd2f285d4fb799a24a04c0aed098'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:59.587743 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-719063ea-e289-4f18-a3c2-f4f58c91973b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68bbfd2f285d4fb799a24a04c0aed098'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:59.594425 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-719063ea-e289-4f18-a3c2-f4f58c91973b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68bbfd2f285d4fb799a24a04c0aed098'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:59.595098 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-719063ea-e289-4f18-a3c2-f4f58c91973b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68bbfd2f285d4fb799a24a04c0aed098'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:59.595741 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-719063ea-e289-4f18-a3c2-f4f58c91973b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68bbfd2f285d4fb799a24a04c0aed098'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:59.608065 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1452/2887] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:47:59 2022] DELETE /identity/v3/users/68bbfd2f285d4fb799a24a04c0aed098 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:59.892514 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a43e96-9f9c-4c88-abbf-c527cd36027d admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:59.894059 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-07a43e96-9f9c-4c88-abbf-c527cd36027d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:59.908108 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a43e96-9f9c-4c88-abbf-c527cd36027d admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:59.968034 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e29b7-4451-478d-b6ac-1309587fd374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:59.968926 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e29b7-4451-478d-b6ac-1309587fd374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:59.969215 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e29b7-4451-478d-b6ac-1309587fd374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:59.969495 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e29b7-4451-478d-b6ac-1309587fd374 admin admin] PATH_INFO: `/v3/projects/62e89b78bd794375b2e20f280cb1aa4f` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:59.970692 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e29b7-4451-478d-b6ac-1309587fd374 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62e89b78bd794375b2e20f280cb1aa4f)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:59.972642 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e29b7-4451-478d-b6ac-1309587fd374 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:48:00.018765 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-712e29b7-4451-478d-b6ac-1309587fd374 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62e89b78bd794375b2e20f280cb1aa4f', 'request_id': 'req-712e29b7-4451-478d-b6ac-1309587fd374'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:00.025161 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-712e29b7-4451-478d-b6ac-1309587fd374 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62e89b78bd794375b2e20f280cb1aa4f', 'request_id': 'req-712e29b7-4451-478d-b6ac-1309587fd374'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:00.032165 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-712e29b7-4451-478d-b6ac-1309587fd374 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62e89b78bd794375b2e20f280cb1aa4f', 'request_id': 'req-712e29b7-4451-478d-b6ac-1309587fd374'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:00.042280 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-712e29b7-4451-478d-b6ac-1309587fd374 admin admin] The token cache is being invalidate because project 62e89b78bd794375b2e20f280cb1aa4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80305) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:48:00.042566 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-712e29b7-4451-478d-b6ac-1309587fd374 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:00.043185 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-712e29b7-4451-478d-b6ac-1309587fd374 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:00.044750 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1436/2888] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:47:59 2022] DELETE /identity/v3/projects/62e89b78bd794375b2e20f280cb1aa4f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:48:00.049707 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680692e-d6eb-4fdb-9880-f318379defce None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:00.050199 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680692e-d6eb-4fdb-9880-f318379defce None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:00.050301 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680692e-d6eb-4fdb-9880-f318379defce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:00.068559 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-1680692e-d6eb-4fdb-9880-f318379defce None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:48:00.069675 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-1680692e-d6eb-4fdb-9880-f318379defce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:48:00.128121 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1453/2889] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:48:00.136923 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91455e8c-7f24-4540-a56c-3ecaef71b3ca None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:00.137238 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91455e8c-7f24-4540-a56c-3ecaef71b3ca None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:00.137523 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91455e8c-7f24-4540-a56c-3ecaef71b3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:00.157103 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-91455e8c-7f24-4540-a56c-3ecaef71b3ca None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:48:00.158303 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-91455e8c-7f24-4540-a56c-3ecaef71b3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:48:00.166157 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1437/2890] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:48:00.170377 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680692e-d6eb-4fdb-9880-f318379defce None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:48:00.180239 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680692e-d6eb-4fdb-9880-f318379defce None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:48:00.184789 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abe458-b9f5-45ee-8e76-9e39b0343a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:48:00.185440 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abe458-b9f5-45ee-8e76-9e39b0343a92 admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:00.185725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abe458-b9f5-45ee-8e76-9e39b0343a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:00.185997 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abe458-b9f5-45ee-8e76-9e39b0343a92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:00.186715 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85abe458-b9f5-45ee-8e76-9e39b0343a92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:48:00.187646 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85abe458-b9f5-45ee-8e76-9e39b0343a92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:48:00.189225 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85abe458-b9f5-45ee-8e76-9e39b0343a92 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:48:00.195957 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:48:00.202203 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1454/2891] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jul 19 15:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:48:00.207081 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91455e8c-7f24-4540-a56c-3ecaef71b3ca None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:48:00.216544 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91455e8c-7f24-4540-a56c-3ecaef71b3ca None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:48:00.221291 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4cc38-c120-459c-b886-480a564a82b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:48:00.221943 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4cc38-c120-459c-b886-480a564a82b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:00.222230 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4cc38-c120-459c-b886-480a564a82b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:00.222509 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4cc38-c120-459c-b886-480a564a82b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:00.223200 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4cc38-c120-459c-b886-480a564a82b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:48:00.225102 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4cc38-c120-459c-b886-480a564a82b6 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:48:00.250602 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1438/2892] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:48:00 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:48:00.254669 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abe458-b9f5-45ee-8e76-9e39b0343a92 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:48:00.264769 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abe458-b9f5-45ee-8e76-9e39b0343a92 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:48:00.321032 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5568ae5-7606-4396-b6e5-329ddb1fe2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:48:00.321628 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5568ae5-7606-4396-b6e5-329ddb1fe2c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:00.321921 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5568ae5-7606-4396-b6e5-329ddb1fe2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:00.322205 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5568ae5-7606-4396-b6e5-329ddb1fe2c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:00.322911 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5568ae5-7606-4396-b6e5-329ddb1fe2c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:48:00.324900 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5568ae5-7606-4396-b6e5-329ddb1fe2c8 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:48:00.344622 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1455/2893] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:48:00 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:48:00.348920 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4cc38-c120-459c-b886-480a564a82b6 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:48:00.359750 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4cc38-c120-459c-b886-480a564a82b6 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:48:00.364656 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca518dd-d718-46a2-a51f-39fdee03bc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:48:00.365316 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca518dd-d718-46a2-a51f-39fdee03bc4e admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:00.365605 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca518dd-d718-46a2-a51f-39fdee03bc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:00.365886 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca518dd-d718-46a2-a51f-39fdee03bc4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:00.366614 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca518dd-d718-46a2-a51f-39fdee03bc4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:48:00.368234 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca518dd-d718-46a2-a51f-39fdee03bc4e admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:48:00.379239 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1439/2894] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:48:00.383189 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5568ae5-7606-4396-b6e5-329ddb1fe2c8 admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:48:00.393541 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5568ae5-7606-4396-b6e5-329ddb1fe2c8 admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:48:00.398630 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe4cac-f882-46a7-a632-fb96fa3f7dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:48:00.399333 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe4cac-f882-46a7-a632-fb96fa3f7dae admin admin] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:00.399622 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe4cac-f882-46a7-a632-fb96fa3f7dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:00.399901 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe4cac-f882-46a7-a632-fb96fa3f7dae admin admin] PATH_INFO: `/v3/roles` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:00.400629 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe4cac-f882-46a7-a632-fb96fa3f7dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:48:00.402226 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe4cac-f882-46a7-a632-fb96fa3f7dae admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:48:00.412813 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1456/2895] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:48:00.417120 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca518dd-d718-46a2-a51f-39fdee03bc4e admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:48:00.428090 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca518dd-d718-46a2-a51f-39fdee03bc4e admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:48:00.432875 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07db11-6497-4904-9569-8f8731354f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:48:00.433761 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07db11-6497-4904-9569-8f8731354f00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:00.434045 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07db11-6497-4904-9569-8f8731354f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:00.434325 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07db11-6497-4904-9569-8f8731354f00 admin admin] PATH_INFO: `/v3/projects/0b613718c47c4276a93173cb77245457/users/11875f968f9c4ab5aefab745fb9919f5/roles/ff311e825f2b4a3d809aa772f6cdecb0` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:00.451111 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07db11-6497-4904-9569-8f8731354f00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b613718c47c4276a93173cb77245457, user_id=11875f968f9c4ab5aefab745fb9919f5, role_id=ff311e825f2b4a3d809aa772f6cdecb0)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:48:00.453593 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07db11-6497-4904-9569-8f8731354f00 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:48:00.467894 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1440/2896] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:48:00 2022] PUT /identity/v3/projects/0b613718c47c4276a93173cb77245457/users/11875f968f9c4ab5aefab745fb9919f5/roles/ff311e825f2b4a3d809aa772f6cdecb0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:48:00.478546 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db627859-2b9e-4900-afc3-33cbcb74c74e None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:00.478830 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db627859-2b9e-4900-afc3-33cbcb74c74e None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:00.479116 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db627859-2b9e-4900-afc3-33cbcb74c74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:00.507850 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-db627859-2b9e-4900-afc3-33cbcb74c74e None None] MFA Rules not processed for user `11875f968f9c4ab5aefab745fb9919f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:48:00.509086 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-db627859-2b9e-4900-afc3-33cbcb74c74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:48:00.576611 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1457/2897] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:48:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:48:00.581402 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07db11-6497-4904-9569-8f8731354f00 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:48:00.590571 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:48:00.648839 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07db11-6497-4904-9569-8f8731354f00 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:48:00.653574 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596dfed-94b1-478d-a2df-d68a41843f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:48:00.654242 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596dfed-94b1-478d-a2df-d68a41843f37 admin admin] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:00.654526 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596dfed-94b1-478d-a2df-d68a41843f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:00.654809 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596dfed-94b1-478d-a2df-d68a41843f37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:00.655553 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596dfed-94b1-478d-a2df-d68a41843f37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:48:00.658016 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596dfed-94b1-478d-a2df-d68a41843f37 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:48:00.686612 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1441/2898] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jul 19 15:48:00 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:48:00.690788 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db627859-2b9e-4900-afc3-33cbcb74c74e None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:48:00.702529 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db627859-2b9e-4900-afc3-33cbcb74c74e None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:48:00.762767 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c998b-f86f-4c32-9e6c-4b0d7ced60fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:48:00.763508 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c998b-f86f-4c32-9e6c-4b0d7ced60fd admin admin] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:00.763792 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c998b-f86f-4c32-9e6c-4b0d7ced60fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:00.764072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c998b-f86f-4c32-9e6c-4b0d7ced60fd admin admin] PATH_INFO: `/v3/users` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:00.764774 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c998b-f86f-4c32-9e6c-4b0d7ced60fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:48:00.766986 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c998b-f86f-4c32-9e6c-4b0d7ced60fd admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:48:00.777919 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:48:00.791011 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1458/2899] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jul 19 15:48:00 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:48:00.794874 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596dfed-94b1-478d-a2df-d68a41843f37 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:48:00.807210 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596dfed-94b1-478d-a2df-d68a41843f37 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:48:00.812193 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e392ec-1058-4094-b689-2cd6ab2c718c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:48:00.812863 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e392ec-1058-4094-b689-2cd6ab2c718c admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:00.813146 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e392ec-1058-4094-b689-2cd6ab2c718c admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:00.813423 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e392ec-1058-4094-b689-2cd6ab2c718c admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:00.814148 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e392ec-1058-4094-b689-2cd6ab2c718c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:48:00.815768 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e392ec-1058-4094-b689-2cd6ab2c718c admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:48:00.829776 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1442/2900] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:48:00.834904 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c998b-f86f-4c32-9e6c-4b0d7ced60fd admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:48:00.845913 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c998b-f86f-4c32-9e6c-4b0d7ced60fd admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:48:00.850952 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498de2a6-4859-40b7-a54d-5d42f38d8d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:48:00.856316 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498de2a6-4859-40b7-a54d-5d42f38d8d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:00.856811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498de2a6-4859-40b7-a54d-5d42f38d8d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:00.857176 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498de2a6-4859-40b7-a54d-5d42f38d8d9b admin admin] PATH_INFO: `/v3/projects/b5901a0d4fbd456b93b0cf6ad5d0cdbf/users/fd25e6a9ab5645ab8f54df125d1707f5/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:00.875798 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498de2a6-4859-40b7-a54d-5d42f38d8d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5901a0d4fbd456b93b0cf6ad5d0cdbf, user_id=fd25e6a9ab5645ab8f54df125d1707f5, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:48:00.878464 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498de2a6-4859-40b7-a54d-5d42f38d8d9b admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:48:00.893300 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1459/2901] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:48:00 2022] PUT /identity/v3/projects/b5901a0d4fbd456b93b0cf6ad5d0cdbf/users/fd25e6a9ab5645ab8f54df125d1707f5/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:48:00.897379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e392ec-1058-4094-b689-2cd6ab2c718c admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:48:00.909256 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e392ec-1058-4094-b689-2cd6ab2c718c admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:48:00.977882 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cd56b-ce6b-45cb-ab28-11a066a460d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:48:00.978561 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cd56b-ce6b-45cb-ab28-11a066a460d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:00.978868 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cd56b-ce6b-45cb-ab28-11a066a460d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:00.979130 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cd56b-ce6b-45cb-ab28-11a066a460d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:00.979920 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cd56b-ce6b-45cb-ab28-11a066a460d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:48:00.981500 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cd56b-ce6b-45cb-ab28-11a066a460d4 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:48:00.995383 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1443/2902] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jul 19 15:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:48:00.998349 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498de2a6-4859-40b7-a54d-5d42f38d8d9b admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:48:01.020433 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498de2a6-4859-40b7-a54d-5d42f38d8d9b admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:48:01.027399 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e463150-8374-427a-a6b2-184d702e6cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:48:01.028410 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e463150-8374-427a-a6b2-184d702e6cfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:01.028766 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e463150-8374-427a-a6b2-184d702e6cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:01.029122 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e463150-8374-427a-a6b2-184d702e6cfe admin admin] PATH_INFO: `/v3/projects/b5901a0d4fbd456b93b0cf6ad5d0cdbf/users/fd25e6a9ab5645ab8f54df125d1707f5/roles/d884ddf33c1440d9b3a3351b85e83e76` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:01.032445 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e463150-8374-427a-a6b2-184d702e6cfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5901a0d4fbd456b93b0cf6ad5d0cdbf, user_id=fd25e6a9ab5645ab8f54df125d1707f5, role_id=d884ddf33c1440d9b3a3351b85e83e76)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:48:01.035360 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e463150-8374-427a-a6b2-184d702e6cfe admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:48:01.053753 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1460/2903] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jul 19 15:48:00 2022] PUT /identity/v3/projects/b5901a0d4fbd456b93b0cf6ad5d0cdbf/users/fd25e6a9ab5645ab8f54df125d1707f5/roles/d884ddf33c1440d9b3a3351b85e83e76 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:48:01.066306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cbf37-dbf7-4fe0-85b9-d6d1a5c22f56 None None] REQUEST_METHOD: `POST` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:01.066848 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cbf37-dbf7-4fe0-85b9-d6d1a5c22f56 None None] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:01.067255 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cbf37-dbf7-4fe0-85b9-d6d1a5c22f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:01.099334 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.auth.core [None req-1e3cbf37-dbf7-4fe0-85b9-d6d1a5c22f56 None None] MFA Rules not processed for user `fd25e6a9ab5645ab8f54df125d1707f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80305) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:48:01.100604 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-1e3cbf37-dbf7-4fe0-85b9-d6d1a5c22f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:48:01.184603 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1444/2904] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:48:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:48:01.192081 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e463150-8374-427a-a6b2-184d702e6cfe admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:48:01.193869 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-6e463150-8374-427a-a6b2-184d702e6cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:48:01.253796 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e463150-8374-427a-a6b2-184d702e6cfe admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:48:01.257426 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62d456-0477-4064-aaab-8dd672833efc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf1f5f0ccf8449191a8660e5b1906d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:48:01.258072 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62d456-0477-4064-aaab-8dd672833efc service cinder] REQUEST_METHOD: `GET` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:01.258367 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62d456-0477-4064-aaab-8dd672833efc service cinder] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:01.258642 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62d456-0477-4064-aaab-8dd672833efc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:01.268290 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62d456-0477-4064-aaab-8dd672833efc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:48:01.269736 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62d456-0477-4064-aaab-8dd672833efc service cinder] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:48:01.279330 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1461/2905] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:48:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:48:01.823343 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cbf37-dbf7-4fe0-85b9-d6d1a5c22f56 None None] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:48:01.827707 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:48:01.888016 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cbf37-dbf7-4fe0-85b9-d6d1a5c22f56 None None] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:48:01.892761 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589dc1f5-71c5-44d5-8364-ec3c43ad36b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:48:01.893630 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589dc1f5-71c5-44d5-8364-ec3c43ad36b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:01.893917 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589dc1f5-71c5-44d5-8364-ec3c43ad36b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:01.894198 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589dc1f5-71c5-44d5-8364-ec3c43ad36b5 admin admin] PATH_INFO: `/v3/users/11875f968f9c4ab5aefab745fb9919f5` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:01.895417 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589dc1f5-71c5-44d5-8364-ec3c43ad36b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11875f968f9c4ab5aefab745fb9919f5)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:48:01.897314 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589dc1f5-71c5-44d5-8364-ec3c43ad36b5 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:48:01.945183 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-589dc1f5-71c5-44d5-8364-ec3c43ad36b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11875f968f9c4ab5aefab745fb9919f5'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:01.957292 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-589dc1f5-71c5-44d5-8364-ec3c43ad36b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11875f968f9c4ab5aefab745fb9919f5'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:01.963997 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-589dc1f5-71c5-44d5-8364-ec3c43ad36b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11875f968f9c4ab5aefab745fb9919f5'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:01.964706 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-589dc1f5-71c5-44d5-8364-ec3c43ad36b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11875f968f9c4ab5aefab745fb9919f5'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:01.965306 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-589dc1f5-71c5-44d5-8364-ec3c43ad36b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11875f968f9c4ab5aefab745fb9919f5'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:01.979198 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1445/2906] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:48:01 2022] DELETE /identity/v3/users/11875f968f9c4ab5aefab745fb9919f5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:48:01.983716 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b68d07-4669-467d-b90f-ea0142b03fc6 None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:01.984544 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b68d07-4669-467d-b90f-ea0142b03fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:01.984824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b68d07-4669-467d-b90f-ea0142b03fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:02.002423 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-e0b68d07-4669-467d-b90f-ea0142b03fc6 None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:48:02.003643 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-e0b68d07-4669-467d-b90f-ea0142b03fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:48:02.060524 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1462/2907] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:48:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:48:02.070831 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589dc1f5-71c5-44d5-8364-ec3c43ad36b5 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:48:02.072340 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-589dc1f5-71c5-44d5-8364-ec3c43ad36b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:48:02.131552 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589dc1f5-71c5-44d5-8364-ec3c43ad36b5 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:48:02.135454 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059175e-3ff8-43d7-b421-7fa3ede00cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:48:02.136106 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059175e-3ff8-43d7-b421-7fa3ede00cfd service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:02.136396 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059175e-3ff8-43d7-b421-7fa3ede00cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:02.136832 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059175e-3ff8-43d7-b421-7fa3ede00cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:02.146440 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059175e-3ff8-43d7-b421-7fa3ede00cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:48:02.147909 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059175e-3ff8-43d7-b421-7fa3ede00cfd service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:48:02.158324 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1446/2908] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:48:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:48:02.461575 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b68d07-4669-467d-b90f-ea0142b03fc6 None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:48:02.463365 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-e0b68d07-4669-467d-b90f-ea0142b03fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:48:02.488568 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b68d07-4669-467d-b90f-ea0142b03fc6 None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:48:02.493920 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fba73-cac0-4b70-a4f5-d4e4045fd8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:48:02.495115 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fba73-cac0-4b70-a4f5-d4e4045fd8ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:02.495400 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fba73-cac0-4b70-a4f5-d4e4045fd8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:02.495794 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fba73-cac0-4b70-a4f5-d4e4045fd8ca admin admin] PATH_INFO: `/v3/projects/0b613718c47c4276a93173cb77245457` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:02.497115 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2fba73-cac0-4b70-a4f5-d4e4045fd8ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b613718c47c4276a93173cb77245457)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:48:02.499104 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2fba73-cac0-4b70-a4f5-d4e4045fd8ca admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:48:02.548049 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-7b2fba73-cac0-4b70-a4f5-d4e4045fd8ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b613718c47c4276a93173cb77245457', 'request_id': 'req-7b2fba73-cac0-4b70-a4f5-d4e4045fd8ca'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:02.556248 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-7b2fba73-cac0-4b70-a4f5-d4e4045fd8ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b613718c47c4276a93173cb77245457', 'request_id': 'req-7b2fba73-cac0-4b70-a4f5-d4e4045fd8ca'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:02.558803 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:48:02.564939 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-7b2fba73-cac0-4b70-a4f5-d4e4045fd8ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b613718c47c4276a93173cb77245457', 'request_id': 'req-7b2fba73-cac0-4b70-a4f5-d4e4045fd8ca'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:02.576926 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-7b2fba73-cac0-4b70-a4f5-d4e4045fd8ca admin admin] The token cache is being invalidate because project 0b613718c47c4276a93173cb77245457 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:48:02.577214 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-7b2fba73-cac0-4b70-a4f5-d4e4045fd8ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:02.578108 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-7b2fba73-cac0-4b70-a4f5-d4e4045fd8ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:02.580768 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1463/2909] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:48:02 2022] DELETE /identity/v3/projects/0b613718c47c4276a93173cb77245457 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:48:02.585582 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059175e-3ff8-43d7-b421-7fa3ede00cfd service neutron] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:48:02.597725 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059175e-3ff8-43d7-b421-7fa3ede00cfd service neutron] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:48:02.619590 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:48:02.661932 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a110c-8a02-4e61-9568-e22fcfdb49e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:48:02.663393 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a110c-8a02-4e61-9568-e22fcfdb49e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:02.664055 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a110c-8a02-4e61-9568-e22fcfdb49e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:02.664851 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a110c-8a02-4e61-9568-e22fcfdb49e1 admin admin] PATH_INFO: `/v3/users/fd25e6a9ab5645ab8f54df125d1707f5` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:02.667097 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a110c-8a02-4e61-9568-e22fcfdb49e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd25e6a9ab5645ab8f54df125d1707f5)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:48:02.669803 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a110c-8a02-4e61-9568-e22fcfdb49e1 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:48:02.719471 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-777a110c-8a02-4e61-9568-e22fcfdb49e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd25e6a9ab5645ab8f54df125d1707f5'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:02.731471 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-777a110c-8a02-4e61-9568-e22fcfdb49e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd25e6a9ab5645ab8f54df125d1707f5'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:02.738618 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-777a110c-8a02-4e61-9568-e22fcfdb49e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd25e6a9ab5645ab8f54df125d1707f5'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:02.739317 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-777a110c-8a02-4e61-9568-e22fcfdb49e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd25e6a9ab5645ab8f54df125d1707f5'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:02.739922 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-777a110c-8a02-4e61-9568-e22fcfdb49e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd25e6a9ab5645ab8f54df125d1707f5'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:02.752849 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1447/2910] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:48:02 2022] DELETE /identity/v3/users/fd25e6a9ab5645ab8f54df125d1707f5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:48:03.026830 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fba73-cac0-4b70-a4f5-d4e4045fd8ca admin admin] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:48:03.028351 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-7b2fba73-cac0-4b70-a4f5-d4e4045fd8ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:48:03.042338 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fba73-cac0-4b70-a4f5-d4e4045fd8ca admin admin] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:48:03.100535 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ad6f2-cce3-48ab-a904-7029155cca7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:48:03.101404 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ad6f2-cce3-48ab-a904-7029155cca7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:03.101716 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ad6f2-cce3-48ab-a904-7029155cca7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:03.102004 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ad6f2-cce3-48ab-a904-7029155cca7a admin admin] PATH_INFO: `/v3/projects/b5901a0d4fbd456b93b0cf6ad5d0cdbf` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:03.103210 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ad6f2-cce3-48ab-a904-7029155cca7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5901a0d4fbd456b93b0cf6ad5d0cdbf)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:48:03.105194 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ad6f2-cce3-48ab-a904-7029155cca7a admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:48:03.151471 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-5e0ad6f2-cce3-48ab-a904-7029155cca7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5901a0d4fbd456b93b0cf6ad5d0cdbf', 'request_id': 'req-5e0ad6f2-cce3-48ab-a904-7029155cca7a'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:03.161776 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-5e0ad6f2-cce3-48ab-a904-7029155cca7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5901a0d4fbd456b93b0cf6ad5d0cdbf', 'request_id': 'req-5e0ad6f2-cce3-48ab-a904-7029155cca7a'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:03.170383 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-5e0ad6f2-cce3-48ab-a904-7029155cca7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5901a0d4fbd456b93b0cf6ad5d0cdbf', 'request_id': 'req-5e0ad6f2-cce3-48ab-a904-7029155cca7a'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:03.181543 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-5e0ad6f2-cce3-48ab-a904-7029155cca7a admin admin] The token cache is being invalidate because project b5901a0d4fbd456b93b0cf6ad5d0cdbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:48:03.181835 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-5e0ad6f2-cce3-48ab-a904-7029155cca7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:03.182478 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-5e0ad6f2-cce3-48ab-a904-7029155cca7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:03.184078 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1464/2911] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:48:03 2022] DELETE /identity/v3/projects/b5901a0d4fbd456b93b0cf6ad5d0cdbf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:48:12.748721 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:48:13.178519 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:DELETE=10,keystone:SELECT=55,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:48:28.412127 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a110c-8a02-4e61-9568-e22fcfdb49e1 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:48:28.413592 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-777a110c-8a02-4e61-9568-e22fcfdb49e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:48:28.426947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a110c-8a02-4e61-9568-e22fcfdb49e1 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:48:28.483859 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bc49a-b228-44fa-afd9-787c40d16699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:48:28.484855 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bc49a-b228-44fa-afd9-787c40d16699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:28.485141 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bc49a-b228-44fa-afd9-787c40d16699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:28.485433 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bc49a-b228-44fa-afd9-787c40d16699 admin admin] PATH_INFO: `/v3/users/8d3cf3ec8feb4991bc4c05883b403d6c` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:28.486621 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517bc49a-b228-44fa-afd9-787c40d16699 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d3cf3ec8feb4991bc4c05883b403d6c)` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:48:28.488614 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517bc49a-b228-44fa-afd9-787c40d16699 admin admin] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:48:28.533798 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-517bc49a-b228-44fa-afd9-787c40d16699 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d3cf3ec8feb4991bc4c05883b403d6c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:28.546190 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-517bc49a-b228-44fa-afd9-787c40d16699 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d3cf3ec8feb4991bc4c05883b403d6c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:28.552917 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-517bc49a-b228-44fa-afd9-787c40d16699 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d3cf3ec8feb4991bc4c05883b403d6c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:28.553615 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-517bc49a-b228-44fa-afd9-787c40d16699 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d3cf3ec8feb4991bc4c05883b403d6c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:28.554235 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.notifications [None req-517bc49a-b228-44fa-afd9-787c40d16699 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d3cf3ec8feb4991bc4c05883b403d6c'} {{(pid=80305) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:28.566960 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1448/2912] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jul 19 15:48:28 2022] DELETE /identity/v3/users/8d3cf3ec8feb4991bc4c05883b403d6c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:48:28.571558 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a4797-7263-44f5-861f-3f24355801ce None None] REQUEST_METHOD: `POST` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:28.572080 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a4797-7263-44f5-861f-3f24355801ce None None] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:28.572203 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a4797-7263-44f5-861f-3f24355801ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:28.590263 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.auth.core [None req-073a4797-7263-44f5-861f-3f24355801ce None None] MFA Rules not processed for user `a5979772c3b54e8bb6dcc49d7d98fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:48:28.591503 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-073a4797-7263-44f5-861f-3f24355801ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:48:28.651262 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1465/2913] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jul 19 15:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:48:28.662240 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bc49a-b228-44fa-afd9-787c40d16699 admin admin] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:48:28.664037 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-517bc49a-b228-44fa-afd9-787c40d16699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:48:28.723947 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bc49a-b228-44fa-afd9-787c40d16699 admin admin] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:48:28.728245 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fefb7-0fa3-450c-ba0a-465d0560f567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c89e7fbcc22c478c98d74b802f4bf8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:48:28.728886 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fefb7-0fa3-450c-ba0a-465d0560f567 service neutron] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:28.729198 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fefb7-0fa3-450c-ba0a-465d0560f567 service neutron] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:28.729495 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fefb7-0fa3-450c-ba0a-465d0560f567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:28.738533 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fefb7-0fa3-450c-ba0a-465d0560f567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:48:28.739973 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fefb7-0fa3-450c-ba0a-465d0560f567 service neutron] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:48:28.749888 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1449/2914] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:48:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:48:29.019089 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a4797-7263-44f5-861f-3f24355801ce None None] Authenticating user token {{(pid=80304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:48:29.020552 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.fernet_utils [None req-073a4797-7263-44f5-861f-3f24355801ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:48:29.038777 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a4797-7263-44f5-861f-3f24355801ce None None] Validating token access rules against request {{(pid=80304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:48:29.043538 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016026e0-909e-4d0b-aa0a-b6f6f3c10fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5979772c3b54e8bb6dcc49d7d98fa0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32cd8d80a1f1402daab4eabadc4fd0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:48:29.044438 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016026e0-909e-4d0b-aa0a-b6f6f3c10fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:29.044725 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016026e0-909e-4d0b-aa0a-b6f6f3c10fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:29.045004 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016026e0-909e-4d0b-aa0a-b6f6f3c10fc5 admin admin] PATH_INFO: `/v3/projects/70fe2a55b32848559373d2a355557cb0` {{(pid=80304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:29.046395 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016026e0-909e-4d0b-aa0a-b6f6f3c10fc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70fe2a55b32848559373d2a355557cb0)` {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:48:29.048378 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016026e0-909e-4d0b-aa0a-b6f6f3c10fc5 admin admin] RBAC: Authorization granted {{(pid=80304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:48:29.096338 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-016026e0-909e-4d0b-aa0a-b6f6f3c10fc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70fe2a55b32848559373d2a355557cb0', 'request_id': 'req-016026e0-909e-4d0b-aa0a-b6f6f3c10fc5'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:29.102811 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-016026e0-909e-4d0b-aa0a-b6f6f3c10fc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70fe2a55b32848559373d2a355557cb0', 'request_id': 'req-016026e0-909e-4d0b-aa0a-b6f6f3c10fc5'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:29.109985 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-016026e0-909e-4d0b-aa0a-b6f6f3c10fc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70fe2a55b32848559373d2a355557cb0', 'request_id': 'req-016026e0-909e-4d0b-aa0a-b6f6f3c10fc5'} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:29.120375 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-016026e0-909e-4d0b-aa0a-b6f6f3c10fc5 admin admin] The token cache is being invalidate because project 70fe2a55b32848559373d2a355557cb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:48:29.120656 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-016026e0-909e-4d0b-aa0a-b6f6f3c10fc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:29.121289 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG keystone.notifications [None req-016026e0-909e-4d0b-aa0a-b6f6f3c10fc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:48:29.122824 dv-cinder-849846-2-smb devstack@keystone.service[80304]: [pid: 80304|app: 0|req: 1466/2915] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jul 19 15:48:29 2022] DELETE /identity/v3/projects/70fe2a55b32848559373d2a355557cb0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:48:38.745777 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:48:39.117240 dv-cinder-849846-2-smb devstack@keystone.service[80304]: DEBUG dbcounter [-] [80304] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:26.048725 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fefb7-0fa3-450c-ba0a-465d0560f567 service neutron] Authenticating user token {{(pid=80305) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:26.050820 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-9b0fefb7-0fa3-450c-ba0a-465d0560f567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:26.203427 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fefb7-0fa3-450c-ba0a-465d0560f567 service neutron] Validating token access rules against request {{(pid=80305) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:26.263382 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81abc2-2b0f-40b5-be10-b70eb4474dcc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a27fe78683743c397fe7929e9053c5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54934775a86487295bdbc02ed3a0103', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80305) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:26.264082 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81abc2-2b0f-40b5-be10-b70eb4474dcc service placement] REQUEST_METHOD: `GET` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:26.264379 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81abc2-2b0f-40b5-be10-b70eb4474dcc service placement] SCRIPT_NAME: `/identity` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:26.264663 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81abc2-2b0f-40b5-be10-b70eb4474dcc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80305) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:26.267175 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.fernet_utils [None req-ed81abc2-2b0f-40b5-be10-b70eb4474dcc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80305) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:26.280618 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81abc2-2b0f-40b5-be10-b70eb4474dcc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:26.282219 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81abc2-2b0f-40b5-be10-b70eb4474dcc service placement] RBAC: Authorization granted {{(pid=80305) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:26.292786 dv-cinder-849846-2-smb devstack@keystone.service[80305]: [pid: 80305|app: 0|req: 1450/2916] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jul 19 15:51:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:51:36.288287 dv-cinder-849846-2-smb devstack@keystone.service[80305]: DEBUG dbcounter [-] [80305] Writing DB stats keystone:SELECT=89 {{(pid=80305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}